Runtime Error: ImportError: cannot import name 'driver' from 'triton.runtime' in FinGPT / Hugging Face Model Deployment

[126MANGESH]

Dear FinGPT and Hugging Face Support Team,

I hope this message finds you well.

I am reaching out to report a runtime issue I encountered while deploying or running a model using the FinGPT/Hugging Face LLM integration. The application consistently fails with the following error trace:
Details

Environment: Python 3.11.17

Libraries involved: peft, bitsandbytes, triton

Runtime: (Please specify if running on FinGPT cloud, Hugging Face Space, or local deployment)

Error Summary: The bitsandbytes library is unable to import the driver module from triton.runtime, causing the model initialization to fail.

Request

I would appreciate your guidance on how to resolve or patch this issue.
If this is a known compatibility or dependency mismatch, kindly share the recommended versions of bitsandbytes and triton that work with the current FinGPT/Hugging Face runtime.

Thank you for your time and support.

Warm regards,
Mangesh Jadhav
B.Tech – Artificial Intelligence & Machine Learning
G.H. Raisoni College of Engineering, Pune
📧 mangeshjadhav126@gmail.com
📱 +91 7498958281