integration in chat-ui
#1
by
micrem73
- opened
Hi, for academic and educational purposes, I would like to develop a RAG-enabled chatbot based on Minerva7b. I tried to clone Hugginchat and instantiate the MODEL variable with sapienzanlp/Minerva-7B-base-v1.0 , but the resulting app answers "fetch error" when prompted. Do you have any suggestion? Otherwise, is it a feasible approach to install chat-ui and run sapienzanlp/Minerva-7B-instruct-v1.0-GGUF via Ollama?
Hi, on HuggingChat, consider using the instruct version of the model instead of the base one. If you're able to deploy the model on a local machine, Chat-UI offers a straightforward solution.
I succeeded in deploying ChatUI, and setting sapienzanlp/Minerva-7B-instruct-v1.0-GGUF as model. It works flawlessly, thanks.
micrem73
changed discussion status to
closed