Using Oobabooga
Learn how to set up and configure Oobabooga text-generation-webui as an AI backend for Arcania
⚠️ Dieser Inhalt ist noch nicht in Ihrer Sprache verfügbar.
You can find the full Oobabooga documentation here.
Installation Steps
-
Install Oobabooga:
python3 -m venv venv source venv/bin/activate # choose correct requirements.txt for your system pip install -r requirements.txt # install the openai extension pip install -r extensions/openai/requirements.txt
-
Start the server:
python server.py --api
-
Configure Oobabooga: Open http://127.0.0.1:7860/ in your browser and configure the server. Make sure you load the model in the "Model" tab.
-
Enable the server in the client:
settings -> ChatBot -> ChatBot Backend -> ChatGPT
Next, set the OpenAI URL to
http://localhost:5000
settings -> ChatBot -> ChatGPT -> OpenAI URL -> http://localhost:5000