DokumentationGetting StartedIkigenia PlatformLearning HubArcaniaGuidesUsing Oobabooga

Using Oobabooga

Learn how to set up and configure Oobabooga text-generation-webui as an AI backend for Arcania

⚠️ Dieser Inhalt ist noch nicht in Ihrer Sprache verfügbar.

You can find the full Oobabooga documentation here.

Installation Steps

  1. Install Oobabooga:

    python3 -m venv venv
source venv/bin/activate
# choose correct requirements.txt for your system
pip install -r requirements.txt
# install the openai extension
pip install -r extensions/openai/requirements.txt

  2. Start the server:

    python server.py --api

  3. Configure Oobabooga: Open http://127.0.0.1:7860/ in your browser and configure the server. Make sure you load the model in the "Model" tab.

  4. Enable the server in the client:

    settings -> ChatBot -> ChatBot Backend -> ChatGPT

    Next, set the OpenAI URL to http://localhost:5000

    settings -> ChatBot -> ChatGPT -> OpenAI URL -> http://localhost:5000
Ollama VerwendenOpenAI Verwenden