Models

Display Name

Make the name memorable and imply it's usage.

Model Name

The model's id as used in the API. i.e. llama3-70b

Description

A brief summary about this model.

Is this model for LLM or Embeddings

Some models can do both, in which case enter it twice.

The Base URL of the model

The URL location of the OpenAI compatible API

Visibility

Who can use this model

The API secret from your provider

This will be given in the providers console

Set the maximum tokens per minute for each user.

If users exceed this limit there access to the model will be limited.

Set the maximum requests per minute for each user.

If users exceed this limit there access to the model will be limited.

Context Size

How much data can be passed to the prompt

Capabilities are only available for LLM models.

Disclaimer

This is displayed at the bottom of the chat.

Example 1

Give the user an example prompt.

Example 2

Give the user an example prompt.

Example 3

Give the user an example prompt.

Example 4

Give the user an example prompt.