KoboldAI Lite

Welcome To KoboldAI Lite

Welcome to KoboldAI Lite!
Pick a UI Style to get started. You can always change it later in the Settings menu.

Classic UI

Aesthetic UI

Corpo UI

Alternatively, you can Load A Savefile or Quick Start Scenario

Context Data

Memory?Put the information you want the AI to always remember. It will be inserted into the top of every request sent to the AI.

Newline After Memory

Author's Note?Similar to Memory, but inserted near the end of the text instead of the start. A good way to control the mood/behavior of the AI.

Author's Note Template?A placeholder, will be inserted with the author's note replacing the <|>. You generally don't need to change this. A/N Strength?Controls how far back to insert the Author's Note. Notes injected closer to the end have a stronger effect.

?WorldInfo Groups can be used to segment data, e.g. entries for a specific place, person or event. Each entire group can be toggled on/off on demand.

Toggle Group

WI Insert Location ?Controls where the world info should be inserted

WI Search Depth ?Controls how far back in the text to search for World Info Keys

Case Sensitive Keys

Automatically search and include relevant snippets from a text document or history.

Enable TextDB

Use Embeddings for Searching ? If enabled, the text DB is converted to vectors using the KoboldCPP embedding endpoint. If not, it uses the traditional TextDB keyword based search. Generally, embeddings are slower to generate initially (so when making changes to DB the next response might be very slow) - but may understand the context of the sentence better while also potentially supporting multiple languages.

Delete Embedding cache ? When embeddings are enabled, they get generated by the KCPP server and then are cached in the web browser. This button clears the browser cache.

Add document to TextDB ? Tries to extract the text from the document, adding (or overwriting) an existing document in the TextDB with the same name.

Search Includes Context History ? If enabled, the entire story/chat history is used as a searchable document.

Num. Search Results ?Controls how many search results to retrieve from DB. Each search result is added to the context as a snippet of the DB document.

1

10

Extra Text For Search ?Adds the specified amount of characters from the context before the last user message to the search query.

50

500

Snippet Size ?Controls the size (in characters) of each snippet taken from the documents.

100

3000

Please note, as with world info this can cause context reprocessing. It is recommended to have at least 8K context size and a good prompt processing speed to use this feature.

TextDB Storage?Paste as much raw text data here as you like. E.g. background information, reference documents, etc. This text will populate the database that will be chunked and searched by TextDB. This can be split using "[DOCUMENT BREAK]" to split the overall database into smaller documents, and titles can be added with "[DOCUMENT BREAK][Title of document]This is the content of the document".

Settings

Sampler Preset ?Pick from an easy selection of curated generation presets, or configure your own.

Context Size ?Maximum number of context tokens submitted to the AI. Must exceed max output tokens. Can be further increased by editing the textbox. Older models stop at 2048, newer ones can do 4096 or greater.

512

4096

Auto-Adjust Limits

Max Output ?Number of tokens the AI should generate. Higher numbers will take longer to generate.

16

512

Auto-Adjust Limits

Temperature ?Randomness of sampling. High values can increase creativity but may make text less sensible. Lower values will make text more predictable but can become repetitious.

0.1

2

Repetition Penalty ?Used to penalize words that were already generated or belong to the context (too high causes incoherence!).

1

2

Top-P Sampling ?Used to discard unlikely text in a nucleus sampling process. Lower values will make text more predictable but can become repetitious. Set to 1 to deactivate it.

0

1

Top-K Sampling ?Top-K Sampling. Discards all but the K most likely tokens. Set 0 to Deactivate. Range 0 to 100.

0

1

Advanced Sampler Config ?These settings control alternative samplers configurations. They are inactive by default, you usually do not need to change them.

Top-A

Typical

TFS

Min-P

Pr. Pen.

Seed

Rp.Range

Rp.Slope

Smooth.F

DyTemp

EOS Token Ban ?Allow the End-Of-Stream (EOS) token and potentially other restricted special tokens to be generated.

Token Limit Multiplier ?Adds a multiplier to token estimations, useful if token counts are inaccurate. Influences text truncation. Higher values increases token allowance.

Sampler Order ? The order by which all 7 samplers are applied, separated by commas. 0=top_k, 1=top_a, 2=top_p, 3=tfs, 4=typ, 5=temp, 6=rep_pen

Mirostat ? Replaces your samplers with mirostat, an alternative sampling method. May not be available depending on backend, not supported on Horde.

Mode

Tau

Eta

Mirostat Not Supported

DRY (If supported) ?An advanced multi-token repetition penalty. Range controlled by Rep-Pen Range. May not be available depending on backend, not supported on Horde.

Mult.

Base

A.Len

DRY Not Supported

XTC ? Enables Exclude Top Choices (XTC) Sampling. May not be available depending on backend, not supported on Horde.

Threshold

Probability

XTC Not Supported

Grammar ? Grammar Sampling (KCPP) - Allows you to constrain output to fit specific structures. Resets grammar state every generation unless Retain is checked.

Retain

T.NSigma

Aesthetic UI customization panel

Background Style

Bubble Color:

System 🖌️

You 🖌️

AI 🖌️

Rounded Bubbles:

Color Background:

Min Height:

px

Horizontally-centered text:

Margin (px):

L:

R:

T:

B:

Padding (px):

L:

R:

T:

B:

Portrait Style

Portraits:

🖼️ Your Portrait

🖼️ AI's Portrait

Portrait Style:

(Reset Image)

User Portrait:

Size:

px

A/R:

AI Portrait:

Size:

px

A/R:

Show Names (Chat Mode):

Font Style

Font Size:

px

Customize:

Per-entity:

Style Text:

Colors:

text🖌️

"speech"🖌️

*action*🖌️

You:

text🖌️

"speech"🖌️

*action*🖌️

AI:

text🖌️

"speech"🖌️

*action*🖌️

System:

text🖌️

"speech"🖌️

*action*🖌️

Code blocks:

background🖌️

foreground🖌️

(Reset All Styles)

Style Preview

Quick Start - Select A Scenario

Automatically select AI model ? This option picks a suitable AI model based on the selected scenario. If no text model is currently selected, an appropriate one will be automatically picked for you.

Roleplay Character Creator

This tool is an easy way to create your own roleplay characters.
Alternatively, you can click here to import an existing Tavern Character Card.

Character Name:

Character Avatar:

Use Character Template ?Adds a character template to memory while creating the character instead.

Character Persona:

Describe Scenario:

Character Greeting:

After creating your character, you can edit it further at any time in the 'Context' memory window.

Save File / Load File / Export File

Slot Storage Option

Data Location

Selected Slot

Caution: Local Storage Slots are saved to a temporary cache and can be deleted by your browser. KoboldCpp remote storage will save data to a file in your KoboldCpp server. To avoid losing data, use the download file button.

KoboldCpp Admin Config

Save / Load Context State:

Change Loaded Model / Config:

Warning: This will terminate the current KoboldCpp instance and relaunch it with a new config. If an invalid configuration is selected, the new server may fail to relaunch!

Really Start A New Session?

Unsaved data will be lost.

Keep AI Selected?

Keep Memory and World Info?

Advanced Load File

Select categories to import from saved file. Selected categories will be overwritten. Unselected categories will retain original values.

Main Story
Memory and Author's Note
World Info and TextDB
Tokens and Regex Settings
General Settings
Aesthetic Settings

Image Information

Loading...

Worker List

Name	Model	Capabilities	Uptime	Kudos

My Worker List

Name	Description	Uptime	Kudos	Maint.	Del.

Share Story

Dynamic Temperature Wizard

Dynamic temperature is specified by a Temperature Value and a Temperature Range. Actual temperature is allowed to be automatically adjusted dynamically between (DynaTemp ± DynaRange).

For ease of use, a simple converter is provided here. Setting both values to the same temperature disables DynaTemp.

Minimum Temperature:

Maximum Temperature:

Temperature:

DynaTemp-Range:

DynaTemp-Exponent:

Add New Image

Paste Image From Clipboard

Capture Image From Camera

Share Story Import / Export

Chat Selectors


Language


TTS Model
TTS Voice

Please Note