As you may know, each chat model has a different context length limit:

• GPT-4o: 128,000 tokens
• Claude 3.5 Sonnet: 200,000 tokens
• Gemini 1.5 Pro: up to 2M tokens

<aside> 💡 Learn more about tokens here

</aside>

What happen when you reached context length limit on TypingMind?

When the limit of context length is reached in a TypingMind conversation:

• An alert that says “Context length limit reached” will appear
• And you can still continue chatting with the AI assistant. However, the system will automatically forget a specific number of earliest text messages to allow room for new content that you input.

<aside> 💡 Please note that the AI model will continuously preserve the system message that you set up via the initial system instruction or AI Character

</aside>

Make use of the context limit on TypingMind

Using context limit enables the AI model to remember only a certain number of recent messages.

So, if your conversation history isn't that crucial, you can limit the AI's memory to only the x number of the latest messages.

<aside> 💡 With that being said, the AI can still remember and give answers as you guide it in the system instruction. It just forgets your previous messages.

</aside>