AI Providing Incorrect or Out-of-Context Answers

When your AI provides incorrect answers or goes off-topic, it's usually due to one of two issues. Here’s how you can troubleshoot and fix these problems.

1. Base Prompt Issue

Your AI model's base prompt might not include clear instructions on when to refuse to answer. Without these guidelines, the AI might attempt to respond even when it lacks the relevant information or when the question is outside your business context.

Solution:

Add an instruction to the base prompt, such as:

This ensures the AI stays within the boundaries of its training data and only provides accurate, relevant responses.

2. Using a Restriction Prompt

A restriction prompt helps limit what the AI can respond to, keeping it focused on the intended context.

Solution:

Use a restriction prompt to define limitations on the AI's responses. This will help maintain relevance and prevent the AI from going off-topic.

Tracing AI Response Sources

To ensure your AI is providing accurate information, it's crucial to trace the data sources it used to generate its answers.

Steps to Check Data Sources:

1. Go to the Conversation page.

2. Open the conversation you want to review.

3. Click on View Source to see the information sources used for each AI-generated response.

This feature displays a list of data sources the AI referenced. You can even navigate directly to the source document.

Correcting training data or data sources:

Knowing the source of the information allows you to update your training data if there are any errors.

If you want to make corrections to the data sources:

1. Click the “source” button.

2. This takes you to the debug lab, where all the sources from that document are listed.

3. Here, you can search, remove, or edit these sources.

Keeping your data sources accurate ensures that your AI continues to provide correct and contextually appropriate answers.