Avoiding hallucination
Providing context can help minimize hallucinations by anchoring the model’s response to the facts and details you supply.
If you ask a model to summarize a company’s performance, the model is more likely to produce an accurate summary if you include a relevant stock market report in your prompt.
Access to data
LLMs have a fixed knowledge cutoff and cannot access real-time or proprietary data unless it is provided in the prompt.
If you need the model to answer questions about recent events or organization-specific information, you must supply that data as part of your prompt. This ensures that the model’s responses are up-to-date and relevant to your particular use case.
You could also provide statistics or data points in the prompt to help the model include useful facts in its response.
Check Your Understanding
Providing Context to LLMs
Which of the following statements are true about providing context to Large Language Models (LLMs)? (Select all that apply)
-
✓ Providing context in a prompt can help reduce hallucinations in LLM responses.
-
✓ Supplying up-to-date information in a prompt allows the LLM to generate more relevant answers.
-
✓ Including specific instructions or examples in a prompt can improve the accuracy of the model’s output.
-
❏ LLMs can access real-time data from the internet without any context provided in the prompt.
Hint
LLMs provide responses based on their training data and the context given in the prompt.
Solution
The following statements are true:
-
Providing context in a prompt can help reduce hallucinations in LLM responses.
-
Supplying up-to-date information in a prompt allows the LLM to generate more relevant answers.
-
Including specific instructions or examples in a prompt can improve the accuracy of the model’s
LLMs cannot access real-time data.
Lesson Summary
In this lesson, you learned about how providing context in your prompts can help reduce hallucinations and improve the accuracy of LLM responses.
In the next module, you will learn about you can use RAG (Retrieval-Augmented Generation) to include additional context in your prompts.