- Explore why some LLM answers are insufficient according to your users
- Pinpoint user actions and questions that lead to dissatisfaction
- Determine topics where LLMs’ answers are inadequate for your users
- Understand the time your users need to get the answers they were looking for
- Evaluate the efficacy of RAG data sources for your users
- Analyze user behavior after (or before) receiving an unsatisfactory answer
Understanding frustration reasons
The best way to easily understand why your users are dissatisfied with your LLM answers is using the Analytics chart filtering users or interactions byfrustration cause.
| Frustration reason | Description |
|---|---|
| Verbosity | Users are frustrated by overly lengthy responses |
| Limited knowledge | Users are unsatisfied when the LLM doesn’t have the information they seek |
| Lack of understanding | Users feel misunderstood when the LLM misinterprets their query |
| Lack of clarity | Users are confused by unclear or ambiguous answers from the LLM |
| Lack of depth | Users find the LLM’s responses superficial and not insightful |