Enhanced Dashboard Analytics #22
Description
Summary
Advanced analytics beyond token counts: response time percentiles (p50/p95/p99), error categorization, conversation completion rates, user satisfaction (thumbs up/down), cost-per-conversation breakdown.
Motivation
Current analytics are token-focused. Production teams need quality and performance metrics. Knowing token spend is useful, but knowing if agents are actually helping users is essential.
Scope
- User feedback collection: thumbs up/down on each response in chat + widget
- New metrics: response latency percentiles, error rate by type, satisfaction rate
- Cost-per-conversation calculation (aggregate tokens across multi-turn)
- Conversation completion rate (did user get what they needed?)
- Dashboard: new charts, exportable reports (CSV/PDF), date range comparisons
- Agent comparison view: side-by-side metrics for different agents
Acceptance Criteria
- Thumbs up/down feedback in chat and widget
- Response latency percentiles displayed
- Cost-per-conversation calculated and shown
- Exportable analytics reports
- Agent comparison view