Libretto monitors LLM behavior daily to catch subtle shifts in model performance before they impact your prompts. By tracking responses to 10 core prompts across top models, Libretto identifies outlier changes, alerting you if a tweak alters your expected outcomes. Don’t let unseen model updates disrupt your workflow—gain the confidence that your prompts perform as intended, every time
Model | Anomalies % | Anomalies by day | Status |
---|---|---|---|
![]() Claude 3.5 Sonnet (version 2024-06-20) Anthropic | 1.40 % (330) | Drift Possible | |
![]() Gemini 1.5 Flash Google Gemini | 8.30 % (1540) | Drift Likely | |
![]() Claude 3.5 Haiku Anthropic | 1.36 % (283) | No Drift | |
![]() GPT-4o OpenAI | 1.37 % (291) | Drift Possible | |
![]() GPT-4o mini OpenAI | 1.59 % (610) | Drift Likely |