in progress
AEGIS
An agentic evaluation system that uses agents to test and score LLM applications.
Idea
Static benchmarks miss how LLM applications fail in real use. AEGIS uses agents to probe an application, run multi-step scenarios, and score the results, so evaluation looks more like real usage.
Stack
Python, LLM agents.