Aegis Monitor Documentation

LLM evaluation, cost monitoring, regression detection, and model comparison.

Use this page as the documentation homepage for the library.

Usage Guide

Install, configure, run evaluations, compare models, and use Python API.

Open Usage Guide

Full Documentation

Complete project reference across architecture, workflows, and operations.

Open Full Documentation

Architecture

Detailed system design, module boundaries, extension points, and data flow.

Open Architecture

Contributing

Project standards, PR process, testing expectations, and setup steps.

Open Contributing

Quick Start

pip install aegis-ai

# evaluate a dataset
aegis eval run --dataset examples/datasets/qa_sample.yaml --model gpt-4

# compare multiple models
aegis compare --dataset examples/datasets/qa_sample.yaml --models gpt-4,gpt-3.5-turbo,claude-3-opus

Examples

simple_eval.py · model_compare.py · cost_tracking_demo.py · sentiment_classification.py · qa_evaluation.py