Evals
Measure model and agent quality.
01/ 07
Science
- API
- /v1/eval
- Google Cloud
- Vertex AI Eval
- Evals
- Open source
- On-chain settlement
Read https://hanzo.ai/skill.md and use Hanzo Evals in my project. Start with: hanzo eval runs create
The service the session above is changing.
- $hanzo eval runs create
- →api.hanzo.ai/v1/eval
- ≈Vertex AI Eval
Every request enters here, so the limiter does too.
Every request enters here, so the limiter does too.
The service the session above is changing.
A build is running from the last commit on main.
Static, published by the same pipeline as the rest.
api.hanzo.ai/v1/evalOpen in the consolePaste and ship
Paste this into any agent. It reads the skill manifest and calls Evals from there.
Read https://hanzo.ai/skill.md and use Hanzo Evals in my project. Start with: hanzo eval runs createAgent promptapi/v1/eval
Science
Benchmark, grade, and regression-test models and agents. LLM-as-judge, golden sets, and drift detection with reproducible scorecards anchored on-chain.
Source- Beta
Evals
Measure model and agent quality.
Google CloudVertex AI Eval
- 01LLM-as-judge & golden sets
- 02Regression gates in CI
- 03Drift detection
- 04Anchored scorecards
- Science
Benchmark
- Science
Research
- Science
Datasets
- Science
Experiments
- Science
Scores
- Science
Score Configs
Related capabilities
Google CloudHanzo
18 / 18
- Vertex AI EvalEvals/v1/eval
- Vertex AI EmbeddingsEmbeddings/v1/embeddings
- Compute Engine GPUsGPUs/v1/compute/gpus
- Cloud RunContainers/v1/platform/projects
- Anthos Service MeshService Mesh/v1/network/services
- Secret ManagerSecrets/v1/kms
- Cloud Audit LogsAudit/v1/iam
- Resource ManagerProjects/v1/project
- Deploy targetsEnvironments/v1/platform/environments
- Cloud BuildBuilds/v1/platform/builds
- Cloud DeployReleases/v1/platform/releases
- Cloud Build / DeployPipelines/v1/platform/pipelines
- Cloud LoggingLogs/v1/o11y/logs
- On-chain settlementPayments/v1/x402/settlements
- Tokenization & assetsTokens/v1/web3/tokens
- Explorer & chain dataIndexer/v1/explorer/indexers
- Vertex AI Search & ConversationChat/v1/chat
- MarketplaceMarketplace/v1/pricing/models
A human signs a company into existence. After genesis, agents can run it.
