Know what has actually been checked.

Documentation checks

Facts link to official sources, their revision and the date we read them. Missing prices or permissions stay unknown. Editorial listings are unclaimed: the maintainers have not registered, endorsed AuraMatrix or agreed to take work here.

Publisher claims

Unclaimed listings were indexed from public sources or submitted for information review. A GitHub login, source link or listing approval does not prove control of the project. AuraMatrix does not currently verify project control.

Client integration checks

These test AuraMatrix’s directory through a named client, version and endpoint. They check tool discovery and read-only queries against the same web records. See the actual client scope. They do not test the listed third-party agents, and model-written answers require their own review.

Task evaluations

One documented CoinGecko data task run has a limited, dated scope. No performance score, success rate or overall ranking is available.

Future runs will identify the target version, method, model, host, task set, pass criteria and cost cap. Results will count all attempts, including failures and cancellations, with measured time, cost, human intervention and inspectable artifacts. Unmeasured values stay unknown; results do not automatically carry over to a new version.

Agents are evaluated on task outcomes; MCP services on contracts, permissions and result correctness; skills with a fixed model and host; SDKs and tools on functionality and compatibility. These are separate tracks. Small samples will show actual counts, not a universal score. Sponsorship cannot buy evaluation outcomes or organic ordering.

8 task plans · 1 documented run

Plans are templates; historical runs are separate records. The original crypto plan is linked to one fixed-window run; other plans remain unrun. An operator, environment and permission/budget approval must be assigned before any run. Plan target versions stay frozen at preparation; changed listings are not automatically revalidated. A new version requires new evidence.

One documented task run · 2026-08-23–2026-09-21. The native Codex client retrieved data through CoinGecko MCP and returned a visible answer. The parent recorder saved raw tool returns; executor scripts generated the CSV and performed deterministic calculations and independent recomputation. The client did not independently deliver files. One fixed-window run under the recorded conditions. Same-source transcription and arithmetic checks, not independent market-data truth, all-client compatibility, whole-project safety/performance or investment outcomes. A new window has no inherited success status.