Eve library

Kalika Phase 113 Adversarial Testing Report

Guide

Revision 1

On this page

Generated: 2026-04-28T00:00:00.000Z

Scope#

Task 113.9.1.3 is implemented as the @kalika/core phase-113 adversarial gate:

  • 20 major Kalika pipelines are represented.
  • 10 adversarial input families are exercised per pipeline.
  • 200 total cases cover malformed expressions, invalid domains, ill-conditioned matrices, singular limits, boundary cases, timeout budgets, backend failures, dimension mismatches, unsafe payloads, and resource exhaustion.
  • Every case must produce a handled outcome with an informative message and diagnostics.
  • The harness converts unexpected validator exceptions into explicit unhandled outcomes so regressions are visible in CI.

Pipelines#

The suite covers CAS expression handling, OpenMath/Content MathML ingress, SMT/TPTP export, formal verification, external CAS bridges, numerical linear algebra, ODE/PDE solvers, optimization, automatic differentiation, knowledge graph queries, citation ingest, cosmology interfaces, HEP formats, QFT amplitudes, GR tensor calculus, algebra/number theory, geometry/topology, research agents, notebook/SDK execution, and persistence/cache/HPC orchestration.

Verification#

The corresponding Vitest coverage verifies:

  • minimum 200-case count,
  • complete pipeline and family coverage,
  • malformed/ill-conditioned/singular/boundary payload construction,
  • graceful handling for every case,
  • informative diagnostics containing expected keywords,
  • explicit unhandled outcomes for harness regressions,
  • Markdown report generation.