Date: 2026-02-22
Checklist Item: GATE-004
Ticket: ISIS-0254
Scope#
Certify that RunPod job history and cost telemetry are complete and queryable at per-job granularity across adapter, API service persistence, and web operations surfaces.
Evidence Matrix#
| Requirement | Evidence | Status |
|---|---|---|
| RunPod history is queryable with filters/pages | libs/isis/ai-providers/src/providers/comfy/runpod-adapter.test.ts section RunPodAdapter.getJobHistory passed, including test supports indexed status filtering with pagination (status filter + limit/offset) and durable persistence loading/saving behavior. |
Pass |
| RunPod cost data is complete with per-job fields | libs/isis/ai-providers/src/providers/comfy/runpod-adapter.test.ts section RunPodAdapter.getCredits passed, validating creditsByJob, costByDay, totalCreditsUsed, creditsRemaining, and estimatedMonthlyCost, including billing-sync and deterministic fixture-runtime accounting scenarios. |
Pass |
| Generation service persists/querys per-job costs | apps/isis/generation-api/src/services/job.service.spec.ts tests backfills missing cost data using provider logs and deterministic runtime fallbacks and supports dry-run cost backfill without mutating job metadata passed; these verify per-job estimatedCostUsd backfill resolution, source attribution, unresolved tracking, and dry-run behavior. |
Pass |
| Web operations surface exposes RunPod cost data | apps/isis/web/src/pages/RunPodPage.spec.tsx passed and verifies RunPod operations UI renders cost/usage telemetry from API (totalCreditsUsed, creditsRemaining, estimatedMonthlyCost, queue/usage sections), ensuring queryability for operators. |
Pass |
Reproduction Commands#
bash
pnpm --filter @isis/ai-providers exec vitest run src/providers/comfy/runpod-adapter.test.ts -t "(RunPodAdapter.getCredits|RunPodAdapter.getJobHistory)"
pnpm --filter @isis/generation-api exec vitest run src/services/job.service.spec.ts -t "(backfills missing cost data using provider logs and deterministic runtime fallbacks|supports dry-run cost backfill without mutating job metadata)"
pnpm --filter @isis/web exec vitest run src/pages/RunPodPage.spec.tsx