feat: bounded feature, provider and model usage insights - #259
Conversation
|
Coordinated gateway/reporting: ScientFactory/ScientFactory-website#34 . Canonical measurement definitions: ScientFactory/Scient#109 . Deploy the compatible gateway before releasing this desktop producer. No production activation performed. |
|
Final-head qualification update (afbb82a): aligned with main including #258. Repository typecheck and 134 focused provider/contract/release-machinery tests pass. Prior full web run: 6,396 passing tests; full repository server test phase remains running locally. Desktop build and smoke passed; numeric restart/retry and synthetic end-to-end export tests passed. CI is running. No visual acceptance or production activation claimed. |
Thread transfer impact✅ Thread transfer remains within every enforced ceiling.
Baseline: Scenario and decoded snapshot size10 historical turns, 5 command tools per turn, 878.9 KiB retained MCP result per historical turn, and a 1.05 MiB retained result in the measured turn.
Updated in place by a trusted workflow. PR artifacts are strictly validated and never executed. |
What Changed
Add bounded product insight events for visible panel categories, Settings sections, Usage tools and project-picker/search entry points. Export native per-turn token counts with provider and allowlisted public model categories, separate from provider readiness and terminal outcome signals.
Reuse the existing worker/outbox and ProviderService correlation. No transcript scan, provider polling, raw model labels, content, paths or account identities. Token subsets are not added twice, missing counts stay unavailable, and consent epoch changes fence turn usage.
Why
Distinguish what people can use from what they actually use, with explicit coverage rather than misleading zero totals. Existing queue limits remain intentional; this is bounded best-effort delivery, not a lossless guarantee.
Documentation Impact
Updated internal analytics contract and user telemetry explanation. Coordinated website gateway/reporting and Scient measurement-plan PRs will be linked below. Deploy the compatible gateway before releasing revision-3 producers.
Validation and review
UI Changes / readiness
Only the existing analytics explanation gains provider/model categories and token-count wording. No visual review performed; human copy/preview acceptance remains pending, so this is a draft. No production configuration, dashboard, consent default or notification activation is changed.
Prepared with Codex API tooling and an independent read-only review agent.