Skip to content

Categorize timeout failures for prioritized investigation #6586

Description

@premun

Business value

Timeouts are one of the most common CI/CD failure modes in .NET, but today they surface as individual, unrelated failures — different error messages, tests, and platforms that often share a common underlying cause. With no way to group them, teams can't tell which timeout patterns hurt the most, and can't prioritize what to fix first. Grouping timeout failures into meaningful categories with aggregated statistics lets engineering teams prioritize timeout investigations by real impact.

Expected outcomes

  • Timeout failures are grouped into meaningful categories that share a common pattern.
  • Each category carries aggregated statistics — how often it occurs, its trend over time, and its blast radius (affected repositories/platforms).
  • Teams can see, at a glance, which timeout categories to investigate first.
  • Timeouts that don't fit an existing category are surfaced as candidates for review.

Acceptance criteria

  • Timeout failures are detected and grouped into categories rather than shown only as isolated failures.
  • For each category, teams can see aggregated stats (frequency, trend, affected repos/platforms).
  • Categories are visible where teams already triage build failures.
  • Uncategorized timeouts are identifiable as candidates for a new category or investigation.

Open decisions

  • Historical scope — how far back to categorize existing timeout failures.
  • Category lifecycle — whether categories are stable once created, or merge/split as patterns evolve.
  • Actionability — whether high-frequency timeout categories should feed known-issue creation (see Related Maestro API with support for release pipelines #72).

Related (cross-cutting)

Reference

De-solutionized rewrite of dotnet/arcade-services#6140 (original contains technical design notes for the implementing team).


🤖 Drafted by an AI agent on behalf of @michalpavelka.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions