Skip to content

[P2] Audit: llms.txt is too shallow for AI answer-engine discovery #149

Description

@baixiangcpp

Imported from the byteflow.tools deep audit on 2026-06-22.

Problem: llms.txt exists and gives basic site-level information, but it is too shallow to help AI answer engines understand the tool inventory, privacy model, categories, workflows, and canonical resources.

Affected URL:

Reproduction steps:

  1. Open /llms.txt.
  2. Review whether it lists canonical category pages, top tools, trust/privacy pages, workflows, and content clusters.
  3. Compare it to the sitemap and core navigation.

Expected behavior: llms.txt should provide a concise but useful AI-readable map of the site.

Actual behavior: it only contains high-level canonical, sitemap, locales, contact, and GitHub information.

Impact: weaker AI/LLM discoverability and less precise citations in answer engines.

Proposed fix:

  • Add top-level category links.
  • Add top tools by category with short descriptions.
  • Link Trust Center, Privacy Policy, About, Pricing, Install App, and GitHub.
  • Add workflow and content cluster references.
  • Keep file compact and canonical.
  • Consider /llms-full.txt for a larger index.

Acceptance criteria:

  • llms.txt includes categories, major tools, trust resources, and workflows.
  • It remains human-readable and under a reasonable size.
  • All listed URLs are canonical and indexable.
  • Updates are generated from manifest data to avoid drift.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions