feat(alpha): implement Alpha crawler architecture and stabilization - #1
Merged
Conversation
…very engine, and fixture tests
…a-report template
…d layout-aware discovery
…strict TypeScript violations
…fication A0 — Repository Stabilization: - Remove all macOS duplicate artifacts (* 2.*, * 3.*) and codemod scripts - Remove empty stub packages (ai, exporters, extractor, ocr, utils) and empty legacy connector dirs; update root tsconfig references - Add typecheck + lint scripts to every package so the full workspace participates in CI (was 1/10 typecheck, 0/10 lint) - Fix latent extension typecheck errors surfaced by full coverage - Add .prettierignore; harden eslint ignores A1 — Runtime Correctness (single extraction path): - Content Script is now a pure DOM adapter; parsing delegated to the connector's StrategyChain (sole runtime extractor) - Move Instagram-specific types out of packages/types into the connector - Collapse duplicate IConnector into one canonical generic IConnector<TRaw>; InstagramConnector implements it with canHandle() - Remove all `any` escape hatches in connector src All gates green: build, typecheck, lint, test, depcruise, format. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Alpha Phase 1 — Repository Stabilization & Runtime Correctness
Overview
This PR establishes the first stable architectural baseline for the Knowledge Extractor.
The focus of this phase is repository health, architectural correctness, and eliminating technical debt that would prevent reliable Alpha validation.
No new end-user features are introduced. The goal is to stabilize the foundation before expanding functionality.
Repository Stabilization
* 2.*,* 3.*)Build & CI Improvements
Added
typechecksupport across workspace packagesAdded proper lint scripts
Fixed hidden TypeScript errors
Resolved formatting issues
Verified:
✅ Build
✅ Typecheck
✅ Lint
✅ Tests
✅ Dependency Cruiser
✅ Format Check
Runtime Architecture Improvements
Unified Extraction Pipeline
Removed duplicated extraction logic from the content script.
The runtime now follows a single extraction path:
Content Script
→ Connector
→ Strategy Chain
→ Parser
→ Normalizer
This removes architectural drift and ensures all extraction passes through the same validated pipeline.
Connector Improvements
anyescape hatchesDomain Improvements
Moved Instagram-specific intermediate models out of the shared domain layer.
The shared
packages/typespackage now remains platform agnostic.Documentation
Updated architectural documentation to reflect the stabilized runtime.
Validation
All repository quality gates pass successfully.
This PR establishes the stable Alpha baseline required before implementing crawler orchestration and runtime observability.