Skip to content

Vendor Harness Core and add Phase B ESP32 OCR handoff - #4

Draft
MengzhangLI wants to merge 2 commits into
mainfrom
codex/phase-b-v1.1-esp32-ocr-handoff
Draft

Vendor Harness Core and add Phase B ESP32 OCR handoff#4
MengzhangLI wants to merge 2 commits into
mainfrom
codex/phase-b-v1.1-esp32-ocr-handoff

Conversation

@MengzhangLI

@MengzhangLI MengzhangLI commented Aug 20, 2026

Copy link
Copy Markdown
Contributor

What changed

  • Vendors the complete Assistive Harness Core into OpenGlass: FunASR, Router, state machine, Skill YAML/prompts, telemetry and tests.
  • Adds the stable Rokid Phase B entry point with PC-speaker V1.1 behavior, model text logging, one-shot task injection and shutdown handling.
  • Adds the Phase A browser thin-adapter assets without overwriting an upstream MiniCPM omni-app.js.
  • Adds a transport-neutral CVObservation/provider contract, non-blocking capacity-one shadow pipeline, YOLO ONNX reference provider and OCR provider template.
  • Adds an explicit ModelScope download helper; runtime --model-path remains a local path and never downloads implicitly.
  • Expands the Chinese handoff guide with clean-clone setup, exact startup commands, OCR extension path, and a table of intentionally external model/runtime assets.

Why

Make this OpenGlass branch the shared Phase B / Rokid / ESP32 / OCR collaboration baseline so a colleague can clone it directly instead of receiving an incomplete local MiniCPM directory archive.

Scope and safety

  • Experimental obstacle awareness and CV are shadow-only; observations do not control navigation or motion.
  • MiniCPM-o/llama.cpp-omni Worker/Gateway and large model weights remain external dependencies.
  • ASR, YOLO and OCR weights are deliberately excluded from Git and have documented local download/placement paths.
  • Unrelated local files are excluded.

Validation

  • Assistive Harness Core + Rokid Phase B: 30 passed.
  • OpenGlass perception pipeline: 3 passed.
  • Phase A browser adapter: 7 passed.
  • YOLO provider smoke test: test discovered; skipped when optional local ONNX weights are absent.
  • Harness server CLI/import smoke test passed.

self.config.image_jpeg_quality,
)
except Exception as exc:
return web.Response(status=400, text=str(exc))
@MengzhangLI MengzhangLI changed the title Add Phase B ESP32 OCR handoff skeleton Vendor Harness Core and add Phase B ESP32 OCR handoff Aug 20, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants