AI Agent controls desktop & web without screenshots, OCR, or coordinate simulation — structured semantic trees via Accessibility API + Playwright DOM
python macos automation accessibility semantic-ui desktop-automation web-automation agent-tool playwright ai-agent accessibility-api ui-bridge no-screenshot agent-sdk ax-api no-ocr
-
Updated
Jul 15, 2026 - Python