Integrate KeySoft

[aidanbruneel]

Outcome

Resolve issues blocking proper functionality on HumanWare's retail firmware so that the IMAGE-Monarch client application can be further developed using KeySoft.

Context and value

Outdated firmware on our development Monarch devices is causing issues with deployment.

Affected users, systems, or workflows

• HumanWare collaborators and contributors to the IMAGE-Monarch client
• IMAGE developers
• McGill University research students
• User study groups

In scope

• Permanently migrate development Monarch displays to retail firmware

Out of scope

• Improving the existing IMAGE-Monarch client's functionality

Success measures

• Achieve baseline functionality of the current IMAGE-Monarch client running on a Monarch with retail firmware

Expected workstreams

• Fix Bug: TTS Speech Output Is Significantly Faster Than Previous Monarch Build and Not Comprehensible #92
• Fix Bug: Unable to Navigate Between Layers During Step-by-Step Exploration #93
• Fix Bug: Missing Error Feedback When Hands Move Outside Active Interaction Region #94
• Fix Bug: Zoom In, Zoom Out, and Pan Are Not Functioning #95
• Fix Bug: LLM Questions About the Graphic Are Not Functioning #96
  • Not critical for user studies
• Fix Bug: Region Selection and Follow-Up Queries Are Not Functioning #97
  • Not critical for user studies

Constraints and coordination considerations

• Ownership of specific tasks needs to be established between HumanWare and the IMAGE team
• The development Monarch devices will need to be brought physically to HumanWare to have retail firmware flashed

Existing and related work

• Identify blocking and blocked issues