Computer Use
Canine
Computer Use
Letting Claude drive an agent computer
How Canine lets Claude see and operate its Omarchy agent computers: a Python server in each VM that speaks Anthropic's computer-use actions and reads the accessibility tree, the Wayland input and coordinate details behind it, and the MCP tools that connect Claude Code to it. Nine chapters and five labs run against a real machine.
Chapters
- 1What computer use is, and what we built5 min
- 2Seeing the screen5 min
- 3Pressing keys and clicking on Wayland6 min
- 4The accessibility tree6 min
- 5The server as a Python package6 min
- 6The Canine side: from Claude to the VM5 min
- 7War stories5 min
- 8Current state and open work2 min
- 9Glossary and cheat sheet3 min