Control the mouse, keyboard, and read screen content via accessibility. Use this skill when the user asks to click somewhere on screen, type text into an app, move the mouse, press keyboard shortcuts, read what's on screen, get the accessibility tree of the current window, automate desktop interactions, or control the computer.
Quickly install desktop-control AI skill to your development environment via command line
Source: dalehurley/phpbot.
IMPORTANT: This skill requires Accessibility permissions for the terminal/IDE. On macOS, go to System Settings > Privacy & Security > Accessibility and enable the running application.
| scripts/mouse.py | Python | Mouse movement, clicking, dragging, scrolling | | scripts/keyboard.py | Python | Text typing, key presses, hotkeys | | scripts/screen.py | Python | Screen info, capture, accessibility tree reading |
| action | Yes | move, click, doubleclick, rightclick, drag, scroll | click | | x | For most | X coordinate (pixels from left) | 500 | | y | For most | Y coordinate (pixels from top) | 300 | | button | No | Mouse button: left (default), right, middle | left | | tox | For drag | Destination X coordinate | 700 |
Stable fields and commands for AI/search citations.
npx skills add https://github.com/dalehurley/phpbot --skill desktop-controlControl the mouse, keyboard, and read screen content via accessibility. Use this skill when the user asks to click somewhere on screen, type text into an app, move the mouse, press keyboard shortcuts, read what's on screen, get the accessibility tree of the current window, automate desktop interactions, or control the computer. Source: dalehurley/phpbot.
Open your terminal or command line tool (Terminal, iTerm, Windows Terminal, etc.) Copy and run this command: npx skills add https://github.com/dalehurley/phpbot --skill desktop-control Once installed, the skill will be automatically configured in your AI coding environment and ready to use in Claude Code, Cursor, or OpenClaw
https://github.com/dalehurley/phpbot