desktop computer automation

CRITICAL RULES — VIOLATIONS WILL BREAK THE WORKFLOW: Never run midscene commands in the background. Each command must run synchronously so you can read its output (especially screenshots) before deciding the next action. Background execution breaks the screenshot-analyze-act loop.

Run only one midscene command at a time. Wait for the previous command to finish, read the screenshot, then decide the next action. Never chain multiple commands together.

Allow enough time for each command to complete. Midscene commands involve AI inference and screen interaction, which can take longer than typical shell commands. A typical command needs about 1 minute; complex act commands may need even longer.

使用 Midscene 的视觉驱动桌面自动化。使用自然语言命令控制您的桌面（macOS、Windows、Linux）。 完全通过屏幕截图进行操作——不需要 DOM 或辅助功能标签。无论技术堆栈如何，都可以与屏幕上的所有可见元素进行交互。 触发器：打开应用程序、按键、桌面、计算机、单击屏幕、键入文本、屏幕截图桌面、 启动应用程序、切换窗口、桌面自动化、控制计算机、鼠标单击、键盘快捷键、 屏幕截图、在屏幕上查找、读取屏幕、验证窗口、关闭应用程序、最小化窗口、最大化窗口 由 Midscene.js (https://midscenejs.com) 提供支持 来源：web-infra-dev/midscene-skills。