desktop computer automation

CRITICAL RULES — VIOLATIONS WILL BREAK THE WORKFLOW: Never run midscene commands in the background. Each command must run synchronously so you can read its output (especially screenshots) before deciding the next action. Background execution breaks the screenshot-analyze-act loop.

Run only one midscene command at a time. Wait for the previous command to finish, read the screenshot, then decide the next action. Never chain multiple commands together.

Allow enough time for each command to complete. Midscene commands involve AI inference and screen interaction, which can take longer than typical shell commands. A typical command needs about 1 minute; complex act commands may need even longer.

使用 Midscene 的視覺驅動桌面自動化。使用自然語言命令控制您的桌面（macOS、Windows、Linux）。 完全透過螢幕截圖進行操作—不需要 DOM 或輔助功能標籤。無論技術堆疊如何，都可以與螢幕上的所有可見元素進行互動。 觸發器：開啟應用程式、按鍵、桌面、電腦、點擊螢幕、鍵入文字、螢幕截圖桌面、 啟動應用程式、切換視窗、桌面自動化、控制電腦、滑鼠點擊、鍵盤快速鍵、 螢幕截圖、在螢幕上尋找、讀取螢幕、驗證視窗、關閉應用程式、最小化視窗、最大化窗口 由 Midscene.js (https://midscenejs.com) 提供支持 來源：web-infra-dev/midscene-skills。