screen-understanding

OpenGUI is an Android GUI agent framework for phone-use AI that can see, plan, and operate real mobile apps through the GUI.

Not a chatbot. Not a coding assistant. A digital operator that controls your entire PC — 219 tools, screen perception, HID control, browser automation, Office suite, AI media. One sentence in, finished work out.

Shake your cursor to summon an AI agent that can see your screen and click, type, and act for you on macOS.

Open-source AI copilot for Android: understands the live screen via the Accessibility API, resolves the exact UI element you need in natural language (Hindi, Tamil, English), and visually guides you to it — built for people who find modern app UIs hard to navigate.

A voice apprentice that learns how your best people work — and teaches it to the next person. ElevenLabs × Hack-Nation 'The AI Apprentice'.

A modular perception engine for AI agents that enables efficient screen understanding, reasoning, and autonomous interaction.

A camada de presença entre você e a máquina. Agente desktop open source que vê tela, lê cursor, ouve voz e aprende padrões. Tauri + Rust, AGPL.

macOS-native, screen-aware AI teacher that lives in your menu bar.

Windows AI Companion — a WPF desktop AI assistant that can see your screen and teach you where to click: chat, screen analysis, visual Guide Me target detection with a teaching overlay, and Whisper voice input. WPF/.NET 8 + Node/TypeScript + Groq.

🧊 a little buddy who lives on your Mac — talks, sees your screen, remembers how you work