DroidAI

EN ☾ Download

DroidAI

AI-Powered Android Device Controller
Complete User Guide & Tutorial

Control one phone or an entire farm of devices using natural language. Just tell the AI what to do — it sees the screen, taps, types, and scrolls for you.

Version 1.0 • March 2026

1. Introduction & System Requirements

What is DroidAI?

DroidAI is a desktop application that lets you control Android devices using natural language. Instead of manually tapping through apps, you simply describe what you want done — and DroidAI's AI agent takes over. It observes the device screen, decides which actions to take, executes them, and repeats until the task is complete.

DroidAI supports controlling multiple devices simultaneously, making it ideal for phone farms, testing labs, and automation workflows at scale.

How It Works

System Requirements

2. Installation & First-Time Setup

Step 1: Install DroidAI

1. Download the latest installer from droidai.live
2. Run the installer and follow on-screen instructions
3. Launch DroidAI from the Start Menu or desktop shortcut
4. Sign in with your Google account when the login screen appears

Step 2: Install ADB (Android Debug Bridge)

ADB is required for DroidAI to communicate with your Android devices. DroidAI bundles its own ADB, but if you encounter issues:

1. Download Android SDK Platform Tools from developer.android.com
2. Extract to a folder (e.g., C:\platform-tools)
3. Add the folder to your system PATH environment variable
4. Open a terminal and verify: adb version

Step 3: Enable USB Debugging on Your Phone

1. Open Settings on your Android device
2. Go to About Phone (or Software Information)
3. Tap Build Number 7 times until you see "You are now a developer"
4. Go back to Settings → Developer Options
5. Enable USB Debugging
6. Connect your phone to the PC via USB cable
7. Tap Allow when the USB debugging authorization prompt appears. Check "Always allow from this computer".

Step 4: Verify Connection

adb devices

You should see your device serial number followed by device:

List of devices attached
ABCD1234    device

If you see unauthorized, check your phone for the authorization popup.

3. Connecting Your First Device

USB Connection

1. Connect your phone via USB with debugging enabled
2. Launch DroidAI — your device should appear automatically in the device grid
3. You'll see a live screen mirror of your device
4. The device panel shows the device name and a numbered badge (#1)

WiFi Connection (Wireless ADB)

1. Connect your phone via USB first
2. Click the Device button in the top toolbar
3. Click WiFi Connect
4. Enter your phone's IP address (find it in Settings → WiFi → tap your network)
5. Click Connect — you can now unplug the USB cable

Installing Portal APK

The Portal APK is a companion app that provides:

• Faster UI tree reading via accessibility service (vs. slow ADB uiautomator)
• Unicode text input via custom IME keyboard (Korean, Chinese, emoji, etc.)
• UI Inspector overlay for debugging element detection

1. Find the P button on your device panel
2. Click the P button to install Portal
3. Wait for installation (10-15 seconds) — button turns green when ready
4. The K button should also turn green (keyboard active)

4. Configuring LLM Providers & API Keys

DroidAI requires an LLM API key to power its AI agent. The AI reads the device screen and decides what actions to take.

Supported Providers

Getting an API Key

Anthropic (Recommended)

1. Go to console.anthropic.com
2. Create an account or sign in
3. Navigate to API Keys in the dashboard
4. Click Create Key and copy it (starts with sk-ant-)
5. Add credits to your account (API is pay-per-use)

OpenAI

1. Go to platform.openai.com
2. Create an account or sign in
3. Navigate to API Keys
4. Click Create new secret key and copy it (starts with sk-)

Entering Your API Key in DroidAI

1. Click the Settings button (gear icon) in the top toolbar
2. In AI Model section, select your provider
3. Paste your API key
4. Select a model from the dropdown
5. Click Save

Using a Custom Provider

If you have an OpenAI-compatible API endpoint (e.g., local model, proxy, third-party):

1. Select Custom from the provider dropdown
2. Enter the base URL (e.g., http://localhost:11434/v1 for Ollama)
3. Enter your API key (if required)
4. Type your model name manually

5. Interface Overview

DroidAI has a split-panel layout: Chat Panel on the left and Device Grid on the right.

Top Toolbar

Chat Panel (Left Side)

The chat panel has four tabs:

Command Input Bar (Bottom)

Device Grid (Right Side)

Each connected device appears as a panel with live screen mirror. Panel controls:

6. Your First Task — Quick Start

Let's walk through your very first DroidAI task, step by step.

Prerequisites Checklist

• ☑ DroidAI installed and running
• ☑ Signed in with Google account
• ☑ Phone connected via USB with USB debugging enabled
• ☑ Device visible in the device grid with live screen
• ☑ Portal installed (green P button)
• ☑ LLM API key configured in Settings

Example: Open YouTube and Search for a Video

1. Make sure your device is selected (click its selection badge)
2. Click the text input field at the bottom of the chat panel
3. Type: Open YouTube and search for "lofi hip hop radio"
4. Press Enter (or click the Send button)
5. Watch the Activity tab — the AI will launch YouTube, tap search, type the query, and press Enter

More Example Commands

Stopping a Task

Click the red Stop button during execution, or press Ctrl+C while the input field is focused.

7. Core Features Deep Dive

How the AI Agent Works

For each step of a task, the AI agent follows this cycle:

1. Observe — Read the UI tree and optionally take a screenshot
2. Think — Analyze the screen state, decide the best action
3. Act — Execute one action: tap, type, scroll, swipe, etc.
4. Repeat — Loop until task complete or max steps reached

Available Actions

Planning Mode

When enabled, the AI generates a step-by-step plan before execution. Useful for complex tasks where you want to see the approach first.

• Toggle via the Mode button in the command bar
• The plan appears in the Activity tab before execution starts
• Minimum 5 actions enforced before early completion

Max Steps

Maximum actions per task (default: 30, configurable: 10-100). Prevents infinite loops. Increase for long tasks; decrease for simple actions.

8. Multi-Device & Phone Farm Setup

DroidAI is built for scale. Connect and control dozens of Android devices simultaneously from a single PC.

Hardware Setup

USB Hub Selection

For multiple phones, you need a powered USB hub:

Recommended Phones for Farms

Connecting Multiple Devices

1. Connect all phones to the USB hub via data cables
2. Connect the USB hub to your PC
3. Enable USB debugging on every device
4. Authorize USB debugging on each phone
5. Launch DroidAI — all devices should appear in the grid
6. Install Portal on all: Device menu → Install Portal All

Sending Commands to Multiple Devices

Option 1: All Devices

Click "All" to select every device, then type your command. Each device gets its own independent AI agent.

Option 2: Selected Devices

Click the selection badge on each device to target. Commands run only on selected devices.

Performance Considerations

9. App Cards & Playbooks

App Cards are pre-configured guides that help the AI understand specific apps. They contain navigation hints and app-specific tips that significantly improve accuracy.

How App Cards Work

When you send a command, DroidAI checks if the current app has an app card. If found, the card's instructions are injected into the AI's system prompt.

Using the App Card Grid

1. Click App Cards button in the command bar
2. A grid popup shows all available app cards (25+ pre-configured)
3. Click any card to open the detail dialog
4. View/edit card content, add instructions, then click Run

Pre-Configured Apps

Creating Custom App Cards

1. Go to Presets tab → App Cards
2. Click New Card
3. Enter the package name
4. Write navigation tips and key UI elements
5. Click Save

10. Mirror Mode

Mirror Mode lets you manually control a device using your PC's mouse and keyboard.

Enabling Mirror Mode

1. Click Mirror in the top toolbar (turns green)
2. Click on a device panel to select it
3. Mouse clicks and keyboard input now go to the device

Controls in Mirror Mode

Mirror Mode + Multi-Device

When multiple devices are selected, input is forwarded to all selected devices simultaneously. Useful for setting up multiple phones with the same configuration.

11. Loop & Repeat Mode

Loop Mode repeats the same command multiple times with optional delays between cycles. Essential for repetitive tasks.

Setting Up a Loop

1. Click Loop button in the command bar
2. Set Count: how many times to repeat (1-999)
3. Set Interval: minutes between cycles (0-999)
4. Type your command and send — it repeats automatically

Example: Social Media Engagement Loop

Loop: 10 cycles, 5 minute interval
Command: "Open Instagram, scroll feed, like 3 posts, then close the app"

Result: Every 5 minutes, each device opens Instagram,
likes 3 posts, and closes. Repeats 10 times over ~50 minutes.

12. Stealth Mode

Stealth Mode makes the AI's actions appear more human-like by introducing natural variations.

What Stealth Mode Does

When to Use Stealth Mode

• Social media automation — Prevents detection by platform algorithms
• Account farming — Makes bot behavior less detectable
• Extended sessions — More natural interaction patterns

13. Personas, AI Rules & Presets

Saved Commands

Save frequently-used commands for one-click execution:

1. Go to Presets tab → Saved Commands
2. Enter a name and command text
3. Click Add
4. Click Play next to any saved command to execute

AI Personas

Personas customize the AI agent's behavior. Only one persona can be active at a time.

Examples: Speed Runner (fast, skip verifications), Careful (verify before/after each action), Social Media Expert (navigate social apps expertly).

AI Rules

Rules are constraints always injected into the AI's system prompt. Multiple rules can be active simultaneously.

Examples: "Never purchase anything", "Close ads immediately", "Always use search instead of scrolling", "Skip sponsored content when liking".

14. Macros, Workflows & Triggers

Macros (Record & Replay)

Macros record AI actions and replay them without the LLM, saving API costs.

Recording a Macro

1. Go to Advanced tab → Macros
2. Click Record (turns red)
3. Send a command and let the AI execute
4. Click Stop Recording

Playing a Macro

Select the macro and click Play — replays exact actions without calling the LLM.

Workflows

Chain multiple commands into sequential flows. Each step runs only after the previous one completes.

1. Go to Advanced tab → Workflows
2. Click New Workflow
3. Add steps with commands
4. Click Run to execute the chain

Triggers

Condition-based auto-execution. Set conditions and DroidAI evaluates them with the LLM to decide when to act.

1. Go to Advanced tab → Triggers
2. Create a trigger with condition and action
3. Enable the trigger — DroidAI monitors and acts when conditions are met

15. Screenshot Modes & Vision

DroidAI can send screenshots to the AI for visual understanding. Three modes available:

When to Use Each Mode

• Reels/Shorts — Video players have minimal UI trees. Use ALWAYS.
• Games — Canvas-rendered UIs. Screenshots essential.
• Standard apps — OFF or AUTO is usually sufficient.

16. Telegram Bot Remote Control

Control DroidAI remotely from your phone using a Telegram bot.

Setting Up the Telegram Bot

1. Open Telegram and search for @BotFather
2. Send /newbot and follow prompts to create a bot
3. Copy the bot token
4. Find your Chat ID via @userinfobot
5. In DroidAI: Settings → Telegram Bot
6. Paste token, enter Chat ID, enable Auto-start, click Save

Telegram Commands

17. Settings Reference

AI Model

Agent

Display

Streaming (Scrcpy)

18. Troubleshooting & FAQ

Device Not Appearing

Portal Issues

AI Agent Issues

Frequently Asked Questions

Q: How much does the LLM API cost?

A typical task (10-15 steps) costs ~$0.01-0.03 with Claude Sonnet, ~$0.005-0.01 with GPT-4o-mini. Screenshots add ~$0.01-0.02 each.

Q: Can I use DroidAI offline?

Internet is required for LLM APIs. However, you can use a local model via Ollama with the Custom provider for offline use.

Q: How many devices can I connect?

No hard limit. Practical limits depend on hardware. Users commonly run 10-30 devices per PC.

Q: Does it work with emulators?

Yes. Any ADB-compatible device works: BlueStacks, NoxPlayer, Android Studio AVD. Connect via adb connect localhost:PORT.

Q: Is my API key stored securely?

API keys are stored locally in settings.json in your AppData folder. Never sent to DroidAI servers.