ZSeven-W/dsh-ios
AI EngineeringGives coding agents 22 tools to boot, build, and drive iOS Simulators or USB-connected iPhones, with a live interactive sidebar.
What it is
DSH iOS Simulator is a plugin for DeepSeek Harness that puts a live iOS Simulator, or a real USB-connected iPhone, inside an agent conversation. The agent gets 22 tools for discovering and booting devices, building and launching Xcode projects, driving the UI through accessibility identities, OCR text, or list rows, and reading logs, processes, backtraces, and leaks. A persistent sidebar panel renders the device stream and accepts taps and drags directly on the video. Simulator udids route through simctl and serve-sim; physical-device udids route through WebDriverAgent.
It is aimed at developers using DSH to build, test, or inspect iOS apps, and at anyone who wants an agent to operate a device UI instead of guessing coordinates. The plugin is written in TypeScript and released under MIT.
Install and first run
The plugin is installed from npm into a DSH profile and then the DSH web UI is started:
dsh plugin --profile web add @zseven-w/dsh-ios@latest
dsh web
A typical first session, taken from the documented workflow in the README:
- Ask the agent to list devices (
ios_sim_devices) to obtain a udid or device name. - Ask it to boot a device (
ios_sim_boot); the live panel opens and the simulator appears in the sidebar. - Tap or drag on the video directly, or ask the agent to drive the UI through the accessibility tree (
ios_sim_ui_tree+ios_sim_tap_element), OCR (ios_sim_find_text+ios_sim_tap_text), or list rows (ios_sim_ui_rows+ios_sim_tap_row). - Build and run a project with
ios_sim_build_run; a full build takes minutes, after which the app launches on the simulator. - For SwiftUI work,
ios_sim_preview startbuilds previews as a dylib and hot-swaps source edits into the running simulator without relaunching. - For a real iPhone, connect it with a data USB cable, unlock it, and run
ios_real_start_wdato build and launch WebDriverAgent; the panel switches to the phone's stream.
Requirements and limits
- macOS with full Xcode, not just Command Line Tools, plus at least one installed Simulator runtime. On non-macOS hosts the plugin loads and the tools register, but calls return an explanatory error.
- DSH ≥ 0.1.0-rc.6 with the web bundle for the live panel. Headless profiles still get all 22 tools without the live view.
- AXe is optional but required by the UI-tree and row tools on a simulator; install it with Homebrew or let the plugin download the pinned, SHA-256-verified release. Vision OCR is compiled from bundled Swift source with
swiftcon first use for the OCR tools. - Backtraces with lldb need macOS Developer Mode (
sudo DevToolsSecurity -enable); otherwise the tool falls back to Xcode's non-suspendingsampleengine and leaks inspection degrades. - Real devices must be unlocked, use a data-capable cable with Developer Mode on, and have a WebDriverAgent checkout at
~/Library/Caches/dsh-ios/wda/src; the plugin never downloads or clones WDA. The first build installs a signed runner that must be trusted, and free-team signing expires after 7 days, requiringios_real_start_wdato run again. - The browser never connects to serve-sim's port: streams, screenshots, and HID control go through signed, expiring routes on the DSH webserver origin, and the stream stops after 5 minutes with no consumers.
- Known issue: Xcode's
leakscan fail on iOS 26.2 simulator runtimes even with Developer Mode enabled; the tool returns the raw diagnostic and the target is always resumed.
HotRepo's take
No HotRepo ranking, snapshot, or discussion records are available for this repository, so the observation here rests on the technical material. The distinguishing design choice is putting device control behind the plugin's signed-route fence rather than exposing the streaming port to the browser, and routing list-row taps through expect_count verification instead of blind coordinate probes. The real-device path is also unusually explicit about its failure modes: locked device, untrusted certificate, expired signing profile, and broken tunnel are reported as coded statuses instead of generic errors. The SwiftUI preview hot reload and the 22-tool surface make this a functional iOS automation layer for DSH rather than a demo, though its usefulness is gated by macOS and a full Xcode install.
Written by AI from the project's README, updated . The project's own docs are the source of truth.
You might also like
- ZSeven-W/dsh-androidDeepSeek Harness plugin that streams a live Android emulator or USB device into the conversation and drives it through adb.
- phoneuse-official/phoneuseOpen-source tools to drive a USB-connected iPhone from a Mac with prompts, live video, REST and MCP.
- hridaya423/phonedriverMCP server and CLI that let AI agents read and control Android phones and iPhones with a confirmation step before payments.
- phone-harness/mcpA hosted MCP server that lets AI agents control real iPhones and Android emulators in the cloud.
- JosssphZhou/pokiLet Claude Code, Codex, or other MCP clients drive a real iPhone from a Mac, without jailbreak or extra hardware.