Stringers
onehumanbeing/esp32-iphone-agent · onehumanbeing

A $7 board that plugs into an iPhone and lets AI tap the screen for you: esp32-iphone-agent, 26 days, 4400 stars

What it is A $7 small board that plugs into an iPhone. It acts as a screen-mirroring receiver so the AI can see the screen, and as a USB mouse and keyboard so it can tap for the AI. Any vision-capable large model can connect and operate the phone.

Why it took off In early October, people were looking for ways to have AI operate an iPhone. Similar solutions all required a Mac and developer signing. This one said plainly "$7, no Mac, no jailbreak" and paired it with an alarm-clock demo video. Both the AI and hardware circles shared it. Hackaday covered it the same day, and it gained 1072 stars.

BHow you could follow it Don't build another iPhone controller. Take the recipe of "a cheap board as the AI's eyes and hands" and move it to other closed devices (game consoles, TV boxes, car head units, professional iPad apps). Follow its playbook: one complete task video, released in both Chinese and English, pitched to Hackaday and maker communities.

Grade B: the approach and recipe are clear and reusable, but the iPhone slot is already held by two projects with 4,000–5,000 stars each. Copycats only get dozens to hundreds of stars. Whether a different device can go viral the same way is a gamble, and the buzz is already fading. Buzzing in small circles
Data (updated daily) · Repo created 2026-10-11 · 4,626 stars · 7 days +471
GitHub · stars
02k4k10-1310-1910-2611-0211-084.6k
Data 2026-10-13 → 2026-11-08 (27 days, 27 observations). Points before 10-28 come from deeply / archive backfill, not every day has one

Henry Yuan, a developer in New York, plugged a fingernail-sized ESP32 dev board into a stock iPhone so AI can watch the screen and tap for itself. No Mac, no developer account, no jailbreak. The repo gained 4436 stars and 596 forks in 26 days. It took off for three reasons: perfect timing, a pitch you can explain in one sentence, and both the hardware and AI circles were willing to share it. Below: what it is, where the stars came from, who it's competing with, and where to start if you want to build something that earns stars the same way.

One alarm-clock video

On Oct 12, 2026, Henry Yuan (on X as @iamhenryyuan, GitHub account registered in 2016, and this is his only public repo) posted on X in both Chinese and English: "A $7 ESP32 lets an AI agent control a stock iPhone. No Mac, no jailbreak…" In the attached video, a Seeed XIAO ESP32-S3 is plugged into the iPhone's USB port. He gives the AI one instruction: "Set a repeating alarm for 8 a.m. on Mondays and Tuesdays, then save." The AI exits the app on its own, opens Clock, spins the wheel, ticks the days, and saves, 22 steps in all, with no one touching the phone.

The English post got 210k views and 242 likes; the Chinese version got 213 likes (on X, as of 11-06). The next day, the major X account @RoundtableSpace reposted it with the line "Apple never built this, so someone hacked it with $7", 92k views. In Oct 14, Hackaday published "AI Controls iPhone Via ESP32", and the repo gained 1072 stars that day, its single-day high so far.

What it actually is

Broken down, the method isn't complicated. It uses features built into iOS that are open to everyone:

  • Eyes: the board runs its own Wi-Fi hotspot, which shows up in the iPhone's screen-mirroring list as *ESP32 Agent*. The phone projects its screen to it, and the board doesn't decode anything. It passes the H.264 video stream straight through to the app on the phone.
  • Hands: to the iPhone, the board is just an ordinary USB mouse and keyboard. With AssistiveTouch turned on, a mouse click equals a finger tap, and a drag equals a swipe.
  • Brain: the app sends the screenshot to any model with an OpenAI-compatible API that can read images. The model decides where to tap, swipe, or type next.

The earliest version still needed a computer running an AirPlay receiver. In Oct 15, he moved that step into the board as well. The README says "The computer is gone," and at runtime all you need is a phone and a board. This update post got 807 likes, the most of any of his posts. Later came a command line and an MCP server (npx -y esp32agent mcp), so Claude Code and Cursor can connect directly and operate an iPhone. In Nov 3 the app went to TestFlight, and in Nov 6 it connected to DeepSeek Harness.

Its weak points are listed in the README itself: the screen is only 480×1040 at up to 5 frames per second, each step takes several seconds, and most of the time goes to waiting on the model. The pointer is relative, so it needs calibration first. Landscape isn't supported. The lock screen, password entry, and Apple Pay can't be mirrored because iOS blocks it, so the AI can't see them. While it runs, the board occupies the phone's Wi-Fi, so only cellular data works. And "no Mac" applies only at runtime: the first flash of the board still requires a computer.

Why this one, and why this month

Demand peaked that very week. In early October, "iPhone-use" suddenly took off in Chinese X circles. zhongerxin/iPhone-use was created in Oct 6 and got 4909 stars in a month. The same week, actell (10-09) and phone-agent (10-06) also appeared. Everyone was asking how to let an agent operate an iPhone, and this repo was created in Oct 11, just in time.

It bypassed the gate everyone else was stuck on. Similar solutions nearly all required a Mac, Xcode, developer signing, or enabling developer mode (listed one by one in the table below). Its title spelled it out: "$7 / No Mac / no developer account / no jailbreak." Even an outsider understands it at a glance, and they're willing to share it.

The same idea had been tried before without taking off. zhaodashuaibi/VersaiOS already used an ESP32 Bluetooth mouse plus an AirPlay receiver on a computer to control an iPhone back in March, seven months earlier. It has 9 stars now. boboabw/phone-agent came out the same week and also used an ESP32 with AssistiveTouch, but it skipped the screen-viewing step and has 21 stars. The extra step this one took was porting the AirPlay receiver onto a $7 board. That made "zero dependencies" a credible claim, and the engineering feat itself became a reason for others to share it.

Two crowds shared it at once. The AI agent crowd shared it on X, and the maker crowd shared it on Hackaday, Elektor, Hackster, and r/esp32. A pure-software iPhone-use project wouldn't make it onto Hackaday, but this one did, thanks to its physical photos. The board is available on Amazon for $7, so viewers felt "I could try this too." The fork-to-star ratio is about 13%, which is high for a hardware project and suggests many people actually tried it. How many actually got it running is not visible from the outside.

Where the stars came from

SourceWhat happenedReach
The author's own X posts10-12 launch post in English and Chinese, with the alarm video; a new post for each version thereafterLaunch post 210k views; 10-15 desktop-version post with 807 likes; 11-06 DeepSeek post with 345 likes and 33k views
Reposted by major X account@RoundtableSpace 10-13; Chinese-language science posts like @hr98w's "iPhone-use Solutions Overview" and @xiaomovps's "Four Projects That Turn ESP32 into an Agent Terminal"92k views; 315 likes / 93 likes
Hardware mediaHackaday 10-14, then Elektor, Open Source For You, Circuit Digest, dev.to, and YouTube explainers+1072 stars on the day of coverage
Self-promotion by the authorPosted by the author on Reddit r/esp32; project pages also went up on Hackster, Instructables, PCBWay, and Elektor LabsThe traffic these brought in can't be verified
Hacker NewsNever charted—

The growth pattern is typical: 10-17 was 2802, then it grew 80 to 170 a day before slowing down; by early November it was only adding thirty or forty a day. After 11-03 hit TestFlight and 11-06 posted the DeepSeek thread, it climbed back to 60 to 70 a day (GitHub daily stars, 11-06). Over the last 7 days: +343; the 7 days before that: +548. The overall trend is slowing, and it depends on posting a new thread with every release to push it up in waves.

Who it's competing with

ProjectApproachstar(11-06)How it differs from the others
zhongerxin/iPhone-useWebDriverAgent / XCTest4909Needs a Mac, Xcode, and signing; gets native controls, so taps are more precise
mobile-next/mobile-mcpAn MCP that works with both iOS and Android10.3kReal iOS devices need a Mac running WDA
web-infra-dev/midscene (ByteDance)Leans toward E2E testing15.5kiOS needs a Mac plus signing
zai-org/Open-AutoGLM (Zhipu)Goes through ADB26.5kMainly Android
OpenMinis/iCTRLCustom XCUITest581Still requires signing
ja1chen/actellAn agent app that runs on the phone116Requires enabling developer mode
Sipeed NanoKVM GoUSB-C video capture hardwarePromo post, 140k views60 fps and faster, but requires buying dedicated hardware

Copycats have already arrived: ananhq/anan-iphone-use (10-13, ESP32 MCP firmware, 150 stars), ghosthand-dev/ghosthand (10-27, USB plus Bluetooth, 37 stars), and JosssphZhou/poki (11-05, pure-software MCP; its pitch directly contrasts itself with "no $7 board," and it has between a hundred and three hundred stars). There are also people riding the hype and poisoning it, pasting "one-click install" commands into issues, and the README now has a warning at the top about it. Apple's own Siri and Apple Intelligence still don't allow third-party models to operate arbitrary apps, and that is the precondition for this whole category of project to exist. The day Apple opens that up, this barrier disappears.

The author's move toward a product is also evident: they've set up a brand, Handsy, and a website, handsy.tech. The README links to Amazon affiliate links for buying the board and cables, the app is waiting on App Store review, and the first line of the README asks anyone who builds on it to credit the author.

If it were you

In one line: B. This wave of "AI operates iPhone" already has two projects with four to five thousand stars; the ones that followed copied it and only got dozens to hundreds. But the recipe of "a cheap board that acts as the AI's eyes and hands" can be reused once more on another device.

Who it's for: developers who can write ESP32 or other microcontroller firmware, understand USB HID and video streams a bit, and ideally already have some presence on X or in hardware communities, and who can publish in both Chinese and English.

Who it's not for: people who want to build another "AI controls iPhone." The original author, iPhone-use, and poki have already taken the "hardware," "software," and "no hardware" positions, so a new one won't have anything new to say in its title. It's also not for people who only write software and don't want to touch hardware. This category broke out in hardware circles precisely because of that physical board.

How to do it: swap in a device that is closed, has no automation interface, but can be screen-mirrored and accepts USB keyboard and mouse input, and copy the recipe over as-is. Candidates: professional apps on iPad, game consoles like Switch or PS5 (HDMI capture plus USB controller emulation), TV boxes, car head units, and e-readers like Kindle (inferred; feasibility not verified for each). Follow its title format: "A $X board that lets AI operate ___, no Y, no Z." The second path is to fix what it did poorly, like cutting each step from several seconds to under one, supporting landscape mode, or shipping a ready-made task library (auto check-in, auto form filling). But stars on that path mostly flow back to the original project, so it's hard to break out on your own.

How to get users: follow its playbook. The first post needs a full task video showing the AI completing a specific job from start to finish. Publish in Chinese and English on the same day. Submit to Hackaday the same week, and post project pages on Hackster, Instructables, and r/esp32. Then pair every release with a new video to stretch one burst into several waves. Put a comparison table in the README against similar projects, spelling out "they need X, I don't."

When to move: the topic of "AI agents operating real devices" is hot right now, but new projects arrive every week. Ideally you ship a first version you can record video of before late December. The later it gets, the less novel "yet another thing that lets AI control ___" feels to readers.

Signs you've got it wrong: (1) In November two or three more "AI controls a certain device" hardware projects shipped and none passed 500 stars, meaning people only care about the iPhone and switching devices won't work. (2) Apple or Google opens system-level third-party agent operation of apps, which removes the reason for the whole hardware approach. (3) Conversely, if someone uses the same recipe on a game console or TV and gets over a thousand stars in a week, the path works and you should move fast.

---

Data and sources: GitHub repo page and README (11-06); daily star/fork counts (logged day by day from 10-17; from 10-11 to 10-16 only single-day peaks are available, not daily figures); the author's and reposters' X posts (views and likes as of 11-06); Hackaday's 2026-10-14 coverage; competitor star counts from GitHub (11-06). The traffic brought by Reddit, Hackster, and other platforms is unverified. Whether the App Store approves it and the actual TestFlight install count are unknown.

GitHub repo ↗

Research notes: competitor table, acquisition evidence, full research report
Competitors
NameWhereLaunchedScaleHow it differs from this one
zhongerxin/iPhone-useOpen source2026-10-064909 starGoes through WebDriverAgent/XCTest, needs a Mac, Xcode, and signing; it's pure physical peripheral with zero dependencies
mobile-next/mobile-mcpOpen source2025-0310.3k starsReal iOS devices need a Mac plus WDA; it doesn't need a computer
web-infra-dev/midsceneOpen source2024-0715.5k starsAimed at E2E testing; iOS needs a Mac plus signing
zai-org/Open-AutoGLMOpen source2025-1226.5k starsMainly Android/ADB, doesn't address iPhone
OpenMinis/iCTRLOpen source2026-07581 starXCUITest approach, requires signing
ja1chen/actellOpen source2026-10-09116 starRequires developer mode and DDI
boboabw/phone-agentOpen source2026-10-0621 starSame ESP32 HID plus AssistiveTouch idea, but no AirPlay screen viewing
zhaodashuaibi/VersaiOSOpen source2026-039 starSame idea but needs a computer running UxPlay; took off seven months earlier with no traction
Sipeed NanoKVM Go(iPhone Use)Other2026-10Promo post, 282 likes / 140k viewsUSB-C DisplayPort capture at 60 fps, faster but requires buying specialized hardware
Apple Siri / Apple IntelligenceBig-company features——Does not allow third-party models to operate arbitrary apps
Where users come from
  • Verified Author's X posts (bilingual, with demo video): 10-12 first post, 242 likes / 210k views; 10-15 new-version post, 807 likes / 62k views; 11-06 Chinese DeepSeek post, 345 likes
  • Verified Big X accounts reposting: @RoundtableSpace 10-13, 620 likes / 92k views; @hr98w, @xiaomovps, @0xLogicrw, and other Chinese science posts
  • Verified Hardware/tech media: Hackaday 2026-10-14 coverage, same day as +1072; Elektor, Open Source For You, daily.dev, Circuit Digest
  • Verified Reddit and maker platform seeding: author's own posts on r/esp32; the author posted project pages on Hackster, Instructables, PCBWay, and Elektor Labs
  • Inferred HN: our hackernews database has no record of it
  • Verified Ongoing feeding through version releases: desktop-free version → TestFlight (11-03) → CLI/MCP → DeepSeek Harness, with an X post at each step, and stars climbed back with each one

Why onehumanbeing/esp32-iphone-agent (Handsy AI) could take off

Channel: GitHub | Repo created 2026-10-11 | As of 2026-11-06:4436 stars / 596 forks (our GitHub repo) | Author Henry Yuan (@iamhenryyuan, New York; GitHub account registered 2016, 117 followers)

One line

An XIAO ESP32-S3 board costing about $7 plugs into the iPhone's USB port. The board acts as an AirPlay receiver to "see" the screen and as a USB mouse and keyboard to "tap" it (with iOS AssistiveTouch). An app on the phone, or an agent on a computer (CLI / MCP), calls any OpenAI-compatible vision model to decide the next step. No Mac, no developer account, no jailbreak.

Conclusion: it rode the "iPhone-use" wave that hit Chinese X in early October 2026 (zhongerxin/iPhone-use was created 10-06 and got several thousand stars within a week). It hit the pain point every similar approach runs into (needing a Mac + Xcode + signing / developer mode), and its one-line pitch, "a $7 board, nothing else needed," backed by a demo video, was amplified to fame first by the big X account @RoundtableSpace (92k views) and then by Hackaday (10-14), adding +10-14 stars in a single day on 1072. Differentiation (pure physical peripheral, zero dependencies) is genuinely why it took off, but timing and the amplification from X and hardware media were just as important.

1. Growth data

  • Single-day peak: 2026-10-14 +1072 stars (data card max_day_gain); 10-17 has 2802,11-06 for 4436 (github database repo_day).
  • Pace: 10-17 → 10-24 gained +80~170 a day; over the last 7 days +343, over the 7 days before that +548, slowing down. From 11-04 it climbed back to +60~70 a day, matching 11-03 going live on TestFlight and 11-06 posting the Chinese "supports DeepSeek Harness / MCP" thread (345 likes, 33k views).
  • Fork/star ratio is about 13%, which is high for a hardware project: many people are actually buying boards and modifying code.

II. Competitors (doing the same thing: letting AI operate a real iPhone)

ProductFormLaunchedScaleHow it differs
zhongerxin/iPhone-useOpen source2026-10-064909 stars (github library)Goes through WebDriverAgent/XCTest. Needs a Mac, Xcode, and a dev signature; gets native elements, so precision is higher
OpenMinis/iCTRLOpen source2026-07-04581 starCustom XCUITest runner, still needs signing
mobile-next/mobile-mcpOpen source MCP servers2025-0310.3k starsCovers iOS/Android/emulators, but real iOS devices need a Mac + WDA
web-infra-dev/midsceneOpen source (ByteDance)2024-0715.5k starsBuilt for E2E testing; iOS needs a Mac + signing
zai-org/Open-AutoGLMOpen source (Zhipu)2025-1226.5k starsMainly Android (ADB), doesn't solve iPhone
ja1chen/actellOpen source2026-10-09116 starAn agent app on iPhone that uses the CoreDevice debug channel; needs developer mode
boboabw/phone-agentOpen source2026-10-0621 starClosest match: ESP32 Bluetooth HID + AssistiveTouch + an iPhone app, but no "eyes" (doesn't receive AirPlay)
zhaodashuaibi/VersaiOSOpen source2026-039 starUxPlay + ESP32 Bluetooth mouse, needs a computer. Almost the same idea, seven months earlier, and it never took off
Sipeed NanoKVM Go used for iPhone Use (recommended by @coolish)Hardware2026-10Post 282 likes / 140k viewsCaptures over USB-C DisplayPort at 60fps, wireless and rechargeable; expensive, needs dedicated hardware
yoyicue/glassbox, AidenAI aiden-firmwareOpen source2026Single digits to unknownHDMI/PicoKVM capture + HID, needs extra capture hardware
Apple's ownBig-company features——Apple Intelligence / Siri doesn't open up letting third-party models operate arbitrary apps. @RoundtableSpace's words: "Apple never built this, so someone hacked it with $7"

The author put a comparison table in the README (VersaiOS, actell, aiden, glassbox, phone-agent, devicehub, plus mobile-mcp / Midscene, which need a Mac and signing). The table itself is the positioning.

III. Growth levers (where users come from)

  1. The author's own X post + demo video (verified): 10-12 first post "A $7 ESP32 lets an AI agent control a stock iPhone. No Mac, no jailbreak…" 242 likes / 210k views; 10-12 also posted a Chinese version (213 likes, a fully automated 22-step alarm-clock demo); 10-15 "The new version doesn't even need a Linux box" 807 likes / 62k views. Bilingual posts went out at the same time, so both circles were reached. (X live search, 2026-11-06)
  2. Big X accounts reposting (verified): @RoundtableSpace (Mario Nawfal circle) 10-13 620 likes / 92k views; @Dinosn (security circle) 10-22; in the Chinese circle, @hr98w's "iPhone-use approaches overview" 315 likes, @xiaomovps's "Four projects that turn ESP32 into an agent terminal" 93 likes, plus explainer posts from @0xLogicrw, @justloveabit, @ai_suxiaole and others.
  3. Hardware press (verified): Hackaday 2026-10-14, "AI Controls iPhone Via ESP32", same day as the +1072 jump. Then Open Source For You, daily.dev, Circuit Digest (Facebook/Instagram), Elektor, several dev.to posts, YouTube explainer videos, and SkillsLLM/SourceForge mirrors.
  4. Community posts and project pages the author set up (verified): Reddit r/esp32 "I built an AI agent that operates a real iPhone with a $7 ESP32-S3"; the author's account also posted project pages on Hackster, Instructables, PCBWay and Elektor Labs. Classic hardware-community multi-platform seeding. (Jina search; exact vote counts unverified)
  5. HN: nothing. Our hackernews database finds no hits for this repo or related titles.
  6. A steady stream of "new version" updates: the original needed a computer running UxPlay → 10-15 removed the computer, with the board acting as the AirPlay receiver itself → 10-22 submitted to the App Store → 11-03 TestFlight → CLI/MCP (cli-v0.1.0) for Claude Code → 11-06 DeepSeek Harness. Each step got its own X post, and the star count picked up another small wave each time.
  7. Early monetization signs: the site handsy.tech sells the board and cables through Amazon affiliate links, and the iOS app is waiting on review. The top of the README asks secondary developers to credit the project, which is groundwork for the Handsy brand.

4. Why it made the list

  • 时机:10 月初“iPhone-use”在中文 X 圈突然火(iPhone-use 10-06、actell 10-09、phone-agent 10-06 同一周冒出),还有 GPT-6 Astra computer use、新 iPhone 发布的话题;@xiaomovps 也提到 Meta 10-02 开源 Muse Gadgets 让 ESP32 当 agent 外设又火了一波。大家正在找“怎么让 agent 操作 iPhone”,它在需求最热的那一周发出来。
  • A one-line pitch that hits the biggest pain point: similar tools all need a Mac + Xcode + signing or developer mode. Its title is literally "$7 / No Mac / no developer account / no jailbreak," which even outsiders can repost.
  • A visible, reproducible demo: a photo of the actual hardware (the board plugged into a phone), plus alarm-clock and drawing videos. At 7 dollars and available on Amazon, everyone thinks "I could try this too," so the fork rate is high.
  • Two crowds crossing over: the AI agent crowd (X) and the hardware/maker crowd (Hackaday, Hackster, r/esp32). A pure-software iPhone-use tool couldn't land on Hackaday. This one could.
  • Fast iteration: within three weeks it went from "needs a computer" to "the board is everything." The engineering effort (porting UxPlay's AirPlay receiver to ESP32 and passing H.264 through) is itself a reason to share it (the author replied, "performance is basically squeezed to the limit").

5. Differentiation

Packs both "eyes" and "hands" into one $7 board, using only public iOS features (screen mirroring + AssistiveTouch + USB peripherals). The same idea existed earlier in VersaiOS (needs a computer) and phone-agent (no eyes), and they only got single digits to a couple dozen stars. The extra step it took, with the ESP32 acting as the AirPlay receiver itself so no computer is needed at runtime, completes the "zero dependencies" story. So differentiation is part of why it worked; but the pure-software iPhone-use projects in the same period also picked up nearly 5000 stars, which shows the hype itself contributed a lot. Differentiation is what made this one the breakout in the hardware community. Trade-offs: relative pointer, needs calibration, slow (each step takes a screenshot through a vision model), no Chinese input or landscape mode yet (quoting @xingjia520 from the README), and precision below the XCTest approach. NanoKVM Go is already claiming it's "fully better than the ESP32 approach."

6. Visibility and copycats

  • Visibility: spreading in small circles, and already reaching hardware media. Hackaday, Elektor and Open Source For You have covered it, and @RoundtableSpace on X has 92k views. It's an open-source project with no public revenue.
  • Copycats already showing up: ananhq/anan-iphone-use (10-13, ESP32 MCP firmware, 150 stars), ghosthand-dev/ghosthand (10-27, controls a real iPhone over USB + Bluetooth, 37 stars), JosssphZhou/poki (11-05, pure-software local MCP, 141~358 stars, its pitch directly compares itself with "no $7 board needed"), @openmys (JosephZhou) using an ESP32 Bluetooth mouse to order takeout on iPhone (436 likes), and the iPhone Use setup on Sipeed NanoKVM Go. The README specifically warns people not to run the "one-click install" commands in issues, because some have already used the hype to poison installs.

VII. What to take away

  • Pick a need people are actively searching for, where every existing solution hits the same gate, and write the title as "No X/Y/Z needed + price."
  • A hardware-plus-software project hits the AI crowd (X) and the maker crowd (Hackaday/Hackster/Instructables/PCBWay/r/esp32) at once, posting in both English and Chinese simultaneously.
  • Attach a video post to each version update, turning one burst of attention into multiple waves.
  • Open-source firmware + one-click browser flashing + two entry points (App and CLI) + hardware affiliate links is the path an open-source hardware project takes toward a product (Handsy).

8. Not sure

  • The vote counts on Reddit, Hackster and similar posts, and the stars they brought, are unverified. Our database has no daily star data for 10-11~10-16 (our data starts 10-17), so the peak comes from the data card.
  • Whether the App Store approves it is unknown (apps that control a phone through AssistiveTouch and peripherals risk rejection). Actual TestFlight install numbers are unknown.
  • Stars don't equal usage. How many people actually flashed a board and got it running is unclear. A high fork rate is the only indirect signal.

Sources

This article was written by AI from public data and the data we collect daily. Numbers are sourced, and inferences are labeled.