
"Humans get motion capture, monsters get nothing": a game YouTuber explains the method first and releases the code later, and the clone takes half the attention
What it is A locally run Python + Blender tool: it has an AI video model generate motion for your own 3D monster, then reads the motion back out and maps it onto the monster's own skeleton, producing game-ready animation.
Why it took off Monsters, quadrupeds, and flying dragons have no usable motion capture. The author explained the pain point and the solution in one video on his own YouTube channel, collected a week of "please open source it" requests, then released the code. Each video since links to the repo, and the star counts rise in two waves that line up with the videos.
CHow you could follow it Don't build the same tool again. That spot is already taken by it and anymove. The better move is to run the same loop on other game-dev pain points: make a video saying "I tried every tool and none worked, so I built one," release the code the same day you explain the method, and use every later video to funnel traffic to a real project.
- Data (updated daily) · Repo created 2026-10-23 · 302 stars · 7 days +81
GitHub · stars Data 2026-10-27 → 2026-11-20 (25 days, 25 observations). Points before 10-28 come from deeply / archive backfill, not every day has one
A YouTube channel with 22k subscribers posted a video on Oct 17 that got 148k views and showed how to animate monsters with AI video. The comments asked for the code for a week, and it was finally released on Oct 25. By Nov 15, video2rig had 264 stars. Two days later, a startup's clone built from that video had 593 stars. Two things are worth watching here: how the "content channel plus open-source tool" loop works in practice, and how a method shared publicly before the code is out leaves a one-week gap that others can fill.
A deer whose legs keep crossing
In Oct 17, the channel Can It Code? posted "AI Can Now Animate Any Monster. Opus 5.5 Built the Tool." The first paragraph of the description reads: "A troll, a wyvern, a centaur with a sword. Humans get motion capture and Mixamo. Monsters get nothing."
It started with a deer in the author's own game. He used AI video to generate a running animation for the deer, shot from a single camera, but the legs kept crossing and you couldn't tell which leg was in front. The video then walks through the approaches he tried, one chapter at a time: Google DeepMind's point tracking, SAM 2 for outline extraction, Depth Anything for depth estimation, color-coding the legs, the animal pose model AP-10K, and Huawei's MoCapAnything. None of them worked. In the end he changed approach: put a front view and a side view in one frame, have Seedance generate motion video from that image, then use Meta's DINOv2 to train a joint recognizer on renders of this one monster, read out each joint frame by frame, and map it onto the monster's own skeleton. One chapter is titled "Before: 4 days checking frame by frame with Opus. Now: minutes."
This episode has 148k views, 2,946 likes, and 386 comments (YouTube, 11-14).
What it actually does
video2rig is a Python + Blender script set that runs on your own computer. It has no GUI and is operated from the command line:
- Open your rigged model in Blender and render a starting image (front view on the left, side view on the right);
- Feed that image to a first-frame video model such as Seedance, Kling, or Veo, write a motion prompt ("giant staggers backward"), and generate a 4–8 second video;
- Train a joint recognizer once per creature: Blender poses the model in random configurations in the background and renders training images, then trains on DINOv2-small. The README gives about 4070 minutes on an RTX 40;
- Read out the joints frame by frame, fit the whole motion to your own skeleton in one pass, and output a standard Blender action that you can export as glTF / FBX.
Unlike the video-to-animation tools on the market, it handles any skeleton: trolls, wolves, centaurs, wyverns, not forced into Mixamo's humanoid rig. The README has a comparison: on a running wolf, the per-bone error drops from about 21° to about 3°. Props (wood, stone, weapons) are tracked as rigid bodies too, there's a check that verifies both views' motion matches, a review that exports comparison clips, and TUTORIAL, TROUBLESHOOTING and other docs are all thorough.
The barrier to entry is stated bluntly: training needs an NVIDIA RTX 30-series card or better, you need Blender and CUDA-enabled PyTorch, and you pay for video generation yourself. License is AGPL-3.0.
Where the stars came from: every wave lines up with a video
| Date | What happened | Stars |
|---|---|---|
| 10-17 | Method video went live, 148k views; method only, no code | Repo not yet created |
| 10-23 | Repo created; same day, "I tested 9 AI video models for game animation" posted, creator pinned "this tool ships this weekend with the Boss fight video" | 0 |
| 10-25 | "Building an entire boss fight in Unreal Engine with AI", 69k views, first line of the description: "My animation tool is free and open source" plus a GitHub link | — |
| 10-27 | Creator posted a thread on X, 33k views | 52 |
| 10-28 | +37 in a single day, highest of the observation period | 89 |
| 10-29 | @ashen_one (56k followers on X) reposted: "His pipeline made my dragon ten thousand times better... I also subscribed to his Patreon", 27k views | 103 |
| 10-31 – 11-08 | The channel posted no tool-related videos | +1 to +4 per day |
| 11-09 – 11-14 | Posted 4 videos in a row (game VFX, a showdown with 3D generators, humanoid animation, etc.), with video2rig linked in the descriptions or the body text | 163 → 253 |
| 11-15 | 264,53 forks |
(Star counts: daily GitHub records; views: YouTube and X, as of 11-14)
The pattern is clear: when the channel stops posting, stars stop; when the channel links it, stars climb. Over the last 7 days it gained 103 stars, versus only 22 the week before. It didn't make GitHub Trending, didn't make Hacker News, and I found no dedicated Reddit thread. Nearly all its stars came from the creator's audience.
53 forks, about 20% of the stars, high for a new project of this size, which means people are actually using it: @ashen_one wired it into his own Unreal game, with a commit reading "17 animation upgrades"; another asset-pipeline project, SlopForge, decided to plug it in as a local motion source.
Comment section, after waiting a week
The comments under the 10-17 video read like a requirements survey:
"Please share this, animating dragons has been so painful for me." (13 likes, 10-20)
"I'm making a game I started designing almost 20 years ago, and AI now lets one person build it. Animation has been the hardest hurdle so far." (10-19)
"Will you put this tool on Patreon, or make it a standalone app?" (10-19)
The creator's own pinned comment read "Should I use this tool to make a full 3A-rank boss fight? Like if you want it, hit like", 249 likes. A week later he delivered: the boss fight video and the open-source release went out together. A week of accumulated demand cashed in on the same day, and that's where the +37 stars on 10-28 came from.
The tool itself doesn't make money for the creator. The video description has a Patreon link, the pinned comment carries a referral link for the video-generation platform Higgsfield, and the tool needs a video-generation model to run at all. The tool builds reputation for the channel, the channel sends stars to the tool, and each feeds the other.
Code not out yet, clones already here
The problem is the week in between. The method was explained in the video at 10-17, but the code only came out at 10-25, and in that window several groups built it themselves from the video:
- A commenter wrote: "Had Opus set up this pipeline, took under an hour, trained a model, and within minutes it had idle, attack and run animations." (10-18)
- 10-22, a Chinese developer open-sourced their own version on V2EX, with a post stating "the core idea comes from CanItCode's video." It now has 12 stars, and the author himself says it's "barely usable."
- 10-27, startup Patch released anymove, and the first paragraph of its README reads "the method is @CanItCode's." It swapped in MiniMax's video model plus a LoRA that keeps the two-camera layout, runs through fal's API, outputs GLB, is packaged as a Claude Code plugin, and funnels traffic to its own game platform. The CEO's launch post got 111k views and 2,104 bookmarks, and the project has 593 stars, more than double the original. Some outlets that covered it wrote about anymove.
This isn't Patch's first time doing this. 10-19 it had just released prompt2rig (text-generated humanoid animation, 580 stars). Its playbook is to watch for AI game-dev methods that suddenly take off on YouTube and X, then ship a fully packaged open-source version within days: GIF cover, step-by-step README, agent plugin, plus a CEO account that already has followers.
Why it only has a couple hundred stars
Among "video-to-animation" projects, several humanoid-only open-source ones have reached a thousand or two stars (Motion2MixamoRig 1,987, toyxyz's RGBMocap 1,507). video2rig hasn't reached that level, for concrete reasons:
- Narrow audience: you need an N-card, must be comfortable with Blender and the command line, each creature needs 40 minutes of training first, and you pay for video generation yourself. Net result: the target user is an indie developer making a 3D game with AI who needs non-humanoid characters.
- Single maintainer: the author has merged no PRs, and the last commit was 11-03.
- No packaging: no GIF cover, no one-click install; the first thing you see is a long dependency table.
- Attention split: the method was made public early, and the better-distributed anymove grabbed the X wave first.
If it were you
Verdict: the need for "AI video → non-humanoid skeleton" is real, and there's no big-company solution. But this slot was taken twice within 10 days (video2rig and anymove), and what's left is packaging, not the method. Cloning it again would struggle to earn stars. What's worth learning is the playbook. Grade C.
Who it fits: developers who have a content channel (YouTube, Bilibili, X with thousands of knowledgeable followers) and are actually building a game. In this playbook, the most valuable piece is a single video that explains the pain point thoroughly; the code comes second.
Who it doesn't fit: people with no distribution who hope to earn stars from GitHub organic traffic, or people who only write code and aren't making a game. The project's credibility comes from the author using it on his own game and boss fights.
How to do it, three ways to follow, ranked by feasibility:
- Run its loop on another pain point (best): pick a step you got stuck on in your own project where no existing tool works (textures, sound, level design, cutscenes), make a video "I tried every tool, none worked, so I built one," let comments pile up "open source it" requests, then release the code, and link it in every later video with you using it in a real project. But don't copy its one-week gap: release the code the same day you explain the method.
- Fill what it didn't do: a Blender add-on panel that needs no command line, or an import pipeline for Unity and Godot users. Mind the licenses: video2rig is AGPL, so if you modify its code, derivatives must also be open source; anymove is Apache-2.0, which has fewer restrictions as a base.
- Copy Patch as a fast follower: watch viral AI game-dev videos that only explain the method without releasing code, ship a fully packaged open-source version within days, and credit the method's origin clearly in the README. Patch did this twice, each getting about 600 stars; the prerequisites are that you move fast and have an account that can push a launch post to a hundred thousand views.
How to get stars: go through video, not GitHub. Look at video2rig's curve: on the 9 days the channel stopped posting, it only gained 1 to 4 stars a day. Put a before-and-after comparison on the cover (its README's first image already puts "AI-video motion" and "motion applied to your own skeleton" side by side), and build an entry point that agents like Claude Code can use directly.
When it's already too late: the shelf life of this kind of method is measured in weeks. Image-to-video models get stronger with every generation, and what today needs a two-camera setup plus per-creature training may be solved outright by the next general-purpose model.
What would show I'm wrong: if video2rig stays around three hundred stars a month or two later, while the channel keeps linking it; or if someone runs this "video + open source" loop on another pain point without it producing meaningful stars, then this time the win came from the specific pain point of "no motion capture for monsters" and that one video, and the playbook can't be copied as-is. Conversely, if a big company's motion-capture product starts supporting arbitrary skeletons, the niche disappears on its own.
Research notes: competitor table, acquisition evidence, full research report
- Competitors
Name Where Launched Scale How it differs from this one patch-gg/anymove(Patch) Open source 2026-10-27 593 stars / 66 forks; launch post 111k views Clone of CanItCode's method, wired to MiniMax H3 + LoRA and fal, outputs GLB, packaged as a Claude Code plugin, funnels traffic to patch.gg; Apache-2.0. Nearly identical method, stronger packaging and distribution blendi-remade/prompt2rig(Patch) Open source 2026-10-19 580 star Text → video → GVHMR → Mixamo, humanoid only MoCapAnything V1/V2 (Huawei) Open source 2025-12 / 2026-04 phongdaot/MocapAnything 510 star Academic general-purpose model, no per-creature training; the author tried it and says it fails on monsters. video2rig trades accuracy for per-creature training GrinZero/open-game-studio Open source 2026-10-22 12 star Clone of the video, author's self-assessment "barely usable" toyxyz/toyxyz_RGBMocap Open source 2026-10-26 1,507 star,gain_7d 640 Windows app for humanoid video motion capture, doesn't do non-humanoid MaxLiu22/Motion2MixamoRig Open source 2026-08-29 1,987 star Real-person video → Mixamo humanoid skeleton squall01337/mixamo-llm-mocap Open source 2026-08-17 440 star GVHMR + MCP, Mixamo humanoid only Mesh2Motion Open source 2023-12 3,671 star Plays preset animation libraries, doesn't extract motion from video NVIDIA Kimodo / GEM-X Big-company features 2026-03 4,212 / 593 star Text-generated humanoid motion / human pose estimation, SOMA humanoid skeleton Mixamo / MetaHuman Animator markerless mocap / Rokoko Vision / DeepMotion / QuickMagic / Autodesk Flow Studio Big-company features Years (MetaHuman markerless plugin 2026-06) Large (unverified) Mostly humanoid skeletons; custom skeletons like monsters and quadrupeds have almost no ready-made solutions - Where users come from
- Verified the creator's own YouTube channel, Can It Code?: the 10-17 method video 148k views; the 10-25 boss fight video (69k) links GitHub in its first description line; 11-09 (70k), 11-12 (55k), 11-14 (19k) all link video2rig in their descriptions; the star spikes line up with both waves (YouTube API, Trendshift daily gains)
- Verified demo first, open-source later: the hype build-up: the 10-17 video's comments are full of "please open source it" and "is there a GitHub?"; the creator pinned "the tool ships this weekend with the boss fight video" at 10-23
- Verified AI game dev circles on X reposted it on their own: @Graalitoo 10-20 posts, 11.7k views; the author's thread 10-27 with 33k; @ashen_one 10-29 post with 27k views and 339 likes (said they bought the Patreon), 11-08 another post with 4,261 views (fxtwitter)
- Verified Second wave on Chinese developer channels: V2EX rebuild post (10-22), @KobinFlow long post, Cnblogs repost, Qingyun TOP, aigamehot, ohmyopus listing
- Verified Monetization: Patreon + Higgsfield referral links: Patreon linked in the video descriptions; the pinned comments on 10-23 and 10-30 are Higgsfield referral links; the tool requires an image-to-video model
Why canitcode/video2rig worked
Data as of 2026-11-15 (our github database + GitHub API + YouTube Data API + fxtwitter + web search). Data card: /home/ljr/fanout/why/cards/gh_canitcode__video2rig.json
Bottom line
video2rig was built by the author of the Polish YouTube channel Can It Code? (@CanItCode, 22k subscribers) to make his own game, not something that grew on GitHub. The sequence was: video first, code later. 10-17 The episode "AI Can Now Animate Any Monster" (148k views) laid out the problem (no mocap for monsters) and the fix (AI video + a joint-reader trained per creature on DINOv2), and the comments filled with "open source this" requests. 10-23 The repo was created, and 10-25 the Boss fight video formally announced the open-source release. Every later star wave lines up with new channel videos linking the repo in their descriptions. Its differentiation is the method itself: non-humanoid custom skeletons (monsters, quadrupeds, flyers) driven by AI video with a front and side camera in one frame, plus a joint-reader trained per creature on synthetic data rendered in Blender. The differentiation is real, but the method 10-17 was public in the video, the code wasn't out yet, and three groups rebuilt it from the video. The most visible was the startup Patch's anymove 10-27 release: 110k views on X and 593 GitHub stars, more than double the original's buzz.
What it is
- A locally run Python + Blender script toolchain (AGPL-3.0, no GUI, not a Blender add-on panel). The workflow:
- Export your own rigged model from Blender and render a starting image (front and side cameras in one frame);
- Use that image as the first frame for an image-to-video model like Seedance / Kling / Veo, write one line describing the motion, and generate a 4–8 second video;
- Train a joint reader once per creature: Blender randomly poses the model and renders training images from the starting image's camera setup, then trains on Meta DINOv2-small (about 40 minutes on an RTX 4070);
python -m video2rig runreads each joint's position from both views frame by frame, fits the whole motion to your own skeleton in one pass, and outputs a Blender Action, which can be exported to glTF / FBX.
- Hard requirements: an NVIDIA RTX 30-series or better GPU, Blender 5.1, Python 3.10–3.12 with CUDA PyTorch, and your own video generation account. Models without a skeleton can be auto-rigged with UniRig.
- Source: README (https://github.com/canitcode/video2rig); the author's account registered 2026-10-23, and this is his only serious repo.
Growth data
| Date | Event | Stars (our github database / Trendshift daily gains) |
|---|---|---|
| 10-17 | Channel posted "AI Can Now Animate Any Monster. Opus 5.5 Built the Tool": 148k views, 2,946 likes, 386 comments (YouTube API) | Repo not yet created |
| 10-20 | X user @Graalitoo (1,300 followers) posted a long recommendation of the video and reproduced it, 11.7k views | — |
| 10-22 | V2EX user bugyaluwang (GitHub GrinZero) open-sourced their own version based on the video's approach (the monster package in open-game-studio), with a post stating "the core idea comes from CanItCode's video" (covered by phuamedia.com and haiai123.com) | — |
| 10-23 | Repo created; same day the author posted the video "I Tested 9 AI Video Models for Game Animation" (21k views), with a pinned comment: "I'll release this tool with the Boss fight video this weekend" | 0 |
| 10-25 | "I Made a Full Boss Fight in Unreal Engine With AI" (69k views); the first line of the description reads "My animation tool is free and open source" with a GitHub link, and chapter 0:19 is "The tool is on GitHub" | +0(Trendshift) |
| 10-26 | GrinZero forked video2rig and posted on X: "canitcode finally open-sourced it, now I'm studying the differences from my version" (Trendshift social mention) | +10 |
| 10-27 | The author's own X thread (588 followers) 33k views; Chinese account @KobinFlow wrote a long post introducing the Boss fight and the tool, 789 views; Patch launched anymove | 52 → 10-28 reached 89 (+37 in one day, the largest in the observation window) |
| 10-29 | X user @ashen_one (56k followers) quoted the author's thread: "his workflow made my dragon 10000 times better... I also bought his Patreon," 27k views, 339 likes | 103 → 126 |
| 10-31 – 11-08 | The channel posted no tool-related videos and X had no new buzz | +1 to +4 per day, essentially flat |
| 11-08 | @ashen_one posted again: "This Vid2Rig system makes me want to buy my own GPU," 4,261 views | 161 |
| 11-09 | "AI Can Now Make Game VFX" (70k views), description links video2rig | +10 |
| 11-12 | "Can Claude Fable 5.2 Beat 3D Generators?" (55k views); round 5 used video2rig, with the link in the description | +28 |
| 11-14 | "How I Make Any Custom Human Animation With AI" (19k views), tool list includes video2rig | 11-14 → 253,11-15 → 264 |
- gain_7d = 103, prev_7d = 22: the second wave accelerated, matching the four videos from 11-09 to 11-14 exactly (our github database).
- 53 个 fork,fork/star 约 20%,比同量级新库高。fork 的人里能看到真在用的:oh-ashen-one 把它用进了自己的 UE5.8 游戏「hulk」,合了一个「Brute video2rig 动画升级:17 段 clip」的 PR;gysahlgreene/SlopForge 2026-10-27 决定把 video2rig 当作本地动作源接进去,有 issue #129/#130 和 PR #131;Ahnyth 提了 6 个 PR 和一份基准测试笔记。
- The author has 0 merged PRs, a single maintainer (Trendshift: Merged PRs 0 in 22 days), last commit 11-03.
- Not on GitHub trending (the repo was only 23 days old, under the 60-day threshold, which itself tells us nothing), not on HN (our hackernews database finds nothing), and no dedicated Reddit thread found.
Where users come from (growth levers)
- The author's own YouTube channel, the main channel (confirmed). Channel opened 2026-06, 49 videos, 2.3M cumulative views, positioned as "making games with top AI models." 9-27 "Crazy AI Animation Workflow" (193k views) covers the tool's previous generation (point tracking), and 10-17 covers the new DINOv2 approach (148k). Every video since has linked the GitHub repo in its description and voiceover. Both star waves line up with video releases.
- "Demo first, open-source later" warm-up (confirmed). 10-17 The video shows the method but not the code, and the comments are full of "please open source", "is there a GitHub?", "can I get it on Patreon?" (one reads "PLEASE SHARE THIS" with 13 likes). The creator pinned "Want me to build an AAA boss fight with this tool?" (249 likes), and pinned a teaser in 10-23 saying "releasing with the boss fight video this weekend." A week of accumulated demand gets cashed in on the day of the open-source release.
- Reposts within the AI game dev circle on X (confirmed). @Graalitoo (11.7k views), the author's own thread (33k), @ashen_one (27k + 4,261), and the Chinese account @KobinFlow. These were all organic; no paid promotion was seen.
- Second spread among Chinese developers (confirmed, small volume). The V2EX rebuild post, a Cnblogs repost (10-27,14 reads), Qingyun TOP, aigamehot, and the ohmyopus case library all picked it up.
- Aggregators and AI indexes (confirmed, small volume). Listed on Trendshift, AwesomeRepos, Just Arrived, context7, and DeepWiki-style sites.
- Where the money comes from: The tool is free, and it uses AGPL so nobody can turn it into a closed-source paid product. The creator monetizes through the channel: Patreon (the 10-17 video description links it, a commenter says "just subscribed to Patreon," and @ashen_one says they bought in), plus Higgsfield affiliate links (the pinned comments on 10-23 and 10-30 are all "try Kling 4.0 on Higgsfield" referral links). The tool needs an image-to-video model to run, so every user is a potential paying customer of a video generation platform, which lines up naturally with the Higgsfield promotion. The tool's role here is a hook that brings new viewers to the channel and builds word of mouth.
Competitors
| Name | Where | Launched | Scale | How video2rig differs |
|---|---|---|---|---|
| patch-gg/anymove (Patch) | Open source | 2026-10-27 | 593 stars / 66 forks; CEO @rehan_shei's launch post 111k views, 1,501 likes, 2,104 bookmarks | A rebuild based on the CanItCode 10-17 video (the README states "The method is @CanItCode's"), swapping in MiniMax H3 + LoRA to preserve the two-camera layout (@Graalitoo's idea), running through the fal API, outputting GLB, packaged as a Claude Code plugin / agent skills, and driving traffic to patch.gg (publish games, ready-made creature asset packs). Apache-2.0 |
| blendi-remade/prompt2rig (also Patch) | Open source | 2026-10-19 | 580 star | Humanoids only: text → fast video model → GVHMR → Mixamo skeleton, with live preview in the browser |
| GrinZero/open-game-studio(monster package) | Open source | 2026-10-22 | 12 star | Also a rebuild of the video (Tripo + TokenRig + DINOv2 + MiniMax H3); the author himself says it's "barely usable" |
| MoCapAnything V1/V2 (Huawei, SIGGRAPH Asia 2026) | Open source / paper | 2025-12 (V1), 2026-04 (V2) | phongdaot/MocapAnything 510 star | A general academic model that drives any skeleton from monocular video without per-creature training; CanItCode said in the video that he tried it and the results were poor |
| toyxyz/toyxyz_RGBMocap | Open source | 2026-10-26 | 1,507 star,gain_7d 640 | Human motion capture from ordinary video (GVHMR/ExMR/FlowHMR), a native Windows app, no non-humanoid support |
| MaxLiu22/Motion2MixamoRig | Open source | 2026-08-29 | 1,987 star | Real-person video → Mixamo humanoid skeleton |
| squall01337/mixamo-llm-mocap | Open source | 2026-08-17 | 440 star | GVHMR + MCP driving Blender, Mixamo humanoids only |
| Mesh2Motion/mesh2motion-app | Open source / web | 2023-12 | 3,671 star | Attaches prebuilt animation libraries to models; does not extract motion from video |
| NVIDIA Kimodo / GEM-X | Open source (big vendor) | 2026-03 | 4,212 / 593 star | Text-to-humanoid motion / monocular human pose, SOMA humanoid skeleton; CanItCode himself uses it for hero animations |
| Mixamo, the MetaHuman Animator markerless mocap plugin (UE 5.8,2026-06), Rokoko Vision, DeepMotion, QuickMagic, Autodesk Flow Studio | Big-company features / commercial SaaS | Years | large (specific numbers unverified) | all built around human skeletons. Custom skeletons like monsters, quadrupeds, and flyers have almost no ready-made solution. That's exactly what the video2rig intro says: "For people there is mocap and Mixamo. For monsters there is nothing" |
Bottom line: human "video to animation" is already crowded (several open-source libraries with 1k–4k stars, plus free plugins from big companies). The sub-niche "AI video → non-human custom skeletons" had only one academic model, MoCapAnything, before 10-17. CanItCode turned it into a workflow game devs can actually run, and within 10 days at least three clones showed up.
Copycats
- Patch's anymove (the biggest copycat and the volume winner): launched 10-27, just two days after video2rig announced it was open source. It credits CanItCode for the method, yet has 2.2× its stars and more than 3× its X views. LockerGnome, tau-home, DTF.ru and others covered anymove, not the original. Users lukeyuRL, Stonefletcher-Productions, ElgoogUdiab and others have already forked anymove. Patch's playbook: the CEO has an a16z scout and a background as a former fal engineer. The team watches trending AI game-dev methods on YouTube and X and quickly ships open-source versions (prompt2rig, anymove) with GIFs, step-by-step READMEs and a Claude Code plugin, then funnels people to patch.gg.
- GrinZero/open-game-studio (V2EX, 10-22).
- matteodante/AssetFurnace PR #8 "animate creatures from a two-camera video". The same idea got merged into someone else's asset pipeline.
- There's also maliceCo/video2rig, a repo borrowing the name whose content is actually the prompt2rig GVHMR approach.
Why it took off
- The need is real, and there's no substitute. Game devs making monsters, dragons and wolves can't get Mixamo or mocap, and hand-keyframing takes days. 10-17 comment sections and r/aigamedev threads about "animation is the biggest wall" say the same thing.
- Timing: image-to-video models can finally hold two synced camera angles of the same action steady (Seedance 2.5, Kling 4.0, MiniMax H3), and Opus 5.5 can now write a full Blender/PyTorch pipeline, so one person can ship it in a few weeks. The channel 10-23 episode "9 video models tested" is itself proof of this timing.
- Distribution runs on the author's own content channel. Not organic GitHub traffic, but method explainer videos with 148k views, plus 4 later videos each linking to it, and a week of "open-source please" hype beforehand.
- The method has real technical substance, not a wrapper. It trains DINOv2 joint recognition on per-creature synthetic data, fits the whole motion from both views together, tracks props as rigid bodies, uses
checkto verify both views agree on the motion, and areviewstep renders comparisons. The README gives error numbers (a running wolf, per bone 21° vs about 3°), and there are TUTORIAL / WORKFLOW / VIDEO / TROUBLESHOOTING docs. So people on X post before-and-after results on their own dragons, and real usage shows up in the forks. - Why it has only 264 stars when similar tools hit thousands: the barrier is high (an NVIDIA GPU, Blender, command line, 40 minutes of training per creature, paying for video generation yourself). The audience is that narrow: indie devs making 3D games with AI. The author maintains it alone, doesn't merge PRs, and has no GIF-first marketing. The method was public from the start, but anymove, with better packaging and stronger channels, took the attention.
Differentiation
- Versus human mocap tools (GVHMR, Rokoko, MetaHuman, Motion2, MixamoRig, etc.): video2rig handles any skeleton (monsters, quadrupeds, pterosaurs, centaurs) and retargets motion onto your own rig instead of requiring Mixamo. That's the core reason it got noticed.
- Versus the general academic model MoCapAnything: it drops the "one model for everything" approach and trains a dedicated recognizer for each creature over 40 minutes, trading compute for accuracy. The starting frame is a render from the creature's own model, so the shape and camera are known, which makes results far more accurate.
- Versus the clone anymove: the difference is small and mostly about engineering choices. video2rig lets you choose any video generator, outputs a Blender Action, and uses AGPL. anymove is tied to fal / MiniMax H3, outputs GLB, uses Apache, and ships an agent plugin and platform. The differentiation is why video2rig got traction, but it's hard to defend: the method spreads through video, and spreading it also publishes the recipe.
What to borrow
- The "content channel + hardcore open-source tool" loop: first shoot a "I tried every tool, none worked, so I built one" video to ignite demand, collect "open-source please" in the comments before releasing code, then keep using the tool in real projects in every later video to keep funneling viewers. The tool builds the channel's word of mouth and Patreon conversions, and the channel brings in stars for the tool.
- The hook has to tie into monetization: the tool needs a video generation model, and the channel happens to sponsor a video platform (Higgsfield), so more users means more sponsorship revenue.
- The reverse lesson: there was a week gap between publishing the method and releasing the code, long enough for a better-packaged version from a team with channels to get out first and take the attention. To hold it, either ship the code at the same time, or don't lose on packaging (GIF-first README, one-click install, agent skill).
- For anyone building in this space: the "AI video → non-human skeleton" need is validated, but the open-source spot is already taken by video2rig and anymove. What's still open is a hosted or Blender-plugin version that needs no command line and no local GPU (AGPL requires derivative websites to be open source too, whereas anymove is Apache and can be closed-source commercial).
Unknowns
- Stars and usage: many forks and real downstream projects, but it's unknown how many people actually got it running.
- Patreon subscriber count and Higgsfield sponsorship revenue: not public, unverified.
- Whether the author's X account (@CanItCode, 588 followers) has other high-view posts: only found the 10-27 thread.
- Whether commercial SaaS competitors (DeepMotion, Rokoko, etc.) already support quadrupeds or custom skeletons: not checked one by one; the note that they're mostly human-focused is from general impression.
- Whether Reddit has dedicated threads about video2rig: several searches found none, which doesn't mean there are none.