Why I Regret Making a 2D Virtual Character with Claude
Key Points
- 1The creator attempted to build a Live2D virtual character using AI tools like Kodex and Claude, but found the process significantly more time-consuming and inefficient than traditional manual creation.
- 2Despite spending over 40 hours manually correcting AI-generated assets, the resulting character still suffered from anatomical distortions and inconsistent alignment between facial components.
- 3Ultimately, the experiment demonstrates that using current AI for complex animation rigging is economically and operationally counterproductive compared to hiring a professional or learning the craft manually.
Summary: Feasibility Study on AI-Assisted Virtual Character Rigging
This report evaluates the practical efficacy of using AI agents—specifically Claude (utilizing Opus 3.5) and the Codex CLI—to automate the creation and rigging of Live2D-style virtual characters. The author concludes that currently, relying on AI for this process is significantly less efficient than traditional manual workflows, highlighting a "productivity paradox" where the labor cost of managing AI interventions far exceeds the cost of professional manual production.
#### Core Methodology and Technical Workflow
The author attempted to bridge image generation and rigging automation through a multi-modal AI stack:
- Environment Setup: Integrated Node.js and npm to interface with the Codex CLI, allowing the AI to generate and retrieve character components via terminal-based prompts.
- Structural Decomposition: Initial attempts to have the AI segment full-body illustrations into functional rigging parts failed, resulting in "chimera-like" anatomical distortions. This necessitated a shift to a manual, iterative structure:
- Part Segmentation: The character was manually broken down into discrete layers (eyes, hair, facial features).
- Mesh & Deformer Mapping: For each segment, the author utilized the AI to guide the creation of meshes and deformers. Parameters were manually defined for head rotation, eye blinking, and facial expressions.
- Iterative Correction Loop: The core "automated" process relied on a feedback loop:
- The current state of the character was periodically captured.
- Codex was prompted to generate reference images based on correct anatomical proportions.
- Claude acted as the intermediary to compare the deformed mesh against the reference, requiring the author to manually tweak coordinate placements to maintain consistency across rotations ( axes).
- Physics and State Logic: The author implemented "spring-like" physics for secondary motion (hair, ribbons, earrings). State transition rules were defined for facial expressions (e.g., smile vs. open mouth) to ensure non-overlapping parameters, preventing the model from conflicting expressions.
#### Challenges and Technical Bottlenecks
- Anatomical Inconsistency: AI-generated references lacked temporal/spatial consistency. Every time a new reference was generated for a different angle (e.g., rotation), the model struggled to maintain geometric continuity with previous frames.
- High Latency in Error Correction: Because the AI cannot directly manipulate the rigging software’s vertices, the user acted as an "operator" translating natural language instructions into precise geometric adjustments. This resulted in a total production time of over 40 hours, compared to an estimated 8 hours for an experienced professional.
- Integration Overhead: The "hidden cost" of utilizing AI (subscription fees plus the 40+ hours of manual labor) was estimated at 400,000 KRW in labor equivalent. The project demonstrated that for simple character rigging, AI tools currently create more "maintenance debt" than they resolve.
#### Conclusion
The experiment highlights that while AI can assist in the conceptualization of assets, the lack of a deep, native integration between LLMs and rigging software makes the current pipeline inefficient. The complexity of managing number of parameters () across varying angles while ensuring the integrity of the mesh surface requires human intervention that currently negates any speed benefits promised by automation.