AI Comic Builder Turns Any Script Into an Animated Short With 1.8k Stars
An open-source Next.js pipeline that turns raw scripts into full animated videos through character extraction, storyboarding, keyframe generation, and multi-model video synthesis.
Takeaways
- Open-source pipeline turns TXT, DOCX, or PDF scripts into fully animated comic videos with subtitles.
- Uses four-view character reference sheets to keep character appearance consistent across shots.
- Supports OpenAI, Gemini, Kling, Seedance, and Veo as swappable per-project backends.
- Built on Next.js 16, React 19, SQLite plus Drizzle, and FFmpeg for final composition.
- Apache 2.0 licensed with a prebuilt Docker image and hosted demo at comic.cturing.cn.
- Around 1.8k GitHub stars on the LingyiChen-AI/AIComicBuilder repository.
Turning a written script into an animated short usually means juggling half a dozen tools: an LLM for character design, an image model for reference sheets, another model for keyframes, a video model for motion, and FFmpeg to stitch everything together. AI Comic Builder collapses that chain into one self-hostable web app, and it has quietly picked up around 1.8k GitHub stars while doing it.
Feed the project a TXT, DOCX, or PDF, and it walks the story through parsing, character extraction, episode splitting, storyboarding, keyframe generation, video synthesis, and final assembly with burned-in subtitles.
The pipeline, stage by stage
The core loop is a directed graph of generation steps, each of which can be triggered independently or in batch. That granularity matters, because video generation is expensive and you rarely want to regenerate the whole thing when only one shot is off.
- Script parsing from uploaded files, with automatic style detection (anime, photorealistic, and so on)
- Character extraction with detailed visual descriptions
- Four-view character reference sheets (front, three-quarter, side, back) to lock in visual consistency
- Storyboard decomposition into a professional shot list with composition, lighting, and camera direction