Live instance: sint-cmo-operator-production.up.railway.appSource: github.com/pshkv/sint-cmo-operator
What It Produces
From a single 45-minute video:| Output | Count | Platform |
|---|---|---|
| Vertical clips with animated captions | 5–15 | TikTok, YouTube Shorts, Reels |
| LinkedIn posts with pull quotes | 5 | |
| Twitter threads | 3 | X/Twitter |
| Instagram carousel slides | Multiple | |
| SEO blog post | 1 (2,000+ words) | Blog/CMS |
| Content calendar | 7-day schedule | All platforms |
Architecture
6-Stage Pipeline
Download & Validate
Fetch video from URL, validate format, extract metadata. Supports YouTube, direct URLs, and uploaded files.
Transcribe
AssemblyAI processes audio with word-level timestamps and speaker diarization. Produces timestamped transcript with speaker labels.
Analyze
Claude performs a 3-pass analysis:
- Pass 1: Topic segmentation — identify distinct content blocks
- Pass 2: Hook identification — find viral-worthy moments
- Pass 3: Scoring — rank segments by engagement potential
Face Track
MediaPipe detects and tracks speaker faces. Smart 9:16 cropping centers on the active speaker for vertical video format.
Render
Remotion + FFmpeg render final clips with:
- Animated TikTok-style captions (word-by-word highlight)
- Brand color overlay
- Speaker-centered framing
- Platform-optimized encoding
18 Specialized Skills
The operator uses a skill-based architecture where each capability is an independent, testable module:| Category | Skills | Description |
|---|---|---|
| Ingestion | asset-ingester | Download and validate source media |
| Analysis | content-analyzer, brand-researcher, competitor-analyzer | Analyze content, brand context, and competition |
| Video | video-clipper, video-repurpose | Smart clipping and format conversion |
| Writing | linkedin-writer, seo-blog, newsletter | Platform-specific content generation |
| Visual | image-generator | AI-generated images and thumbnails |
| SEO | seo-optimizer, serp-scraper | Search optimization and SERP analysis |
| Distribution | content-publisher, platform-formatter, content-repurpose | Multi-platform formatting and publishing |
| Planning | social-calendar, schema-generator | Content calendar and structured data |
| Operations | output-packager, notifier | Package deliverables and alert stakeholders |
Tech Stack
| Component | Technology |
|---|---|
| Runtime | Node.js 22+, TypeScript |
| API | Express.js with modular route handlers |
| Video rendering | Remotion + FFmpeg |
| Face tracking | MediaPipe |
| Transcription | AssemblyAI |
| AI generation | Claude (Anthropic) |
| Auth | Custom auth middleware |
| Deployment | Railway (production) |
| Testing | Vitest |
Source Structure
Quick Start
Required Environment Variables
| Variable | Service | Purpose |
|---|---|---|
ANTHROPIC_API_KEY | Anthropic | Content analysis and generation |
ASSEMBLYAI_API_KEY | AssemblyAI | Transcription with timestamps |
ELEVENLABS_API_KEY | ElevenLabs | Voice generation (optional) |
YOUTUBE_API_KEY | YouTube publishing | |
TWITTER_API_KEY | X/Twitter | Tweet publishing |
LINKEDIN_ACCESS_TOKEN | Post publishing |
Integration with SINT Ecosystem
The CMO Operator connects with other SINT components:- SINT Outreach — Generated content feeds into LinkedIn outreach campaigns
- SINT Avatars — Video content can be presented through the 3D avatar system
- SINT Protocol — Content publishing actions can be governed by capability tokens for enterprise compliance
Source Code
View the full source on GitHub
Live Instance
Try the production deployment