I build systems where models meet meaning. Over the past few years, I’ve worked across open source, devtools, consumer, and multimodal AI, from designing frameworks that help developers integrate Visual Language Models into production to building narrative-aware agents that understand long videos and movies. My work sits at the intersection of multimodal AI (VLMs), LLM agents, and real-world product systems — not just models, but systems that actually ship and scale. I’ve worked across open source, startups, and research systems: Senior Research Engineer & maintainer for PyTorch Lightning (~5M+ monthly downloads), where I led distributed training features like TPU Pod support Built evaluation and retrieval systems for long video understanding at Rumi Labs (a16z-backed), including multi-agent pipelines and multi-context RAG Co-developed VLM Run’s vision MCP server and schema-driven extraction systems for structured data from images, PDFs, and video Co-founded Sequels AI — an agentic AI media OS generating contextual content in real-time, later licensed to an a16z-backed startup What I can help you with: 1. Multimodal AI systems (Vision + Language) Extract structured data from images, documents, or video Build pipelines that actually work in production (not just demos) 2. LLM agents & workflows LangGraph / agent orchestration Tool-using agents, evaluation, and reliability 3. AI system architecture Designing scalable backends (FastAPI, queues, async pipelines) RAG systems with real-world constraints (latency, retrieval quality, cost) 4. Evaluation & reliability Build eval systems for LLMs, agents, or multimodal models Define metrics that actually reflect product performance How I typically work: Turn vague ideas into clear system designs Identify what’s actually hard vs hype Help you ship faster with fewer iterations If you’re building: AI products using real-world data Multimodal systems (vision, video, documents) Agent-based workflows Developer tools for AI —I can help you go from idea → architecture → working system.
AI Consultant
CurrentReiko2024-12-01 – 2026-04-11
Co-Founder & Head of AI
Sequels AI2023-05-11 – 2024-11-11
Senior Research Engineer & Open Source Maintainer
Lightning AI2021-01-11 – 2023-01-11