0 views

YouTube Shorts AI Creator

YouTube Shorts AI Creator is a powerful automated system that identifies the most exciting moments in sports footage by analyzing both video and audio signals. It combines YOLO-based player and ball detection with audio-driven excitement scoring to generate high-quality, viral-ready highlights. The platform streamlines the entire process, from analysis to extraction, making short-form content creation fast, accurate, and effortless.

YouTube Shorts AI Creator is an end-to-end automated highlight generation platform designed for sports content creators. It merges advanced computer vision and audio analysis to detect high-energy moments within long-form videos. Built with a modern Next.js 16 frontend and a robust FastAPI backend, the system integrates YOLOv8, Librosa, PyTorch, and OpenCV to compute excitement scores and extract highlight-worthy clips. With asynchronous job processing powered by Redis and RQ, and seamless storage backed by Supabase, the platform delivers a scalable and efficient workflow. The intuitive UI provides real-time feedback, interactive timelines, and AI-driven highlight playlists, enabling creators to produce viral Shorts with minimal effort.

Key Features

  • Smart Video Analysis using YOLOv8 for player/ball tracking
  • Audio-based Excitement Detection using Librosa
  • Multi-signal Excitement Scoring System (0-100)
  • Automated Highlight Extraction with start/end detection
  • Real-time Analysis Dashboard with progress indicators
  • Interactive Timeline Visualization for highlight segments
  • Highlight Playlist sorted by excitement score
  • Asynchronous Processing Pipeline using Redis & RQ
  • Secure Cloud Storage for videos via Supabase

Technologies Used

Next.js 16TypeScriptTailwind CSSShadcn UIAxiosReact HooksFastAPIPython 3.12+YOLOv8 (Ultralytics)OpenCVPyTorchNumPyLibrosaSoundFilePyAVMoviePySupabase (PostgreSQL)Supabase StorageRedisRQDocker