APOLLO MASTER – NETWORK PIPELINE MANAGER

Apollo MASTER is a distributed render and processing pipeline I designed to coordinate image workflows across multiple Ubuntu worker nodes. The system uses a central FastAPI-based master server with a live web dashboard for project management, task control, worker monitoring, queue handling, logging, and progress tracking, while all project data, pipeline state, and outputs are stored centrally on NAS storage. The architecture separates orchestration from execution: the master manages projects, tasks, and queue state, while worker machines pull chunked jobs from the master and execute them inside Docker containers. This makes the system scalable, reproducible, and easier to maintain, because every processing task runs in a controlled containerized environment with the same dependencies on every worker. I also implemented NAS mounting, worker heartbeat/status reporting, live progress updates, chunk-based task distribution, and modular documentation for the master, the overall system, and the worker/slave side.

Software: Hyper-V, Docker, Ubuntu, OpenAI Codex, Python