Horahora is a microservice-based video hosting website with additional functionality for group content archival from Niconico, Bilibili, and Youtube. Users can upload their own content, or schedule categories of content from other websites to be archived (e.g. a given channel on Niconico, a tag on Youtube, or a playlist from Bilibili).
This project is a WIP, and under active development.
Join our discord here: https://discord.gg/6TAEmAA
Currently, there are three microservices:
- User Service, which handles registration, logins, and JWT validation
- Video Service, which handles video uploads (both from Scheduler and from users), transcoding/chunking as required for DASH, uploads to the origin, and storage of metadata.
- Scheduler, which handles content archival requests from users. For example, if a user specifies that they'd like all videos on Niconico with the tag "YTPMV" to be downloaded, Scheduler will download those videos, register them (and their associated creator) with video service and user service, and check that category of content regularly for new videos.
All microservices are horizontally scalable, containerized, and communicate via gRPC.
The MVP will also consist of a frontend service to handle HTML templating, and a Censorship Service (name is a WIP) to manage the workflow for video approvals, and censorship of obscene content from foreign websites.
Currently, only local use is supported. To run horahora locally, follow these steps:
- First install the following depdendencies:
- Flyway
- Docker
- Kubernetes
- Start minikube, and use
./run-local.shin the Kubernetes directory. If the database migrations fail to apply, keep running run-local.sh until they succeed. - Run
./build.all.shto build all Docker images and send to the Docker daemon within minikube ./run-tests.shwill run local integration tests. Currently, this will send an archival request to scheduler for all YTPMVs on Niconico.
Missing features are tracked using Trello.
Our Trello board is: https://trello.com/b/Rm5TPR4Q/horahora