Jazz is a CS:GO crawling platform whose purpose is to ingest, process and store .dem files from professional CS:GO matches.
As stated in Fileinfo, demo files are used to record a player's perspective inside a match and can be replayed inside the game itself.
By using the same parsing code as awpy, this project is able to parse crawled matches into tables.
Note that the entire awpy package was not used because only a small portion of it was necessary to parse the data.
Jazz uses lambdas orchestrated by Airflow. Although this may not be the optimal data processing tool, it suits well this case scenario as it makes parallel processing possible.
It also leaves the ec2 instance running as light as possible, bearing all the loads needed to crawl, download and parse data.
