wga-scraper

A bot that automatically downloads all the images listed in the .xlsx Excel-Sheet and then lables them accordingly.

The source for the images can be found here.

Usage 📲

• Head over to the Releases Page and download the latest .zip

• Proceed to unzip an open up a terminal

• Move into the directory you unzipped the file into and run the following:

  java -jar .\wga-scraper-0.2-jar-with-dependencies.jar

  ^{Note: This has only been tested with Java 17 (recommended) and Java 8. Other versions might behave differently.}

Building from Source 🧱

• git clone the repo
• Navigate into ./studio.optinux.scraper/
• Make sure that you have Maven installed
• Open up a terminal and run mvn package to compile the application
• You will find the result in ./studio.optinux.scraper/target

TODO: 📝

• Implement the optional use of proxies in order to circumvent ratelimiting / ip-banning

• Make it use the entire database in its raw form instead of relying on an already trimmed down version

  ^{see branch currently_broken for my failed attempts regarding this}

this somehow took ~8h to do due to me having to pretty much learn 80% of this from scratch lol