Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Downloading all data #180

Closed
LivacoNew opened this issue Apr 23, 2023 · 1 comment
Closed

Downloading all data #180

LivacoNew opened this issue Apr 23, 2023 · 1 comment

Comments

@LivacoNew
Copy link

Hi,
My use with this API works completely fine but I've got concerns with hitting rate limits as it currently stands. As it currently stands I can have any number of users request a random image from any SOL/Camera at any time - With the rate limits of 1000 req/h that's a struggle.
I want to take the data and store it in a local sqlite database I can hit locally, so that I'm not wacking yours continuously. Is there any easy way to do this just in a single request, or would I have to manually write a script to go through every SOL in a rovers manifest to get that data?
All I would need is an image url, the rover it belongs to, the camera and the sol. The rest I can gather very easily myself - it's just these bits of data that I would need hundereds of requests over hours to get otherwise.
Thanks.

@LivacoNew
Copy link
Author

Closing due to lack of response - Went with my idea of just scraping the API with a python script :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant