Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Scrape Gallery/Query pages? #2

Open
CuddleBear92 opened this issue Apr 18, 2021 · 1 comment
Open

Scrape Gallery/Query pages? #2

CuddleBear92 opened this issue Apr 18, 2021 · 1 comment

Comments

@CuddleBear92
Copy link

CuddleBear92 commented Apr 18, 2021

Anyway you can add sccraping/parsing of the gallery/query pages you could download.
Would just need to load the html and look for the same urls the download system supports.
Unless you make some sort of url class to identify the correct urls in a list.
This way the user dont need to open all the issues in tabs before sending, instead they could refine queries and send it all in a single bulk.

EDIT: i guess this could also be done on the downloader side for a smoother and better interaction when i think about it. Oh well.

@Difegue
Copy link
Owner

Difegue commented Apr 18, 2021

The download system doesn't really have any concept of "supported" URLs, it will try to download anything that's thrown at it. (Potentially going through a downloader plugin if their regex match the URL)

I don't really plan to add a system like Hydrus' url classes as I feel it's a lot of overhead for little gain. (It's useful when you want to dump a whole danbooru page and not have to open every image, but for doujins? meh)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants