Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Minimum post age for scraper #15

Open
b3lrog opened this issue May 4, 2024 · 2 comments
Open

Minimum post age for scraper #15

b3lrog opened this issue May 4, 2024 · 2 comments

Comments

@b3lrog
Copy link

b3lrog commented May 4, 2024

A feature I'd like is a configurable minimum age threshold that posts have to surpass before being archived.
Setting this to something like 6 hours would essentially remove the need to manually moderate an archive since it gives jannies enough time to delete illegal content before it's archived.

@bbepis
Copy link
Owner

bbepis commented May 4, 2024

So there's going to be two parts to this:

  • Ignoring posts that are newer than a set configurable age
  • Adding capability for the board scanner to recheck threads that may contain posts older than set configurable age (Otherwise posts will be ignored until the next time the thread gets bumped)

First part should be really easy, second part would be pretty hard. It's possible to just make the first part but it's possible for posts to slip through the gaps. Depends on how much you care

@b3lrog
Copy link
Author

b3lrog commented May 5, 2024

Yeah, I realised this when I took a look at implementing it myself.
Having it only apply to threads would be easy to implement and wouldn't miss any posts but has the obvious downside of still archiving replies immediately.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants