Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Consider lifting Send+Sync restrictions and migrating to a single thread tokio runtime #15

Open
let4be opened this issue Jul 24, 2021 · 0 comments
Labels
enhancement New feature or request

Comments

@let4be
Copy link
Owner

let4be commented Jul 24, 2021

We could simplify && speed things up
=> spawn several Crawlers in their own threads, we already handle job delegation via channels
this way we have less internal/external Send/Sync restrictions and we do not bother tokio with work stealing schenanigans which most likely hurt more than help in our use case

after this is implemented, can review let4be/crusty#35
probably could use Actix here and there

@let4be let4be added the enhancement New feature or request label Jul 24, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant