How to mark spider as done/finished?

[francoism90]

I would like to scrape a website, but I don't know the page limits. This means the scraper will do something like this:

$this->request("https://example.com/page/{$i}", ..);

I know it is possible to get the response of this request, however how to actually stop the spider from actual further processing on 404? It seems a method like $this->finished() or $this->done() doesn't exists.

Thanks