Skip to content

Commit

Permalink
readme updates
Browse files Browse the repository at this point in the history
  • Loading branch information
jschnurr committed Jul 2, 2021
1 parent a92401a commit 5e5d837
Showing 1 changed file with 3 additions and 3 deletions.
6 changes: 3 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -105,13 +105,13 @@ results = processor.run([myjob1, myjob2, ...])
```

#### A word about Spider outputs
As per the [scrapy docs](https://doc.scrapy.org/en/latest/topics/spiders.html), a Spider
As per the [scrapy docs](https://doc.scrapy.org/en/latest/topics/spiders.html), a `Spider`
must return an iterable of `Request` and/or `dict` or `Item` objects.

Requests will be consumed by Scrapy inside the Job. Dicts or Item objects will be queued
Requests will be consumed by Scrapy inside the `Job`. `dict` or `scrapy.Item` objects will be queued
and output together when all spiders are finished.

Due to the way billiard handles communication between processes, each dict or item must be
Due to the way billiard handles communication between processes, each `dict` or `Item` must be
pickle-able using pickle protocol 0. **It's generally best to output `dict` objects from your Spider.**

### Contributing
Expand Down

0 comments on commit 5e5d837

Please sign in to comment.