Skip to content

Crowdsourcing tips

Scott Sievert edited this page Feb 14, 2018 · 1 revision
  • We've seen lots of MTurk use. Typically demographic information is collected on MTurk, then a NEXT URL is presented. They answer many questions, then paste the presented user ID back into MTurk to get paid (and you can see how many responses that user ID answered, their response times, etc)
  • Sending many participants to NEXT may result in significant slowdowns (>1s delay between responses), and the participants may send emails complaining. To resolve this, try sending participants to NEXT in batches.
    • This has been improved with NEXT 1.2, as noted in the release notes. We rewrote a significant portion of NEXT, and this helps resolve the significant delays users were experiencing.
Clone this wiki locally