datasets==2.21.0 is not fit for me

[rhmaaa]

datasets==2.21.0 is not fit for me. I use datasets==2.15.0 is ok for python scripts/dataset_prep/download_longbench.py

[henryzhongsc]

I just made a clean venv with just datasets==2.21.0 piped, and it works with scripts/dataset_prep/download_longbench.py. May you please specify the error message you are getting?

In any case, that script is only there to pull a certain distribution of LongBench, so basically as long as you can pull one, there should be minimum differences in practice. In case you want a carbon copy of what we used, we now also share a LongBench copy on Google Drive along with our processed and raw results. Hope this helps.