Skip to content

Commit

Permalink
docs: remove solved issues
Browse files Browse the repository at this point in the history
  • Loading branch information
terryyz committed Jun 26, 2024
1 parent b3262e9 commit f6fc695
Showing 1 changed file with 1 addition and 3 deletions.
4 changes: 1 addition & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -333,9 +333,7 @@ We share pre-generated code samples from LLMs we have [evaluated](https://huggin
## Known Issues
- [ ] We notice that some tasks heavily use memory for scientific modeling during testing. This will lead to timeout issues for some machines. If you get an error message like `Check failed: ret == 0 (11 vs. 0)Thread creation via pthread_create() failed.` in Tensorflow, it is very likely due to the memory issue. Try to allocate more memory to the process or reduce the number of parallel processes.
- [ ] Due to the flakes in the evaluation, the execution results may vary slightly (~0.2%) between runs. We are working on improving the evaluation stability.
- [ ] Due to the flakes in the evaluation, the execution results may vary slightly (~0.1%) between runs. We are working on improving the evaluation stability.
- [ ] We are aware of the issue of some users needing to use a proxy to access the internet. We are working on a subset of the tasks that do not require internet access to evaluate the code.
Expand Down

0 comments on commit f6fc695

Please sign in to comment.