Fix the failed ShipIt task

Summary:
ShipIt does not allow multiple internal files mapping to the same GitHub file, we are violating this rule because:

1. In the ShipIt config, we are mapping `pytorch/benchmark` to github https://github.com/pytorch/benchmark: https://www.internalfb.com/code/configerator/source/opensource/shipit_config/pytorch/benchmark.cconf
Therefore, it is mapping `huggingface.yaml` to userbenchmark/dynamo/dynamobench/huggingface.yaml

2. The ShipIt config also explicitly maps "fbcode/caffe2/benchmarks/dynamo/huggingface.yaml" to "userbenchmark/dynamo/dynamobench/huggingface.yaml"

We should use "fbcode/caffe2/benchmarks/dynamo/huggingface.yaml" as the single ground of truth. Therefore, we are removing the pytorch/benchmark/userbenchmark/dynamo/dynamobench/huggingface.yaml

Reviewed By: kit1980

Differential Revision: D65695792

fbshipit-source-id: b0ddc342aba3166175de962b3d05eb3c77d8b090

requirements.txt

@@ -20,3 +20,5 @@ numpy
 opencv-python
 submitit
 pynvml
+pandas
+scipy