Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Phase lock #228

Merged
merged 27 commits into from
Jul 2, 2024
Merged

Phase lock #228

merged 27 commits into from
Jul 2, 2024

Conversation

Delaunay
Copy link
Collaborator

No description provided.

@Delaunay Delaunay force-pushed the phase_lock branch 18 times, most recently from 82c12f5 to 5b1ef3b Compare June 20, 2024 14:52
@Delaunay Delaunay force-pushed the phase_lock branch 7 times, most recently from b5e4bcf to f0f59ee Compare June 25, 2024 22:38
@Delaunay
Copy link
Collaborator Author

=================
Benchmark results
=================
bench                          | fail |   n |       perf |   sem% |   std% | peak_memory |      score | weight
brax                           |    0 |   1 |  724034.46 |   0.5% |   4.2% |        6448 |  724034.46 |   1.00
dlrm                           |    0 |   1 |  389259.69 |   0.7% |   5.3% |        7624 |  389259.69 |   1.00
bf16                           |    0 |   8 |     293.38 |   0.3% |   7.2% |        5688 |    2362.93 |   0.00
fp16                           |    0 |   8 |     290.09 |   0.2% |   4.3% |        5688 |    2330.33 |   0.00
fp32                           |    0 |   8 |      19.13 |   0.0% |   0.8% |        6066 |     153.18 |   0.00
tf32                           |    0 |   8 |     146.85 |   0.2% |   4.5% |        6066 |    1179.77 |   0.00
bert-fp16                      |    0 |   8 |     161.63 |   0.9% |  13.5% |         nan |    1322.86 |   0.00
bert-fp32                      |    0 |   8 |      40.11 |   0.5% |   8.2% |       35464 |     325.34 |   0.00
bert-tf32                      |    0 |   8 |     130.62 |   0.9% |  13.5% |        1504 |    1068.94 |   0.00
bert-tf32-fp16                 |    0 |   8 |     161.43 |   0.9% |  14.4% |         nan |    1323.11 |   3.00
reformer                       |    0 |   8 |      62.26 |   0.3% |   5.9% |       29304 |     501.64 |   1.00
t5                             |    0 |   8 |      51.27 |   0.4% |   9.8% |        5462 |     414.95 |   2.00
whisper                        |    0 |   8 |     162.55 |   2.3% |  51.4% |       36724 |    1305.80 |   1.00
llama                          |    0 |   8 |     471.59 |   4.5% |  80.5% |       32326 |    3580.15 |   1.00
opt-1_3b                       |    0 |   1 |      30.24 |   1.3% |   6.7% |       41854 |      30.24 |   5.00
opt-6_7b                       |    0 |   1 |      13.64 |   0.0% |   0.2% |       55202 |      13.64 |   5.00
stargan                        |    0 |   8 |      53.89 |   2.4% |  52.8% |       40710 |     432.30 |   1.00
super-slomo                    |    0 |   8 |      31.33 |   2.6% |  56.3% |       69972 |     250.82 |   1.00
davit_large                    |    0 |   8 |     322.84 |   0.6% |  13.4% |       34118 |    2614.22 |   1.00
davit_large-multi              |    0 |   1 |    2187.11 |   2.1% |  16.7% |         nan |    2187.11 |   5.00
focalnet                       |    0 |   8 |     376.81 |   0.7% |  15.5% |       27464 |    3052.06 |   2.00
resnet152                      |    0 |   8 |     519.42 |   0.9% |  21.6% |       31216 |    4196.06 |   1.00
resnet152-multi                |    0 |   1 |    3490.39 |   3.5% |  27.7% |         nan |    3490.39 |   5.00
convnext_large-fp16            |    0 |   8 |     306.49 |   2.1% |  32.5% |       31292 |    2503.00 |   0.00
convnext_large-fp32            |    0 |   8 |      60.60 |   0.8% |  12.6% |       51200 |     495.10 |   0.00
convnext_large-tf32            |    0 |   8 |     158.14 |   0.9% |  14.6% |       53566 |    1296.65 |   0.00
convnext_large-tf32-fp16       |    0 |   8 |     315.07 |   1.9% |  29.4% |       31292 |    2574.94 |   3.00
regnet_y_128gf                 |    0 |   8 |     115.83 |   0.5% |  10.1% |       35514 |     937.53 |   2.00
resnet152-ddp                  |    0 |   1 |    4305.36 |   4.3% |  32.4% |       31740 |    4305.36 |   0.00
resnet50                       |    0 |   8 |     906.21 |   2.4% |  52.1% |       14686 |    7311.99 |   1.00
resnet50-noio                  |    0 |   8 |    1161.23 |   0.3% |   7.3% |       31350 |    9370.68 |   0.00

Scores
------
Failure rate:       0.00% (PASS)
Score:             802.90
```

@Delaunay Delaunay force-pushed the phase_lock branch 8 times, most recently from d58a9d4 to f97f614 Compare June 28, 2024 20:21
@Delaunay Delaunay merged commit d669feb into master Jul 2, 2024
3 of 4 checks passed
@Delaunay Delaunay deleted the phase_lock branch July 2, 2024 15:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant