Code

Bert fix2#6

Code

Open

xinhaoc wants to merge 82 commits intomerged_bertxinhaoc/FlexFlow:merged_bertfrom bert_fix2xinhaoc/FlexFlow:bert_fix2Copy head branch name to clipboard

+3,111-924

Commits

Commits on Apr 17, 2023

• push changes to print dot graph

  

  Teresa Noyola

  committed
  2436152

Commits on Apr 21, 2023

• padded input to 512, added isExact to slice_tensor

  

  Teresa Noyola

  committed
  7030ae0

Commits on May 7, 2023

• Add multiprecision support to replicate

  lockshaw

  committed
  280d29a

• Add explicit template instantiations for replicate kernels

  lockshaw

  committed
  8e84401

Commits on May 8, 2023

• Fix incorrect instantiations

  lockshaw

  committed
  a2ddb91

• Add nop init_task for replicate

  lockshaw

  committed
  52cc8e8

• Fix replicate init_task registration

  lockshaw

  committed
  9eb530a

Commits on May 10, 2023

• Hopefully print hip errors

  lockshaw

  committed
  d7a219c

• Instantiate extra hip replicate kernels

  lockshaw

  committed
  f323a6e

• fix

  jiazhihao

  committed
  9a75f24

• Merge branch 'BertMLM_fixes' of https://github.com/flexflow/FlexFlow into BertMLM_fixes

  jiazhihao

  committed
  fe61cbe

• debug changs

  jiazhihao

  committed
  c9277f3

Commits on May 12, 2023

• Add slice_tensor fix

  

  Teresa Noyola

  committed
  fe66561

• Merge branch 'BertMLM_fixes' of github.com:flexflow/FlexFlow into BertMLM_fixes

  

  Teresa Noyola

  committed
  9e04302

• Add logging for metrics

  lockshaw

  committed
  1177748

• Add the cuda metrics hack to hip kernel as well

  lockshaw

  committed
  5b7cace

• Add parallel dim pretty printing

  lockshaw

  committed
  e798a91

• [Embedding] bug fix

  jiazhihao

  committed
  90541cf

• Merge branch 'BertMLM_fixes' of https://github.com/flexflow/FlexFlow into BertMLM_fixes

  jiazhihao

  committed
  63fcde6

• Add replica dim to pretty print

  lockshaw

  committed
  7862143

• Merge remote-tracking branch 'refs/remotes/origin/BertMLM_fixes' into BertMLM_fixes

  lockshaw

  committed
  9663d96

• Fix replicate issue with python hack

  tnoyola

  committed
  ef43c36

Commits on May 20, 2023

• Use local json submodule

  lockshaw

  committed
  dd8090e

• ofi conduit-related fixes

  

  Teresa Noyola

  committed
  0dc6187

Commits on May 22, 2023

• Add mpi flags for hip

  lockshaw

  committed
  0950ac7

Commits on May 24, 2023

• fix fusion bug

  jiazhihao

  committed
  4b06040

• Merge branch 'BertMLM_fixes' of https://github.com/flexflow/FlexFlow into BertMLM_fixes

  jiazhihao

  committed
  6796b1c

• increase the max number of regions in a ZeroInitMeta from 64 to 128

  jiazhihao

  committed
  99e9f95

• support mixed precision

  jiazhihao

  committed
  282c44a

• undo changes to Fused::Transpose

  jiazhihao

  committed
  992dcb9

• undo changes to config.linux

  jiazhihao

  committed
  f528774

Commits on Jun 2, 2023

• try to fix layernorm

  jiazhihao

  committed
  a68150d

• fix typo

  jiazhihao

  committed
  2bf9afc

Commits on Jun 3, 2023

• Add possible layernorm fix

  lockshaw

  committed
  f6f7a32

• Fix additional layernorm bug due to get_piece_size return size in bytes

  lockshaw

  committed
  5e03b0a

• Bugfixes

  tnoyola

  committed
  53fb8bd

• Actually check elementwise_affine

  lockshaw

  committed
  449a14c

Commits on Jun 5, 2023

• Revert "Actually check elementwise_affine"

  Show description for c737be6
  tnoyola

  committed
  c737be6

Commits on Jun 6, 2023

• Change optimizer to adam with correct hyperparams

  lockshaw

  committed
  a98e09d

• Merge remote-tracking branch 'refs/remotes/origin/BertMLM_fixes' into BertMLM_fixes

  tnoyola

  committed
  66b805e

Commits on Jul 4, 2023

• fix training bert model.

  xinhaoc

  committed
  4bec811

• revert changes

  xinhaoc

  committed
  2d28c15

Commits on Jul 5, 2023

• fix bert training issue. (flexflow#832)

  xinhaoc

  authored
  2025d56

Commits on Jul 25, 2023

• Improve machine_view hash

  lockshaw

  committed
  5f793c1

• Fix bugs in improved hashing

  lockshaw

  committed
  2c09397

• fix weight dimension in layernorm

  xinhaoc

  committed
  862e9d7

• Merge branch 'BertMLM_fixes' of https://github.com/flexflow/FlexFlow into BertMLM_fixes

  xinhaoc

  committed
  d29bf1d

Commits on Aug 8, 2023

• Merge remote-tracking branch 'origin/master' into BertMLM_fixes

  lockshaw

  committed
  88ad5fa

Commits on Aug 11, 2023

• fix preregister_task_variant issue, linting

  goliaro

  committed
  2eee875

Commits on Aug 14, 2023

• try to run graph_optimize on each node

  jiazhihao

  committed
  b9d1332

• remove unnecessary file

  jiazhihao

  committed
  b5b0815

Commits on Aug 15, 2023

• fix hip build

  xinhaoc

  committed
  94e35d9

• Merge branch 'BertMLM_fixes' of https://github.com/flexflow/FlexFlow into BertMLM_fixes

  xinhaoc

  committed
  ac185e3

Commits on Aug 18, 2023

• bypass simulator creation when only_data_parallel is specified

  jiazhihao

  committed
  ded175c

• add nccl prints

  jiazhihao

  committed
  1f7e8b7

Commits on Aug 21, 2023

• .

  jiazhihao

  committed
  3fb70f6

Commits on Aug 29, 2023

• rccl

  xinhaoc

  committed
  d652b62

Commits on Oct 6, 2023

• fix fuse

  xinhaoc

  committed
  b39528b

• fix hip

  xinhaoc

  committed
  0cf3c8e

• more fix to hip

  xinhaoc

  committed
  17a1c4e

Commits on Nov 3, 2023

• customized kernel for broadcasting add.

  xinhaoc

  committed
  f65044d

Commits on Dec 20, 2023

• dropout

  xinhaoc

  committed
  bcab56a

• optimizer

  xinhaoc

  committed
  fa1fffc

Commits on Dec 21, 2023

• opt

  xinhaoc

  committed
  40d830c

• fix

  xinhaoc

  committed
  e825526

Commits on Jan 12, 2024

• fix

  xinhaoc

  committed
  d2bdb15

• .

  xinhaoc

  committed
  3b9e1c6

• fix

  xinhaoc

  committed
  9f8bb9e

• remove print

  xinhaoc

  committed
  fb91122

Commits on Jan 19, 2024

• fix hip

  xinhaoc

  committed
  c162d4c

• fix multinodes

  xinhaoc

  committed
  ea79317

• fix

  xinhaoc

  committed
  58d84ed

Commits on Jan 25, 2024

• fix

  xinhaoc

  committed
  01c9d4c

Commits on Jan 26, 2024

• fix

  xinhaoc

  committed
  a31f8e9

Commits on Feb 2, 2024

• tp

  xinhaoc

  committed
  9141c46

Commits on Feb 15, 2024

• timer

  xinhaoc

  committed
  8185289

Commits on Feb 16, 2024

• rmv

  xinhaoc

  committed
  d958805

Commits on Feb 22, 2024

• fix tp

  xinhaoc

  committed
  38dfd87

Commits on Feb 29, 2024

• try a fix

  xinhaoc

  committed
  355d4b4

Commits on Sep 13, 2024

• fix hip

  xinhaoc

  committed
  8488ba0

Commits on Sep 26, 2024

• Merge remote-tracking branch 'xinhao/merged_bert' into bert_fix2

  xinhaoc

  committed
  1753e7e

• update submodule

  xinhaoc

  committed
  d5496e9