Code

NCCL interfaces#261

Code

Closed

chhwang wants to merge 100 commits intomainmicrosoft/mscclpp:mainfrom chhwang/nccl-interfacesmicrosoft/mscclpp:chhwang/nccl-interfacesCopy head branch name to clipboard

+1,875-51

Commits

Commits on Jan 15, 2024

• Add allgather5

  chhwang

  committed
  d208486

Commits on Jan 17, 2024

• optimized allgather5

  chhwang

  committed
  6c425e3

Commits on Jan 19, 2024

• Merge branch 'main' into chhwang/alg

  chhwang

  authored
  f69248e

• fix

  chhwang

  committed
  cc9c150

Commits on Jan 21, 2024

• updates

  

  amduser

  committed
  c10d01b

Commits on Jan 24, 2024

• Doing some experiments

  chhwang

  committed
  80bade5

Commits on Jan 25, 2024

• measure perf

  Binyang2014

  committed
  3d178f3

Commits on Jan 30, 2024

• new algo

  Binyang2014

  committed
  43bdd35

Commits on Feb 1, 2024

• Add abortFlag

  chhwang

  committed
  28c5d21

• 16.14us for 512KB allreduce

  chhwang

  committed
  e06fbeb

Commits on Feb 2, 2024

• 16.72us for 512KB allreduce7 & pass pingpong test

  chhwang

  committed
  1bef17e

• clean up

  Binyang2014

  committed
  24420b0

• update

  Binyang2014

  committed
  83c7e06

• cleanup

  chhwang

  committed
  ea4e1f5

• update docs

  chhwang

  committed
  f79b939

• fix a typo

  chhwang

  committed
  214fa22

• update names

  chhwang

  committed
  f6e515a

Commits on Feb 4, 2024

• clean up tests

  Binyang2014

  committed
  31d427f

Commits on Feb 5, 2024

• minor update

  Binyang2014

  committed
  80413a0

• cleanup

  chhwang

  committed
  eef3c27

• fix wrong offset calculation

  chhwang

  committed
  98334b8

• Do not compile nvls_test with ROCm

  chhwang

  committed
  71f6c85

• MSRCHA-371 workaround

  chhwang

  committed
  5eb35cd

• Merge branch 'chhwang/fix-rocm-proxy' into chhwang/alg3

  chhwang

  authored
  d064259

Commits on Feb 6, 2024

• fix multi-node connection

  chhwang

  committed
  58eb956

• wip

  chhwang

  committed
  b841e91

Commits on Feb 7, 2024

• Merge branch 'main' into chhwang/nccl-interfaces

  chhwang

  authored
  db59917

• Merge branch 'main' into chhwang/nccl-interfaces

  chhwang

  authored
  b77be22

• Restructuring

  chhwang

  committed
  b6bec53

• cmake

  chhwang

  committed
  e1988e2

• wip

  Binyang2014

  committed
  ae3fb4d

• wip

  Binyang2014

  committed
  e15d22a

• wip

  Binyang2014

  committed
  ad92678

• update

  Binyang2014

  committed
  1b4a8fb

• borrow simple test code

  chhwang

  committed
  8a4c0be

• Lint

  chhwang

  committed
  1e00f59

• all-reduce wip

  chhwang

  committed
  0e4e80c

Commits on Feb 8, 2024

• fix a mistake

  chhwang

  committed
  bbf2b2f

• nccl-tests works

  chhwang

  committed
  60bf6a9

• out of place pass

  Binyang2014

  committed
  f264eab

• support more data types

  Binyang2014

  committed
  ea60195

• cllean up

  Binyang2014

  committed
  2093e27

• wip

  Binyang2014

  committed
  a5ab22f

• leave some commeents

  Binyang2014

  committed
  cd2c85d

Commits on Feb 19, 2024

• WIP

  Binyang2014

  committed
  f420ee3

• WIP

  Binyang2014

  committed
  adbabf9

Commits on Feb 20, 2024

• Merge branch 'main' into chhwang/alg3

  chhwang

  authored
  aba92bf

• WIP

  Binyang2014

  committed
  7b8e4f1

• WIP

  Binyang2014

  committed
  1c08a80

• workable version

  Binyang2014

  committed
  1e6a7a5

• Revert "MSRCHA-371 workaround"

  Show description for 9790dfc
  chhwang

  committed
  9790dfc

• Update names & interfaces

  chhwang

  committed
  53b0953

• Merge branch 'main' into chhwang/nccl-interfaces

  chhwang

  authored
  7fc6479

• Merge branch 'chhwang/alg3' into chhwang/nccl-interfaces

  chhwang

  authored
  c48c34e

• Lint

  chhwang

  committed
  90f93a7

• Merge branch 'chhwang/alg3' into chhwang/nccl-interfaces

  chhwang

  authored
  fa7abb6

• spelling

  chhwang

  committed
  c1da8dd

Commits on Feb 21, 2024

• Updates for ROCm

  chhwang

  committed
  c7ebf3a

• fixes

  chhwang

  committed
  182a8e3

• Merge branch 'chhwang/alg3' into chhwang/nccl-interfaces

  chhwang

  authored
  7d52b5f

• Merge branch 'main' into chhwang/nccl-interfaces

  chhwang

  authored
  ab75ea2

• Add more function definitions

  chhwang

  committed
  34a1c6b

• make it work for rocm6.0

  Binyang2014

  committed
  b8fa212

• allreduce7 works

  Binyang2014

  committed
  4b3e27c

• disable IB for now

  chhwang

  committed
  5bf684b

Commits on Feb 22, 2024

• allgather works

  chhwang

  committed
  d92e248

• add some impls

  chhwang

  committed
  141e7da

• out-of-place allgather

  chhwang

  committed
  c50f7b5

• hipGraph work

  Binyang2014

  committed
  cf91552

• hipGraph works

  Binyang2014

  committed
  1becb79

Commits on Feb 24, 2024

• fixed out-of-place allgather

  chhwang

  committed
  2e0013f

• fixed allreduce hanging

  chhwang

  committed
  f01c702

• perf improve

  Binyang2014

  committed
  9537c97

• update

  Binyang2014

  committed
  c39cbef

• allreduce8 wip

  chhwang

  committed
  f0e3063

• fix reduce-scatter

  chhwang

  committed
  674ef34

• wip

  Binyang2014

  committed
  d8452c2

• allreduce8 looks good

  chhwang

  committed
  5c07184

• some tuning

  chhwang

  committed
  efa4da2

• safety guard

  chhwang

  committed
  4f13178

Commits on Feb 26, 2024

• fix

  Binyang2014

  committed
  0e4367b

• fix perf issue

  Binyang2014

  committed
  86334d7

• update

  Binyang2014

  committed
  12ae9db

Commits on Feb 28, 2024

• clean code

  Binyang2014

  committed
  057886e

• lint

  Binyang2014

  committed
  f58b6f8

• allreduce for all message sizes

  Binyang2014

  committed
  d72f09f

Commits on Mar 8, 2024

• Fixed issues found on AMD (#271)

  pash-msft

  authored
  96e31bf

Commits on Mar 12, 2024

• improve perf

  Binyang2014

  committed
  8d02754

• perf improve

  Binyang2014

  committed
  f81d53d

Commits on Mar 19, 2024

• Fix build dependencies

  chhwang

  committed
  a075f71

• Further fix build dependencies

  chhwang

  committed
  7aa2ddd

• Temporal flags

  chhwang

  committed
  2dfb5cf

• Include mscclpp object in mscclpp_nccl

  chhwang

  committed
  c685788

• Update readme

  chhwang

  committed
  84eb0ef

Commits on Mar 20, 2024

• minor updates

  chhwang

  committed
  f3d4a3c

Commits on Mar 22, 2024

• A bug fix

  chhwang

  committed
  ba6a4e9

• minor fixes

  chhwang

  committed
  bfb665c

• WIP algather sync issue

  chhwang

  committed
  36248ef

Commits on Mar 25, 2024

• Merge branch 'main' into chhwang/nccl-interfaces

  chhwang

  authored
  32ff61d

Commits on Mar 26, 2024

• Fixed allgather

  chhwang

  committed
  fa3d0d2