Skip to content

Commit

Permalink
comment
Browse files Browse the repository at this point in the history
  • Loading branch information
wujingyue committed Dec 9, 2024
1 parent 6a84d85 commit 0d1dfb6
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions tests/python/test_transformer_engine.py
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,9 @@ class ComputeType(Enum):


class Parallelism(Enum):
# https://docs.nvidia.com/nemo-framework/user-guide/latest/nemotoolkit/features/parallelisms.html#tensor-parallelism
TENSOR_PARALLEL = auto()
# https://docs.nvidia.com/nemo-framework/user-guide/latest/nemotoolkit/features/parallelisms.html#sequence-parallelism
SEQUENCE_PARALLEL = auto()


Expand Down

0 comments on commit 0d1dfb6

Please sign in to comment.