-
Notifications
You must be signed in to change notification settings - Fork 523
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Feat: add se_atten_v2
to PyTorch and DP
#3840
Conversation
WalkthroughWalkthroughThe updates introduce a new descriptor class Changes
Sequence Diagram(s) (Beta)sequenceDiagram
participant User
participant DescrptSeAttenV2
participant Serializer
User->>DescrptSeAttenV2: Initialize with extended parameters
DescrptSeAttenV2->>Serializer: Call serialize method
Serializer-->>DescrptSeAttenV2: Serialized data
DescrptSeAttenV2-->>User: Return serialized data
Recent review detailsConfiguration used: CodeRabbit UI Files selected for processing (1)
Files skipped from review as they are similar to previous changes (1)
Thank you for using CodeRabbit. We offer it for free to the OSS community and would appreciate your support in helping us grow. If you find it useful, would you consider giving us a shout-out on your favorite social media? TipsChatThere are 3 ways to chat with CodeRabbit:
Note: Be mindful of the bot's finite context window. It's strongly recommended to break down tasks such as reading entire modules into smaller chunks. For a focused discussion, use review comments to chat about specific files and their changes, instead of using the PR comments. CodeRabbit Commands (invoked as PR comments)
Additionally, you can add CodeRabbit Configration File (
|
for more information, see https://pre-commit.ci
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Actionable comments posted: 1
Codecov ReportAttention: Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## devel #3840 +/- ##
==========================================
- Coverage 82.67% 82.66% -0.01%
==========================================
Files 515 517 +2
Lines 49549 49662 +113
Branches 2989 2985 -4
==========================================
+ Hits 40965 41055 +90
- Misses 7673 7696 +23
Partials 911 911 ☔ View full report in Codecov by Sentry. |
for more information, see https://pre-commit.ci
for more information, see https://pre-commit.ci
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Actionable comments posted: 1
for more information, see https://pre-commit.ci
se_atten_v2
to PyTorch and DP and redirect dpa1
to se_atten_v2
se_atten_v2
to PyTorch and DP
@iProzd thinks there is no need to redirect |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Actionable comments posted: 1
Do you want to update the documentation in #3828 or in this PR?? |
Co-authored-by: Duo <[email protected]> Signed-off-by: Chenqqian Zhang <[email protected]>
Co-authored-by: Duo <[email protected]> Signed-off-by: Chenqqian Zhang <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Actionable comments posted: 2
Solve deepmodeling#3831 and deepmodeling#3139 - add `se_atten_v2` to PyTorch and DP - add document equation for `se_attn_v2` <!-- This is an auto-generated comment: release notes by coderabbit.ai --> ## Summary by CodeRabbit - **New Features** - Introduced a new descriptor class with enhanced configuration options and methods for serialization and deserialization. - Added new configurable parameters to the descriptor setup for improved flexibility. - **Documentation** - Updated function documentation to reflect new arguments and usage instructions. - **Bug Fixes** - Refined serialization logic to handle new parameters and class types more accurately. - Improved error messages for better clarity during serialization processes. <!-- end of auto-generated comment: release notes by coderabbit.ai --> --------- Signed-off-by: Chenqqian Zhang <[email protected]> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Duo <[email protected]>
Solve #3831 and #3139
se_atten_v2
to PyTorch and DPse_attn_v2
Summary by CodeRabbit
New Features
Documentation
Bug Fixes