Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Question]: UIE模型在昇腾910b上的推理速度还能再提升么 #9493

Open
Irisnotiris opened this issue Nov 26, 2024 · 0 comments
Open

[Question]: UIE模型在昇腾910b上的推理速度还能再提升么 #9493

Irisnotiris opened this issue Nov 26, 2024 · 0 comments
Assignees
@gongel
Labels
question Further information is requested

Comments

@Irisnotiris
Copy link

Irisnotiris commented Nov 26, 2024 •
edited
Loading

请提出你的问题

如题。版本信息如下：
paddlepaddle 3.0.0.dev20240520
paddle_custom_npu 3.0.0.dev20240719
paddlenlp 2.8.1
已设置ASCEND_MAX_OP_CACHE_SIZE=5000，FLAGS_npu_jit_compile=0
分别在910B上和3090Ti上测试单条50-60字输入长度的推理秒数如下，可以看出性能差距还是挺大的。
想问下是否还有办法进一步提升在910B上的推理速度呢？
910B：
image
3090Ti：
image
@Irisnotiris Irisnotiris added the question Further information is requested label Nov 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@gongel gongel

Labels
question Further information is requested
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@Irisnotiris @gongel