Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Paddle Inference]Enhance the shape check of trt_embedding_eltwise_layernorm_fuse_pass,… #54861

Conversation

Wangzheee
Copy link
Contributor

@Wangzheee Wangzheee commented Jun 25, 2023

PR types

Others

PR changes

Others

Description

Pcard-71501

  • Enhance the shape check: trt_embedding_eltwise_layernorm_fuse_pass, don't support broadcast
  • Enhance the shape check: embedding_eltwise_layernorm_fuse_pass, don't support broadcast

image

  • fix test for trt_embedding_eltwise_layernorm_fuse_pass, embedding_eltwise_layernorm_fuse_pass

@paddle-bot
Copy link

paddle-bot bot commented Jun 25, 2023

你的PR提交成功,感谢你对开源项目的贡献!
请关注后续CI自动化测试结果,详情请参考Paddle-CI手册
Your PR has been submitted. Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

},


class TestEmbeddingEltwiseLayerNormFusePassNoBroadcast(PassAutoScanTest):
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

测试elementwise_add需要广播的情况

from program_config import OpConfig, ProgramConfig, TensorConfig

import paddle.inference as paddle_infer


class TestEmbeddingEltwiseLayerNormFusePass(PassAutoScanTest):
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

只测试原生GPU的pass融合


def add_ignore_pass_case(self):
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

去除了之前所有的ignore_check_case(跳过精度检查),对计算结果精度也进行检查

import paddle.inference as paddle_infer


class TestEmbeddingEltwiseLayerNormFusePass(PassAutoScanTest):
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

只测试 trt pass

)


class TestEmbeddingEltwiseLayerNormFusePassNoBroadcast(PassAutoScanTest):
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

测试elementwise_add需要广播的情况

qingqing01
qingqing01 previously approved these changes Jun 26, 2023
@Wangzheee Wangzheee merged commit e49c17d into PaddlePaddle:develop Jun 27, 2023
Wangzheee added a commit to Wangzheee/Paddle that referenced this pull request Jun 28, 2023
…yernorm_fuse_pass,… (PaddlePaddle#54861)

* Enhance the shape check of trt_embedding_eltwise_layernorm_fuse_pass, embedding_eltwise_layernorm_fuse_pass
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants