Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support fused_attention_qkv for auto_parallel llama #8432

Merged
merged 5 commits into from
May 16, 2024

add

5e2edde
Select commit
Loading
Failed to load commit list.
Merged

Support fused_attention_qkv for auto_parallel llama #8432

add
5e2edde
Select commit
Loading
Failed to load commit list.
Codecov / codecov/patch failed May 16, 2024 in 0s

0.00% of diff hit (target 80.00%)

View this Pull Request on Codecov

0.00% of diff hit (target 80.00%)

Annotations

Check warning on line 275 in paddlenlp/transformers/llama/modeling_auto.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/transformers/llama/modeling_auto.py#L275

Added line #L275 was not covered by tests

Check warning on line 277 in paddlenlp/transformers/llama/modeling_auto.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/transformers/llama/modeling_auto.py#L277

Added line #L277 was not covered by tests

Check warning on line 416 in paddlenlp/transformers/llama/modeling_auto.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/transformers/llama/modeling_auto.py#L416

Added line #L416 was not covered by tests

Check warning on line 419 in paddlenlp/transformers/llama/modeling_auto.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/transformers/llama/modeling_auto.py#L419

Added line #L419 was not covered by tests

Check warning on line 425 in paddlenlp/transformers/llama/modeling_auto.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/transformers/llama/modeling_auto.py#L424-L425

Added lines #L424 - L425 were not covered by tests