Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[LLM INFER] Fix some bugs and chatglm_v2 support block_attn #9271

Merged
merged 6 commits into from
Oct 25, 2024

update

d19ed92
Select commit
Loading
Failed to load commit list.
Merged

[LLM INFER] Fix some bugs and chatglm_v2 support block_attn #9271

update
d19ed92
Select commit
Loading
Failed to load commit list.
Codecov / codecov/patch failed Oct 25, 2024 in 1s

0.00% of diff hit (target 80.00%)

View this Pull Request on Codecov

0.00% of diff hit (target 80.00%)

Annotations

Check warning on line 34 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L34 

Added line #L34 was not covered by tests

Check warning on line 46 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L46 

Added line #L46 was not covered by tests

Check warning on line 181 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L181 

Added line #L181 was not covered by tests

Check warning on line 191 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L189-L191 

Added lines #L189 - L191 were not covered by tests

Check warning on line 193 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L193 

Added line #L193 was not covered by tests

Check warning on line 382 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L377-L382 

Added lines #L377 - L382 were not covered by tests

Check warning on line 386 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L384-L386 

Added lines #L384 - L386 were not covered by tests

Check warning on line 388 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L388 

Added line #L388 was not covered by tests

Check warning on line 393 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L390-L393 

Added lines #L390 - L393 were not covered by tests

Check warning on line 395 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L395 

Added line #L395 was not covered by tests

Check warning on line 398 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L398 

Added line #L398 was not covered by tests

Check warning on line 400 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L400 

Added line #L400 was not covered by tests

Check warning on line 414 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L412-L414 

Added lines #L412 - L414 were not covered by tests

Check warning on line 420 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L417-L420 

Added lines #L417 - L420 were not covered by tests

Check warning on line 422 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L422 

Added line #L422 was not covered by tests

Check warning on line 425 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L424-L425 

Added lines #L424 - L425 were not covered by tests

Check warning on line 435 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L435 

Added line #L435 was not covered by tests

Check warning on line 437 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L437 

Added line #L437 was not covered by tests

Check warning on line 448 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L446-L448 

Added lines #L446 - L448 were not covered by tests

Check warning on line 568 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L564-L568 

Added lines #L564 - L568 were not covered by tests

Check warning on line 572 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L570-L572 

Added lines #L570 - L572 were not covered by tests

Check warning on line 575 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L574-L575 

Added lines #L574 - L575 were not covered by tests

Check warning on line 587 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L585-L587 

Added lines #L585 - L587 were not covered by tests

Check warning on line 589 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L589 

Added line #L589 was not covered by tests

Check warning on line 593 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L591-L593 

Added lines #L591 - L593 were not covered by tests
View more details on Codecov