Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Provide raw canonical composition and decomposition #2099

Merged
merged 11 commits into from
Jul 18, 2022

Conversation

hsivonen
Copy link
Member

Draft due to missing tests. Closes #2073.

hsivonen added 3 commits June 23, 2022 13:11
* Use named constants instead of magic numbers.
* Use wrapping_sub with HANGUL_S_BASE. (Couldn't find a way to trigger a debug-mode overflow without this, though.)
@hsivonen hsivonen added the C-collator Component: Collation, normalization label Jun 23, 2022
@hsivonen hsivonen self-assigned this Jun 23, 2022
@hsivonen hsivonen requested a review from echeran June 23, 2022 14:10
@hsivonen
Copy link
Member Author

ICU4C part

@hsivonen
Copy link
Member Author

I've compared every decomposition with ICU4C.

@hsivonen
Copy link
Member Author

ICU4C main PR

@hsivonen
Copy link
Member Author

hsivonen commented Jul 12, 2022

The CI failures seem to be rust-lang/rustup#3029

@hsivonen hsivonen marked this pull request as ready for review July 12, 2022 13:41
@hsivonen hsivonen requested review from a team, sffc, robertbastian and Manishearth as code owners July 12, 2022 13:41
@hsivonen
Copy link
Member Author

Marked ready for review, because the CI failures don't seem to be caused by the changes here.

sffc
sffc previously approved these changes Jul 16, 2022
Copy link
Member

@sffc sffc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewing since @echeran is OOO

components/normalizer/src/lib.rs Show resolved Hide resolved
components/normalizer/src/lib.rs Show resolved Hide resolved
components/normalizer/src/lib.rs Show resolved Hide resolved
components/normalizer/src/lib.rs Outdated Show resolved Hide resolved
components/normalizer/src/lib.rs Show resolved Hide resolved
@hsivonen
Copy link
Member Author

This can't land until the backport of the ICU4C patch has landed to the maintenance branch.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
C-collator Component: Collation, normalization
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Make normalizer able to provide the normalization operations that HarfBuzz wants
2 participants