Add full support for traditional and simplified Chinese labels

[peitili]

Tilezen remaps localized names into 2-char languages codes from OpenStreetMap, Natural Earth, and OpenStreetMap – which each has their own way of representing name localizations.

In the case of Chinese (and possibly other languages), this "spoken" language has multiple "written" character sets (Traditional and Simplified) and is spoken and written in multiple countries using different configs.

But in Tilezen we only export a generic and ambiguous name:zh value. In UX design generally it's best practice to target each language as a combination of language + country code to allow for local colloquialisms. But for mapping sometimes less is better / mostly we're dealing in proper nouns - so another alternative is to say zh-hans (Chinese simplified irresepctive of country) and zh-hant (Chinese traditiional irrespective of country). Let's pick one and stick with it, and make it work with the point-of-view / worldview being introduced in v5.

For example:

Locale	Description
zh-CN	Chinese (Simplified, PRC)
zh-SG	Chinese (Simplified, Singapore)
zh-TW	Chinese (Traditional, Taiwan)
zh-HK	Chinese (Traditional, Hong Kong S.A.R.)

vector-datasource/vectordatasource/transform.py

Lines 523 to 558 in 024909e

	def _convert_wof_l10n_name(x):
	lang_str_iso_639_3 = x[:3]
	if len(lang_str_iso_639_3) != 3:
	return None
	try:
	lang = pycountry.languages.get(alpha_3=lang_str_iso_639_3)
	except KeyError:
	return None
	return LangResult(code=_alpha_2_code_of(lang), priority=0)
	def _convert_ne_l10n_name(x):
	if len(x) != 2:
	return None
	try:
	lang = pycountry.languages.get(alpha_2=x)
	except KeyError:
	return None
	return LangResult(code=_alpha_2_code_of(lang), priority=0)
	def _normalize_osm_lang_code(x):
	# first try an alpha-2 code
	try:
	lang = pycountry.languages.get(alpha_2=x)
	except KeyError:
	# next, try an alpha-3 code
	try:
	lang = pycountry.languages.get(alpha_3=x)
	except KeyError:
	# finally, try a "bibliographic" code
	try:
	lang = pycountry.languages.get(bibliographic=x)
	except KeyError:
	return None
	return _alpha_2_code_of(lang)

[nvkelso]

New preview files:

• https://github.com/nvkelso/natural-earth-vector/files/6845759/v5.0.0-pre8-boundaries-pov-chinese.zip

This would need to be updated here:

• https://github.com/tilezen/vector-datasource/blob/master/data/assets.yaml#L121

[nvkelso]

I think we take country names from OSM, so not clear why these are in the import statement:

• https://github.com/tilezen/vector-datasource/blob/master/data/assets.yaml#L189-L199