Switch to new source of DefinitelyTyped data?

[karlhorky]

It appears that Microsoft deleted the "create a search index" function in June:

microsoft/DefinitelyTyped-tools#456 (comment)

Maybe a new method is needed for determining this information:

npm-search/src/typescript/index.ts

Lines 24 to 40 in d99c31f

	export async function loadTypesIndex(): Promise<void> {
	const start = Date.now();
	const { body } = await request<TypeList[]>(config.typescriptTypesIndex, {
	decompress: true,
	responseType: 'json',
	});
	log.info(`📦 Typescript preload, found ${body.length} @types`);
	// m = modules associated
	// t = @types/<name>
	body.forEach((type) => {
	typesCache[unmangle(type.t)] = type.t;
	});
	datadog.timing('typescript.loadTypesIndex', Date.now() - start);
	}

One option:

Using the same algorithm that ATA uses, as mentioned by Orta https://twitter.com/orta/status/1600084654895267842

https://github.com/microsoft/TypeScript-Website/blob/f905e795350720b4a906b00155e95f370734f63c/packages/ata/src/index.ts#L63-L92

[Haroenv]

Thanks for opening this issue. Are you interested in contributing the change in source?

[jablko]

Is pkgs a list of all npm packages? If so, could we look there for a @types/package

npm-search/src/typescript/index.ts

Lines 97 to 103 in d99c31f

	/**
	* Check if packages have Typescript definitions.
	*/
	export async function getTSSupport(
	pkgs: Array<Pick<RawPkg, 'name' | 'types' | 'version'>>,
	filelists: File[][]
	): Promise<Array<Pick<RawPkg, 'types'>>> {

instead of in the obsolete

npm-search/src/config.ts

Lines 161 to 162 in d99c31f

	typescriptTypesIndex:
	'https://typespublisher.blob.core.windows.net/typespublisher/data/search-index-min.json',

[jablko]

Alternatively there's all-the-package-names: https://unpkg.com/all-the-package-names@2.0.476/names.json

[Haroenv]

pkgs is the current batch. All-the-package-names could be good enough for this use case. Maybe npm has a separate api to request packages of a certain owner?

[karlhorky]

Thanks so much @MartinKolarik and reviewers @pixelastic and @bodinsamuel for the considerable effort in #1140 🙌

Updated the thread on Twitter:

• https://twitter.com/karlhorky/status/1711424681591398701