Feat/mds adapter

[williamhaley]

Jira Ticket: HP-255

This PR is a companion to uc-cdis/cloud-automation#1649

New Features

• Add aggregate metadata adapters to talk to third party metadata services

Breaking Changes

• ES indices will not be namespaced per environment

Bug Fixes

• Scope ES indices to a namespace so they don't conflict with other environments

Deployment changes

• Must set the appropriate AGG_MDS_NAMESPACE value in metadata.env

[johnfrancismccann]

Suggested change

	if adapter_name == "icpsr":
	gather = ISCPSRDublin(mds_url)
	json_data = gather.getRemoteDataAsJson(filters=filters)
	results = gather.normalizeToGen3MDSFields(
	json_data,
	mappings=mappings,
	perItemValues=perItemValues,
	keepOriginalFields=keepOriginalFields,
	)
	return results
	if adapter_name == "clinicaltrials":
	gather = ClinicalTrials(mds_url)
	json_data = gather.getRemoteDataAsJson(filters=filters)
	results = gather.normalizeToGen3MDSFields(
	json_data,
	mappings=mappings,
	perItemValues=perItemValues,
	keepOriginalFields=keepOriginalFields,
	)
	return results
	if adapter_name == "pdaps":
	gather = PDAPS(mds_url)
	json_data = gather.getRemoteDataAsJson(filters=filters)
	results = gather.normalizeToGen3MDSFields(
	json_data,
	mappings=mappings,
	perItemValues=perItemValues,
	keepOriginalFields=keepOriginalFields,
	)
	return results
	else:
	raise Exception(f"unknown adapter for commons: {name}")
	adapters = {"icpsr": ISCPSRDublin, "clinicaltrials": ClinicalTrials, "pdaps": PDAPS}
	if adapter_name in adapters:
	adapter = adapters[adapter_name]
	gather = adapter(mds_url)
	json_data = gather.getRemoteDataAsJson(filters=filters)
	results = gather.normalizeToGen3MDSFields(
	json_data,
	mappings=mappings,
	perItemValues=perItemValues,
	keepOriginalFields=keepOriginalFields,
	)
	return results
	else:
	raise Exception(f"unknown adapter for commons: {name}")

[craigrbarnes]

John like your suggestion, as I refactored this section in my branch, I incorporated it.