PXP-8825 & BRH 206

[tianj7]

New Features

• Array fields can be "compressed" to return the length and not the full field using the counts parameter
• The elastic search index can be configured using the schema section of the config file
• Introspection of the schema to a JSON schema using the info/schema call
• Multiple adapters can write to the same common namespace; this allows for adapters to have more fine grain control to cherry-pick studies and store them in the same namespace
• Support for pagination info using the pagination=true
• Can optionally flatten the response using flatten=true
• A true Gen3 adapter replaces the older Gen3 specific loader (MDSInstance). This means the gen3_commons section of the config file should not be used.
• Optionally cache DRS prefix to hostname mapping from dataguids.org. Allowing the aggregate_metadata service to act as a DRS resolver.

Breaking Changes

The configuration file is not compatible with the previous release. This is due to the new support for defining a schema, new configuration options, and changes to the adapters.

Bug Fixes

Improvements

• The ETL process (i.e. populate) now will load to a temporary index and clone to the live index only if no errors are encountered
• Updated documentation and sample config file
• all config file have been removed
• extend httpx and rety timeout for Gen3Adapter

Dependency updates

Deployment changes

configuration files will need to be updated