Skip to content

Latest commit

 

History

History
303 lines (197 loc) · 6.65 KB

CHANGES.md

File metadata and controls

303 lines (197 loc) · 6.65 KB

Changes

Version 1.8.2-beta (released 2020-06-15)

Changes:

  • [EDMS] Update mappings shards

Version 1.8.1-beta (released 2020-06-14)

Changes:


Version 1.8.0-beta (released 2020-06-10)

Changes:

  • Add indico and lcagenda filters and schemas
  • Improve error handling
  • Celery improvements: logging and worker_proc_alive_timeout
  • Add index to records buckets
  • Config CERN_SEARCH_PROCESS_FILE_META can be a bool or a list of fields
  • New config CERN_SEARCH_COPY_TO_METADATA allows copying stored fields to metadata
  • Add nested filter facet
  • Support gzip access list
  • Support default operator query param

Version 1.7.0-beta (released 2020-04-07)

Changes:

  • Decrease max file content size to 1MB
  • [EDMS] Document mapping weights update

Version 1.6.1-beta (released 2020-01-19)

Changes:

  • ES timeout configurable
  • New query parameter: exclude (ES source filtering)

Version 1.6.0-beta (released 2020-12-10)

Changes:

  • Switch from pipenv to poetry
  • Fix linting
  • Bump python version 3.8

Version 1.5.0-beta (released 2020-12-08)

Changes:

  • [SEARCH-108] Facets: querystring + url filter
  • [SEARCH-114] Limit access to alias instances GET /records
  • Add Indico schemas and aggregations
  • [SEARCH-107] Switch to new cern oauth
  • [SEARCH-115] refactor archives (add discourse and notifications archives)

Version 1.4.0-beta (released 2020-09-08)

Changes:

  • [SEARCH-86] Bump to Invenio 3.3
  • [NI] Generate certificate with a Certificate Authority

Version 1.3.3-beta (released 2020-08-31)

Changes:

  • Revert release 1.3.2 and 1.3.1
  • [SEARCH-102] EDMS schemas updates
  • Limit content of files on ~100MB

Version 1.3.2-beta (released 2020-08-20)

Changes:

  • [NI] Add sentry-sdk dependency

Version 1.3.1-beta (released 2020-08-18)

Changes:

  • [SEARCH-86] Upgrade to invenio 3.3

Version 1.3.0-beta (released 2020-07-06)

Changes:

  • [SEARCH-96] JACoW filters and metadata
    • Support file metadata extraction and indexing
      • authors, keywords, creation date, content type and title
    • Webservices filters and facets:
      • aggs: authors, sites, keywords
      • filters: author, site, keyword
      • matches: author_match, keyword_match, site_match
  • [SEARCH-92] Add codimd schemas
  • [NI] Add openshift-dev CI

Version 1.2.1-beta (released 2020-05-28)

Changes:

  • [SEARCH-79] EDMS: schemas improvements
  • [NI] Add options to reindex cli
    • add option to reindex by id: invenio utils reindex -i <id>
    • option to set chunk size: invenio utils runindex -s 10
    • option to reindex by doc type: invenio utils runindex -d doc_v0.0.2
  • [SEARCH-88] Filters improvements - apply to aggregations
  • [SEARCH-88] Permissions improvements
    • Make public records available without login
    • Only view admin accounts can use the access query param

Version 1.2-beta (released 2020-05-14)

Changes:

  • [SEARCH-85] Fix reindex cli
    • Instead of invenio index reindex -t recid now should use invenio utils reindex -t recid
    • Instead of invenio index run now should use invenio utils runindex
  • [NI] fix indico jonschemas

Version 1.1.2-beta (released 2020-05-14)

Changes:

  • Update full compose
  • [SEARCH-67] Remove binary mappings

Version 1.1.1-beta (released 2020-04-28)

Changes:

  • [SEARCH-72] Fix too_many_clauses error

Version 1.1.0-beta (released 2020-04-28)

Changes:

  • [SEARCH-67] Migrate to ES v7

Version 1.0.9-beta (released 2020-04-16)

Changes:

  • [SEARCH-71] egroupsarchives: make group searchable

Version 1.0.8-beta (released 2020-04-14)

Changes:

  • [SEARCH-70] Add field to egroups archives

Version 1.0.7-beta (released 2020-04-07)

Changes:

  • [SEARCH-69] Multifields type search parameter

Version 1.0.6-beta (released 2020-04-06)

Changes:

  • [egroupsarchives] Update archive_v1.0.0.json

Version 1.0.5-beta (released 2020-04-06)

Changes:

  • [SEARCH-66] Add highlight and explain params to search api

Version 1.0.4-beta (released 2020-04-03)

Changes:

  • [SEARCH-60] Egroups Archives mapping fix
  • [SEARCH-68] Improve score calculations

Version 1.0.3-beta (released 2020-04-02)

Changes:

  • [SEARCH-60] Add egroups archives schemas

Version 1.0.2-beta (released 2020-03-23)

Changes:

  • [SEARCH-47] Bump tika to 1.24

Version 1.0.1-beta (released 2020-03-19)

Changes:

  • [SEARCH-42] Bump invenio-records to 1.2.2 - security vulnerability

Version 1.0.0-beta (released 2020-03-17)

Changes:

  • [SEARCH-1] File indexing via Tika + remove support for OCR extraction via ES pipelines
  • [#94] Fix rate limit configuration
  • [#91] CI: refactor to dev, test and prod usecase
  • [#85] EDMS: file v5
  • [#88] Files: implement file upload
  • [#77] Tests: Run on CI against local changes
  • [#83] Mappings: add edms objects
  • [#48] Permissions: make schema owner configurable and refactor logic
  • [#79] Automate linting
  • [#82] Build: bugfixes and improvements
  • [#53] Create docker-compose environments
  • [#68] Improvements on EDMS documents schema
  • [EDMS] config: add sorting options for cernsearchqa-edms
  • [EDMS] mappings: new versions
  • [TEST] mappings: refactor search-as-you-type analyzer and add did-you-mean
  • [WEBSERVICES] mappings: add suggest field for search-as-you-type
  • [TEST] mappings: add suggest schema

Version 0.7.0 (released 2019-05-31)

Features:

  • Refactor folders hierarchy
  • Created datamodel convention for searchable data (_data)
  • Improve Webservices Mappings
  • Upgrade to ES6
  • Enable OCR extraction in ES
  • Migrate to Python3
  • Migrate to Pipenv
  • Split docker images (Base and App)

Version 0.6.0 (released 2018-01-17)

Features:

  • Refactor access patter to allow cascade.
  • Add health check endpoint to web app.
  • Add licensing.
  • Add schema validation.

Fixes:

  • Change _access mappings field from type nested to object for performance reasons.
  • Setup.py versions.

Version 0.5.3 (released 2018-11-13)

Features:

  • Add an endpoint to perform Update By Query actions over single documents.
  • Add document_v1.0.0 schema for EDMS instance.
  • Add Health blueprint with three possible endpoints (uWSGI, Elasticsearch and database).
  • Make access parameter optional in requests.
  • Make optional the use of CERN e-groups for permissions.

Fixes:

  • Document creation should just check if the user is authenticated in the first iteration. Permissions over the schema are checked on the second iteration.