Code

Merge develop to main#775

Code

Merged

jsjiang merged 20 commits intomainCDLUC3/ezid:mainfrom developCDLUC3/ezid:developCopy head branch name to clipboardOct 30, 2024

+371-6

Commits

Commits on Aug 29, 2024

• This will go through all the identifiers in opensearch and delete those that don't exist in the database.

  sfisher

  committed
  7783f1a

• Fixing some leftover code and comments that don't appply anymore.

  sfisher

  committed
  ede31f5

Commits on Aug 30, 2024

• Adding retry to the scroll since I got an error one time it was used

  sfisher

  committed
  483f1bc

• indenting message slightly.

  sfisher

  committed
  e4b6dc2

Commits on Sep 5, 2024

• Correcting error where I had the join backwards since the OO in Python is weird

  sfisher

  committed
  77e2f60

Commits on Sep 9, 2024

• Make identifier value parameterized

  sfisher

  committed
  e224051

Commits on Oct 3, 2024

• Updates the SearchIdentifier updateTime (and OpenSearch update_time) from link checker. !) only updates if changed, 2) now OS update takes the time, 3) updated test.

  sfisher

  committed
  9a41960

Commits on Oct 8, 2024

• Removed conditional update, only when values changed. The current code *might* do this, logic is unclear.

  sfisher

  committed
  215b35c

• add proc-cleanup-async-queues_v2.py with data range

  jsjiang

  committed
  7338fb4

• terminate when queryset reaches to the end

  jsjiang

  committed
  9d3860b

Commits on Oct 9, 2024

• Merge branch 'develop' into 752-update-code-to-ensure-sure-updatetime-updated-w-link-checker

  sfisher

  committed
  9699495

Commits on Oct 21, 2024

• Merge pull request #755 from CDLUC3/752-update-code-to-ensure-sure-updatetime-updated-w-link-checker

  Show description for 5f93ef0
  sfisher

  authored
  5f93ef0

• Merge branch 'main' into opensearch-delete-clean

  sfisher

  committed
  481bd37

• Merge pull request #721 from CDLUC3/opensearch-delete-clean

  Show description for 0d07eb3
  sfisher

  authored
  0d07eb3

Commits on Oct 23, 2024

• use select_for_update to avoid concurrent update

  jsjiang

  committed
  475eeb3

Commits on Oct 24, 2024

• mark last processed record and move query to next batch

  jsjiang

  committed
  7e6bb61

Commits on Oct 25, 2024

• Refactor proc-cleanup-async-queues

  Show description for a2d531e
  jsjiang

  committed
  a2d531e

• fix time range

  jsjiang

  committed
  ca8025e

• adjust ASYNC_CLEANUP_SLEEP time

  jsjiang

  committed
  c3a9db1

Commits on Oct 30, 2024

• Merge pull request #765 from CDLUC3/727-cleanup-async-queues

  Show description for e071c5d
  jsjiang

  authored
  e071c5d