Code

Move datasets between 4CAT servers#375

Code

Merged

stijn-uva merged 40 commits intomasterdigitalmethodsinitiative/4cat:masterfrom export-datasetsdigitalmethodsinitiative/4cat:export-datasetsCopy head branch name to clipboardOct 25, 2023

+738-84

Commits

Commits on Jul 10, 2023

• Export/import datasets between 4CAT servers

  stijn-uva

  committed
  9d7cb51

• Merge branch 'master' into export-datasets

  stijn-uva

  committed
  0e2795d

Commits on Aug 3, 2023

• Merge branch 'master' into export-datasets

  dale-wahl

  committed
  cefe041

• move datasource and add init, add new setting to allow export, pass 4CAT version for comparison, run some tests,

  Show description for a6a4ae4
  dale-wahl

  committed
  a6a4ae4

• use version function for comparison

  Show description for f735496
  dale-wahl

  committed
  f735496

Commits on Aug 16, 2023

• close, but children fail; possibly just zip files

  dale-wahl

  committed
  db461ed

• use send_from_directory (tested on 1.5 gig files successfully); cleaned up some errors/logging and added notes

  dale-wahl

  committed
  33f2faf

Commits on Aug 25, 2023

• Merge branch 'master' into export-datasets

  Show description for a16f4fe
  stijn-uva

  committed
  a16f4fe

Commits on Oct 18, 2023

• Merge branch 'master' into export-datasets

  Show description for a1eb4be
  stijn-uva

  committed
  a1eb4be

Commits on Oct 19, 2023

• Merge branch 'master' into export-datasets

  Show description for 6aba774
  stijn-uva

  committed
  6aba774

• Use custom exception instead of TypeError when dataset not found

  stijn-uva

  committed
  16b5d1d

• Use 401 HTTP status for login form

  stijn-uva

  committed
  4521b0f

• Ignore hidden files in cleanup worker

  stijn-uva

  committed
  1bdf67c

• Ensure unique dataset key and allow changing keys

  stijn-uva

  committed
  c09b031

• Allow workers to set dataset key manually

  stijn-uva

  committed
  557576d

• MANY CHANGES

  stijn-uva

  committed
  617da89

• Don't print log to stdout twice when not running as daemon

  stijn-uva

  committed
  e916220

• Remove stray debug print

  stijn-uva

  committed
  66241c4

• Show original timestamp for imported datasets

  stijn-uva

  committed
  380e285

• Dataset form logic

  stijn-uva

  committed
  fb4900c

• Don't show empty dataset status

  stijn-uva

  committed
  fde5a68

• Forbid importing unfinished datasets

  stijn-uva

  committed
  a0645fe

• Not using this file

  stijn-uva

  committed
  61e4990

• Fix copied comment

  stijn-uva

  committed
  918e52d

• Merge branch 'master' into export-datasets

  stijn-uva

  committed
  2e50761

Commits on Oct 23, 2023

• Fix interrupt routine and clean up half-imported data

  stijn-uva

  committed
  0dd87b1

• Catch dataset not found error in expiration worker

  stijn-uva

  committed
  58a0481

Commits on Oct 24, 2023

• Hide anon/label options when importing

  stijn-uva

  committed
  3279710

• Fix delete button on dataset creation page

  stijn-uva

  committed
  45414c8

• Fix interrupting imports

  stijn-uva

  committed
  94604cd

• Remove "filtered from" on imported datasets

  stijn-uva

  committed
  00528f8

• Add DESCRIPTION.md for import data source

  stijn-uva

  committed
  c3d7348

• Better markdown

  stijn-uva

  committed
  301dfed

Commits on Oct 25, 2023

• return error() not raise

  dale-wahl

  committed
  0b61d99

• use replace on result_file to use new_dataset.key (with_stem is python3.9 and newer)

  dale-wahl

  committed
  c6d2805

• Clarify some comments

  stijn-uva

  committed
  55a004b

• get_software_version() -> get_software_commit()

  stijn-uva

  committed
  ad38daa

• Use version instead of commit to determine migration compatibility

  stijn-uva

  committed
  81d7354

• More commentary

  stijn-uva

  committed
  a36cbf6

• Use reserve_results_file() to ensure correct import data path

  stijn-uva

  committed
  5687c3f