2021-05-25 End of sprint

• Loosen the Rubocop settings that were most frequently disabled.
• Allow administrators for publishers and societies to view datasets
  associated with their journals.
• On the “Admin Dashboard” page:
  • Allow curators to “assign” themselves or other curators to a dataset.
  • Allow filtering of datasets by the curator that is assigned.
• On the “Activity Log” page, allow curators to forcibly take control of a
  dataset that had been under the submitter’s control.
• Add the submitter’s name to notices that journals receive for review purposes.
• Minor updates to documentation.
• Show warnings before submission for datasets that do not have any data, but only software or supplemental information
• Remove old file upload code in rails controllers/views that is no longer used due to React upload
• Enforce size for software/supplemental uploads and data with different sizes for each and simplify size configuration to be global instead of per-tenant.
• Tabulate our own counter stats rather than retrieve from event data server.
  • Optimize tabulator so it runs in a 10 or 20 minutes instead of half a day.
• Fix for data problem causing Related Works to not process completely.
• Added automation to notify us if Related Works updates do not complete.
• Change terminology from new to uploaded for files that have been uploaded.
• Cleanup for forthcoming deployment rework
  • Be sure all SOLR schema files are in one place and can be downloaded from our code (rather than from geoblacklight schema and our changes combined)
  • Remove Passenger-specific Capistrano deployment automation as we expect to deploy to use Puma server started through Puppet in the future.
• Update EZID prefix for UCOP.

2021-05-11 End of sprint (react uploads)

• Unifying file uploads into one page
  • Many changes on page to make more interactive using React
  • Adding new category of files for Supplemental Information
  • Combining tables into one for pending and uploaded files
  • New UI elements and modal dialog for entering and verifying URLs
  • URLs and direct file uploads combined into single table
  • New layouts, styles and user interface
  • Disallow navigation while current uploads are in progress
• Journal service
  • Removed code for the old (v1) journal service
  • Documentation on start/sop process for V1 server for future
• Adding provenance messages and logging for datasets created or edited in the API
• Changes to test suite for the submission system
• Supplemental Information updates
  • Adding Private for Peer Review downloads for supplemental information
  • Addition of information to publication email
  • Updated related works to show last versions with files in Zenodo, even when later versions with no files exist
• Library updates for app and engines
• Javascript library (Node/NPM/Yarn) on servers to support React
• Fix for replication errors to Zenodo for mismatched size in some rare CSV files
• Additional Rake tasks to support internal operations such as cloning a dataset to another and removing a dataset

2021-05-11 End of Sprint (React file uploads)

• Unifying file uploads into one page
  • Many changes on page to make more interactive using React
  • Adding new category of files for Supplemental Information
  • Combining tables into one for pending and uploaded files
  • New UI elements and modal dialog for entering and verifying URLs
  • URLs and direct file uploads combined into single table
  • New layouts, styles and user interface
  • Disallow navigation while current uploads are in progress
• Journal service
  • Removed code for the old (v1) journal service
  • Documentation on start/sop process for V1 server for future
• Adding provenance messages and logging for datasets created or edited in the API
• Changes to test suite for the submission system
• Supplemental Information updates
  • Adding Private for Peer Review downloads for supplemental information
  • Addition of information to publication email
  • Updated related works to show last versions with files in Zenodo, even when later versions with no files exist
• Library updates for app and engines
• Javascript library (Node/NPM/Yarn) on servers to support React
• Fix for replication errors to Zenodo for mismatched size in some rare CSV files
• Additional Rake tasks to support internal operations such as cloning a dataset to another and removing a dataset

2021-04-27 End of sprint release

• Added parsing for journal metadata emails and connected them to the submission system. This allows the Dryad v2 server to take over all of the journal-related activities that were previously performed by the v1 server.
• Updated configuration for the sshuttle tool that allows it to connect to the development server’s database.
• Updated language in the emails sent to submitters, reflecting recent changes to the submission system.
• Fixing deletion errors where file already doesn't exist at Zenodo.
• Do not attempt uploading empty (zero length) files to Zenodo since they do not accept them.
• Added script for validating download of files in latest published version and produces CSV report.
• Webpack(er) dependency deployment on development server and updated documentation.
• Rework of related works (related identifiers) and how they get set between dataset and Zenodo.
  • Flag all items added automatically so they can be changed as needed without affecting user-added items.
  • Added supplemental information relations.
  • Only link Dryad->Zendo to latest version doi in zenodo since otherwise the list becomes repetitive and unwieldy for users.
• Updated DataONE tenant for new user, but same collection.
• On the Join Us page, added description of how consortia may join Dryad.
• On the Governance page, updated dates to reflect the new terms of board members.
• On the Our Staff page, updated list of staff members.
• On the FAQ page, added link to recommendations regarding endangered species.

2021-04-13 End of Sprint

• Single table inheritance changes
  • All existing tests updated for new models
  • User Interface working again with new models
  • Change inheritance for file controllers to inherit from GenericFileController
  • Controllers/routes reflect new model names and all references to old names changed
  • Zenodo uploads for software now supporting multiple types of independent submissions (supplemental info submissions)
• Additional validation of files being present in S3 before submission to mitigate cases of unknown (Javascript ?) issues in the browser where we are notified of upload completion, but file doesn't exist.
• Updated documentation for producing the Shopping Cart Report
• Added a utility class to facilitate processing emails from Dryad’s partner journals
• Cleanup of some older failed zenodo submissions.

2021-03-30 End of Sprint

• Migrated UC legacy collections out of individual Merritt collection into standard Dryad storage for Merritt
• Updated documentation on contribution flow.
• Fixed bundler deprecations in github action tests.
• CSS changes for public information pages.
• Updated the submission system, allowing users to switch a dataset’s association
  from a “known” journal to an “unknown” journal.
• Changed the “Our Community” page to “Our Membership”.
• Added a new page “Join Us”, which is represented in the menus as a page in the
  “Our Membership” section.
• Updated settings for GitHub Actions to run tests in a specific version of
  Ubuntu.
• Updated version of mimemagic library due to their licensing issues

In other branches (not yet released)

• Transforming separate file tables into single table inheritance and refactoring and updating code.
• Validating URLs using React as part of file workflow redesign.

2021-03-16 End of sprint

• Retry errors at Zenodo
  • Retry individual requests
  • Retry compound request streaming s3 to zenodo
• Fixed detection of previous errors at Zenodo for in-order versioning
• Remove Daniella from Zenodo error emails
• Documented how current file uploads work ( https://github.com/CDL-Dryad/dryad-app/pull/382/files#diff-5b8175a9019998f84da3248d469423780c50bcdc86cca284bf79dd78cc8402d8 )
• Better zenodo error info in database (keeps history and timestamp)
• Do not publish to zenodo if all files have been added and then removed before publication
• File checking for zero-length or dynamic files by URL and do not allow
• Fix for deadlock error (we hope)
• Re-sent some stubborn errors and edge cases to Zenodo (Merritt corrected some file encoding issues).
• Desert Research Institute added as partner
• Added support statistics associated with curation activity.
• Improved handling for MIME types on files that are uploaded into the
  submission system.
• (in react-uploads-main) Added a Rails environment for improved testing that
  connects to a database in the AWS system.

2021-03-02 End of sprint

• Added rake task that can migrate temporary files from a local uploads directory to Amazon S3.
• Allow API superusers to completely disable emails associated with datasets, when using a test server.
• In the shoppingcart report, simplified the headings to ease post-processing.
• On dataset landing pages, only display asterisks that indicate unverified values when the viewer is a superuser.
• In s3-main branch
  • Automatically delete temporary files from S3 when deleting in-progress datasets
  • Allow file uploads via API to go into S3
• Rework of all upload/replication to Zenodo to use S3 storage (software) or stream through from Merritt. see datadryad/dryad-product-roadmap#1077

2021-02-16 End of Sprint Release

• Updated text on the FAQ page
• Updated biography and photo for Elizabeth Wolkovich on the Advisors page
• Expanded some pages in thetechnical documentation
• Moved remaining utility scripts from the dryad-config repository into this
  respository
• Improved error prevention in the publication updater
• Increased the default page size for results returned from the API
• Updated the API to show the same list of versions as the UI, so API users are
  guaranteed to be able to access the files that are listed as the results of
  other API calls
• Added code to send error emails if replication to zenodo fails.
• Reconfigured IIT login method for Shibboleth login.
• in s3-main branch
  • Updated Merritt/SWORD submission process to only use “manifest” submissions, not direct uploads. Modified the manifests to reference all files from an AWS S3 bucket.
  • Direct uploads to S3 by presigned URL creating unique S3 key "directories" for different servers. Complete rework of UI upload flow and Javascript to use EvaporateJS, although it appears mostly the same from the user's point of view. (Lots of changes, see #1076).

2021-02-02 End of sprint release WITH Merritt Collection changes

This is the same as v0.5.41 but with config changes to move UC collections to Dryad collection in Merritt.

Currently this is no longer being used. If the migration happens again before our next deploy we can reuse it. If not, we will need to tag again when we are ready to test the deployment of these changes again.