Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Problem: some client scripts keep db transactions open for too long #313

Open
sevein opened this issue Nov 2, 2018 · 1 comment
Open
Labels
Status: refining The issue needs additional details to ensure that requirements are clear. Type: bug A flaw in the code that causes the software to produce an incorrect or unexpected result.

Comments

@sevein
Copy link
Contributor

sevein commented Nov 2, 2018

Expected behaviour
No component in our system should maintain database transactions open for too long because it degrades the overall performance of the database.

Current behaviour
E.g. sanitize_object_names.py took 12 minutes in a transfer with 20k files maintaining a transaction open while it was running. This is new behaviour introduced in AM18's new task scheduling redesign.

Steps to reproduce

  1. Start a new transfer with a big number of files (e.g. 5k files)
  2. While Sanitize object's file and directory names runs, monitor the innodb engine and observe the number of active transactions.

Your environment (version of Archivematica, OS version, etc)
AM18-dev

Related: #313


For Artefactual use:
Please make sure these steps are taken before moving this issue from Review to Verified in Waffle:

  • All PRs related to this issue are properly linked 👍
  • All PRs related to this issue have been merged 👍
  • Test plan for this issue has been implemented and passed 👍
  • Documentation regarding this issue has been written and it has been added to the release notes, if needed 👍
@sevein sevein added Severity: high A high-priority situation where performance or other uses are significantly impacted or degraded. Type: bug A flaw in the code that causes the software to produce an incorrect or unexpected result. labels Nov 2, 2018
@sevein
Copy link
Contributor Author

sevein commented Nov 2, 2018

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Status: refining The issue needs additional details to ensure that requirements are clear. Type: bug A flaw in the code that causes the software to produce an incorrect or unexpected result.
Projects
None yet
Development

No branches or pull requests

2 participants