Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fixed disk trashing on input cube reads. Fixes #3711 #4793

Merged
merged 1 commit into from
Feb 11, 2022

Conversation

scsides
Copy link
Contributor

@scsides scsides commented Feb 11, 2022

Fixes very slow run times when using band priority.

Description

The band priority mode has to read extra data (i.e., the band used to set the priority). The default cube IO caching algorithm was causing Cube IO cache memory to be flushed too soon. Resulting in multiple reads of the same data, aka thrashing. The change shows automos to run 13 times faster than before with no difference in output values.

Related Issue

#3711

Motivation and Context

Unnecessarily slow execution when using band priority

How Has This Been Tested?

All existing tests pass locally. Hand testing shows the band priority option running 13 times faster. There are no timing test in the test suite.

Screenshots (if appropriate):

Types of changes

  • Bug fix (non-breaking change which fixes an issue)
  • [] New feature (non-breaking change which adds functionality)
  • Documentation change (update to the documentation; no code change)
  • Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

  • I have read and agree to abide by the Code of Conduct
  • I have read the CONTRIBUTING document.
  • My change requires a change to the documentation.
  • I have updated the documentation accordingly.
  • I have added tests to cover my changes.
  • All new and existing tests passed.
  • I have added myself to the .zenodo.json document.
  • I have added any user impacting changes to the CHANGELOG.md document.

Licensing

This project is mostly composed of free and unencumbered software released into the public domain, and we are unlikely to accept contributions that are not also released into the public domain. Somewhere near the top of each file should have these words:

This work is free and unencumbered software released into the public domain. In jurisdictions that recognize copyright laws, the author or authors of this software dedicate any and all copyright interest in the software to the public domain.

  • I dedicate any and all copyright interest in this software to the public domain. I make this dedication for the benefit of the public at large and to the detriment of my heirs and successors. I intend this dedication to be an overt act of relinquishment in perpetuity of all present and future rights to this software under copyright law.

@scsides scsides merged commit 8f4dc8a into DOI-USGS:dev Feb 11, 2022
scsides added a commit that referenced this pull request Feb 11, 2022
* Add a list of browse records to the output rdr if they exist on the cube (#4774)

* Converted TGO IngestReingest Category Test. (#4789)

* Fixed disk trashing on input cube reads (#4793)

* Prepwork for 7.0.0 RC1

* Cleaning up the Markdown a bit

I saw that some sections had wrong section numbers as they were hardcoded instead of making use of Markdown's auto-numbering.
I repaired the indents for auto-numbering to work in the first half of the document and didn't touch the 2nd half where things looked okay.

* Fixed jigsaw observation mode (#4791)

* Test modification

* Added changelog

* Revert "added custom target to copy over camera.plugin files on ninja install solves #3834 (#4769)"

This reverts commit 2681ffe.

* updates for conda build of 7.0 (#4783)

* xalan is required for ISIS, see cmakelists.txt (#4785)

* Mac OS 11.6 local build fixes (#4788)

* xalan is required for ISIS, see cmakelists.txt

* Fix conda build for Mac 11.6

Co-authored-by: acpaquette <acpaquette@usgs.gov>
Co-authored-by: Amy Stamile <74275278+amystamile-usgs@users.noreply.github.com>
Co-authored-by: Michael Aye <michaelaye@users.noreply.github.com>
Co-authored-by: Jesse Mapel <jmapel@usgs.gov>
Co-authored-by: Jesse Mapel <jam826@nau.edu>
scsides added a commit to scsides/ISIS3 that referenced this pull request Feb 11, 2022
@jessemapel jessemapel mentioned this pull request Feb 11, 2022
13 tasks
scsides added a commit that referenced this pull request Feb 11, 2022
scsides added a commit to scsides/ISIS3 that referenced this pull request Feb 11, 2022
scsides added a commit that referenced this pull request Feb 11, 2022
* Add a list of browse records to the output rdr if they exist on the cube (#4774)

* Converted TGO IngestReingest Category Test. (#4789)

* Fixed disk trashing on input cube reads (#4793)

* Prepwork for 7.0.0 RC1

* Cleaning up the Markdown a bit

I saw that some sections had wrong section numbers as they were hardcoded instead of making use of Markdown's auto-numbering.
I repaired the indents for auto-numbering to work in the first half of the document and didn't touch the 2nd half where things looked okay.

* Fixed jigsaw observation mode (#4791)

* Test modification

* Added changelog

* Revert "added custom target to copy over camera.plugin files on ninja install solves #3834 (#4769)"

This reverts commit 2681ffe.

* updates for conda build of 7.0 (#4783)

* xalan is required for ISIS, see cmakelists.txt (#4785)

* Mac OS 11.6 local build fixes (#4788)

* xalan is required for ISIS, see cmakelists.txt

* Fix conda build for Mac 11.6

* Added log entry for #4793 (#4796)

Co-authored-by: acpaquette <acpaquette@usgs.gov>
Co-authored-by: Amy Stamile <74275278+amystamile-usgs@users.noreply.github.com>
Co-authored-by: Michael Aye <michaelaye@users.noreply.github.com>
Co-authored-by: Jesse Mapel <jmapel@usgs.gov>
Co-authored-by: Jesse Mapel <jam826@nau.edu>
@scsides scsides deleted the automosslow branch March 8, 2022 00:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants