Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to check whether all ARD products exist? #189

Open
johntruckenbrodt opened this issue Apr 4, 2024 · 0 comments
Open

How to check whether all ARD products exist? #189

johntruckenbrodt opened this issue Apr 4, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@johntruckenbrodt
Copy link
Member

For ARD generation, the processor.py script executes the following main steps:

  • select all scenes based on the user-defined search criteria
  • group the scenes by acquisition time (data take)
  • for each group:
    • select all overlapping MGRS tiles
      • for each tile:
        • start function ard.format

Inside ard.format, the function ard.get_datasets is called, which collects all relevant processed files and performs a check whether the part of the file overlapping with the MGRS tile contains any valid data. If it doesn't, the processed product is ignored and its files not returned by the function (because they are not relevant for creating the current ARD product).
As important as this is, it leads to the situation that the full list of ARD files that should exist can only be known if all processed SAR products exist. it would be good to know whether all ARD products exist from the source scene selection alone. Otherwise some scenes whose processing output had already been deleted are re-processed because the processor thinks some tiles are missing.
I currently see two options:

  • create dummy product folders with some note saying that the product was not created because the source products did not overlap with it
  • maintain some database/text file in ard_dir listing those products that were never created
@johntruckenbrodt johntruckenbrodt added the enhancement New feature or request label May 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant