Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

NIFI-12898 Allow uploading asset and referencing via Parameter #9138

Closed
wants to merge 8 commits into from
Closed

NIFI-12898 Allow uploading asset and referencing via Parameter #9138

wants to merge 8 commits into from

Commits on Aug 9, 2024

  1. NIFI-12898 Implemented backend of new Asset Management capability

    @markap14 @bbende
    markap14 authored and bbende committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    6301500 View commit details
    Browse the repository at this point in the history

  2. NIFI-12898 Follow on updates from initial implementation 

    - Remove AssetRequestReplicator and use existing UploadRequestReplicator
- Remove AssetManagerFactoryBean and expose AssetManager from Java based Spring config
- Switch multi-part form upload to direct octect-stream upload
- Adding CLI commands creating and referencing assets
- Add REST end-point for listing assets in a given param context
- Fix param context update merger
- Add REST end-point for retrieving content of an asset
- Add CLI commands for listing assets and getting asset content
- Refactor asset id to a generated uuid from param context id + asset name
- Add AssetSynchronizer and wire into StandardFlowService
- Protect against referencing assets from different context
- Implement syncing assets from the cluster coordinator
- Add system tests for replacing an asset and syncing assets
- Update flow diffing/synchronization to account for changes to referenced assets
- Change ParameterDTO from a list of String assetIds to a list of AssetReferenceDTOs
- Authorize node identities to read parameter contexts
- Add field to AssetDTO to indicate if content is missing
- Update synchronization to call createMissingAsset when content is missing
- Improve teardown of system tests to destroy environment if cluster is not in a good state
    @bbende
    bbende committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    faa1fa0 View commit details
    Browse the repository at this point in the history

  3. Improve file/path handling in asset manager

    @bbende
    bbende committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    78a5acf View commit details
    Browse the repository at this point in the history

  4. Improve sanitization of filename

    @bbende
    bbende committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    8a97199 View commit details
    Browse the repository at this point in the history

  5. Add end-point and CLI command for deleting an asset when unreferenced

    @bbende
    bbende committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    349b9be View commit details
    Browse the repository at this point in the history

  6. Address review feedback

    @bbende
    bbende committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    51d68d6 View commit details
    Browse the repository at this point in the history

  7. Remove retry of asset creation in system tests since no longer callin… 

    …g OkHttp client
    @bbende
    bbende committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    1516683 View commit details
    Browse the repository at this point in the history

  8. Add restarting of affected components when replacing an asset

    @bbende
    bbende committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    8e64663 View commit details
    Browse the repository at this point in the history