Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Refactoring and optimisation of RestoreTableCommand #912

Closed
wants to merge 4 commits into from
Closed

Refactoring and optimisation of RestoreTableCommand #912

wants to merge 4 commits into from

Commits on Jan 26, 2022

  1. Refactoring and optimization of RestoreTableCommand 

     * RestoreTableCommand moved to org.apache.spark.sql.delta.commands package
 * cache() of filesToRemove DataFame removed (according to delta-io#863 (comment))
 * cache() of filesToAdd will be applied only if spark.sql.files.ignoreMissingFiles = false (default value)

Signed-off-by: Maksym Dovhal <maksym.dovhal@gmail.com>
    Maksym Dovhal committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    9dc27ed View commit details
    Browse the repository at this point in the history

Commits on Jan 28, 2022

  1. Refactoring to resolve review comments

    Maksym Dovhal committed Jan 28, 2022
    Configuration menu
    Copy the full SHA
    1dcebdd View commit details
    Browse the repository at this point in the history

Commits on Jan 30, 2022

  1. Removed cache for filesToAdd. Added better job description for spark UI

    Maksym Dovhal committed Jan 30, 2022
    Configuration menu
    Copy the full SHA
    7f2128e View commit details
    Browse the repository at this point in the history

Commits on Jan 31, 2022

  1. Fixed review comments

    Maksym Dovhal committed Jan 31, 2022
    Configuration menu
    Copy the full SHA
    3f402b9 View commit details
    Browse the repository at this point in the history