Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Make EnforceSorting global sort aware, fix sort mis-optimizations involving unions, support parallel sort + merge transformations #5171

Merged
merged 35 commits into from
Feb 8, 2023
Merged

Make EnforceSorting global sort aware, fix sort mis-optimizations involving unions, support parallel sort + merge transformations #5171

merged 35 commits into from
Feb 8, 2023

Commits on Jan 26, 2023

  1. Make EnforceSorting global sort aware, fix union bug, parallelize CP+… 

    …Sort cascades
    @ozankabak
    ozankabak committed Jan 26, 2023
    Configuration menu
    Copy the full SHA
    0444abc View commit details
    Browse the repository at this point in the history

  2. Remove unnecessary cloning

    @ozankabak
    ozankabak committed Jan 26, 2023
    Configuration menu
    Copy the full SHA
    fd7a714 View commit details
    Browse the repository at this point in the history

Commits on Jan 30, 2023

  1. Convert sort_onward to tree to support multipath

    @mustafasrepo
    mustafasrepo committed Jan 30, 2023
    Configuration menu
    Copy the full SHA
    015f931 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'apache:master' into feature/union_exec_handling

    @mustafasrepo
    mustafasrepo authored Jan 30, 2023
    Configuration menu
    Copy the full SHA
    640dc7b View commit details
    Browse the repository at this point in the history

Commits on Jan 31, 2023

  1. Add limit bug handling

    @mustafasrepo
    mustafasrepo committed Jan 31, 2023
    Configuration menu
    Copy the full SHA
    b356962 View commit details
    Browse the repository at this point in the history

  2. minor changes

    @mustafasrepo
    mustafasrepo committed Jan 31, 2023
    Configuration menu
    Copy the full SHA
    4d8a4b2 View commit details
    Browse the repository at this point in the history

  3. Coalesce Partitions converted to tree

    @mustafasrepo
    mustafasrepo committed Jan 31, 2023
    Configuration menu
    Copy the full SHA
    3884fd5 View commit details
    Browse the repository at this point in the history

  4. Simplifications

    @mustafasrepo
    mustafasrepo committed Jan 31, 2023
    Configuration menu
    Copy the full SHA
    32ff1b0 View commit details
    Browse the repository at this point in the history

  5. Add new test

    @mustafasrepo
    mustafasrepo committed Jan 31, 2023
    Configuration menu
    Copy the full SHA
    2d9819a View commit details
    Browse the repository at this point in the history

  6. Simplifications

    @mustafasrepo
    mustafasrepo committed Jan 31, 2023
    Configuration menu
    Copy the full SHA
    dff1f7f View commit details
    Browse the repository at this point in the history

Commits on Feb 1, 2023

  1. Simplifications and refactors

    @ozankabak
    ozankabak committed Feb 1, 2023
    Configuration menu
    Copy the full SHA
    17e07eb View commit details
    Browse the repository at this point in the history

  2. Update todos

    @mustafasrepo
    mustafasrepo committed Feb 1, 2023
    Configuration menu
    Copy the full SHA
    1fa2c43 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into feature/union_exec_handling

    @mustafasrepo
    mustafasrepo authored Feb 1, 2023
    Configuration menu
    Copy the full SHA
    3c8399e View commit details
    Browse the repository at this point in the history

  4. minor changes

    @mustafasrepo
    mustafasrepo committed Feb 1, 2023
    Configuration menu
    Copy the full SHA
    cb0debd View commit details
    Browse the repository at this point in the history

  5. Add test for union doesn't maintain any of its child ordering

    @mustafasrepo
    mustafasrepo committed Feb 1, 2023
    Configuration menu
    Copy the full SHA
    f3542a2 View commit details
    Browse the repository at this point in the history

  6. Add new test

    @mustafasrepo
    mustafasrepo committed Feb 1, 2023
    Configuration menu
    Copy the full SHA
    51ced76 View commit details
    Browse the repository at this point in the history

  7. use corresponding idx instead of 0th index

    @mustafasrepo
    mustafasrepo committed Feb 1, 2023
    Configuration menu
    Copy the full SHA
    d5d4943 View commit details
    Browse the repository at this point in the history

  8. Add global limit test

    @mustafasrepo
    mustafasrepo committed Feb 1, 2023
    Configuration menu
    Copy the full SHA
    1359a73 View commit details
    Browse the repository at this point in the history

Commits on Feb 2, 2023

  1. Add SortPreservingMerge handling

    @mustafasrepo
    mustafasrepo committed Feb 2, 2023
    Configuration menu
    Copy the full SHA
    a470f98 View commit details
    Browse the repository at this point in the history

  2. add finer sorting change Sort and SortPreserve test

    @mustafasrepo
    mustafasrepo committed Feb 2, 2023
    Configuration menu
    Copy the full SHA
    027eace View commit details
    Browse the repository at this point in the history

  3. Update test

    @mustafasrepo
    mustafasrepo committed Feb 2, 2023
    Configuration menu
    Copy the full SHA
    ec27254 View commit details
    Browse the repository at this point in the history

  4. simplifications

    @mustafasrepo
    mustafasrepo committed Feb 2, 2023
    Configuration menu
    Copy the full SHA
    4c32040 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'apache:master' into feature/union_exec_handling

    @mustafasrepo
    mustafasrepo authored Feb 2, 2023
    Configuration menu
    Copy the full SHA
    1d3a995 View commit details
    Browse the repository at this point in the history

  6. Simplifications

    @mustafasrepo
    mustafasrepo committed Feb 2, 2023
    Configuration menu
    Copy the full SHA
    d8e9515 View commit details
    Browse the repository at this point in the history

  7. Improved comments and naming

    @ozankabak
    ozankabak committed Feb 2, 2023
    Configuration menu
    Copy the full SHA
    3f68703 View commit details
    Browse the repository at this point in the history

Commits on Feb 7, 2023

  1. Remove explicit union check

    @mustafasrepo
    mustafasrepo committed Feb 7, 2023
    Configuration menu
    Copy the full SHA
    13d9074 View commit details
    Browse the repository at this point in the history

  2. make parallelize sort flag config parameter

    @mustafasrepo
    mustafasrepo committed Feb 7, 2023
    Configuration menu
    Copy the full SHA
    fdffa3f View commit details
    Browse the repository at this point in the history

  3. go back to first commit, add test

    @mustafasrepo
    mustafasrepo committed Feb 7, 2023
    Configuration menu
    Copy the full SHA
    4d19187 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'apache:master' into feature/union_exec_handling

    @mustafasrepo
    mustafasrepo authored Feb 7, 2023
    Configuration menu
    Copy the full SHA
    2bdbbef View commit details
    Browse the repository at this point in the history

  5. update config mg

    @mustafasrepo
    mustafasrepo committed Feb 7, 2023
    Configuration menu
    Copy the full SHA
    663d163 View commit details
    Browse the repository at this point in the history

  6. Use repartition_sorts in the API instead of parallelize_sorts

    @ozankabak
    ozankabak committed Feb 7, 2023
    Configuration menu
    Copy the full SHA
    d5957ae View commit details
    Browse the repository at this point in the history

  7. Update/format configs.md

    @ozankabak
    ozankabak committed Feb 7, 2023
    Configuration menu
    Copy the full SHA
    6a63f72 View commit details
    Browse the repository at this point in the history

Commits on Feb 8, 2023

  1. Use maintains_input_order instead of output_ordering comparison

    @mustafasrepo
    mustafasrepo committed Feb 8, 2023
    Configuration menu
    Copy the full SHA
    0ab76da View commit details
    Browse the repository at this point in the history

  2. Move logic under map_children to init method

    @mustafasrepo
    mustafasrepo committed Feb 8, 2023
    Configuration menu
    Copy the full SHA
    03c4fbe View commit details
    Browse the repository at this point in the history

  3. Remove two unnecessary clones

    @ozankabak
    ozankabak committed Feb 8, 2023
    Configuration menu
    Copy the full SHA
    a25ed96 View commit details
    Browse the repository at this point in the history