Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Optimized SparkRunner ParDo Operation #32546

Merged
merged 9 commits into from
Oct 3, 2024
Merged

Optimized SparkRunner ParDo Operation #32546

merged 9 commits into from
Oct 3, 2024

Commits on Sep 24, 2024

  1. Optimize to skip filter application when there is only a single output

    @twosom
    twosom committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    aac672e View commit details
    Browse the repository at this point in the history

  2. Make SparkTransformOverrides class public for testing

    @twosom
    twosom committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    48c9b80 View commit details
    Browse the repository at this point in the history

  3. add related test

    @twosom
    twosom committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    ed74b71 View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2024

  1. Touch trigger files

    @twosom
    twosom committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    2e8e3dc View commit details
    Browse the repository at this point in the history

  2. add CHANGES.md

    @twosom
    twosom committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    354a629 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into optimize-spark-runner-par-do

    @twosom
    twosom authored Sep 25, 2024
    Configuration menu
    Copy the full SHA
    56e54f2 View commit details
    Browse the repository at this point in the history

Commits on Oct 2, 2024

  1. Merge branch 'master' into optimize-spark-runner-par-do

    @twosom
    twosom authored Oct 2, 2024
    Configuration menu
    Copy the full SHA
    fb669c8 View commit details
    Browse the repository at this point in the history

  2. Update runners/spark/src/main/java/org/apache/beam/runners/spark/tran… 

    …slation/TransformTranslator.java
    @Abacn
    Abacn authored Oct 2, 2024
    Configuration menu
    Copy the full SHA
    567a11d View commit details
    Browse the repository at this point in the history

  3. Update runners/spark/src/main/java/org/apache/beam/runners/spark/tran… 

    …slation/TransformTranslator.java
    @Abacn
    Abacn authored Oct 2, 2024
    Configuration menu
    Copy the full SHA
    c490de7 View commit details
    Browse the repository at this point in the history