Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CORE] Statement level controls whether to use gluten #3049

Closed
loneylee opened this issue Sep 7, 2023 · 1 comment
Closed

[CORE] Statement level controls whether to use gluten #3049

loneylee opened this issue Sep 7, 2023 · 1 comment
Labels
enhancement New feature or request stale stale

Comments

@loneylee
Copy link
Member

loneylee commented Sep 7, 2023

Description

Currently, spark.gluten.enable is control by spark session. Some times, gluten returns wrong results, we need to quickly fall back to the version without gluten, and statement-level control is required.

@loneylee loneylee added the enhancement New feature or request label Sep 7, 2023
@PHILO-HE
Copy link
Contributor

It looks useful. We need to support changing this config by respecting user's set statement at runtime. And we may also need more work to fully control Gluten's usage to align with this config.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request stale stale
Projects
None yet
Development

No branches or pull requests

2 participants