Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Spark 2.4.0 (Scala 2.12.x) Release #28

Closed
morazow opened this issue Nov 9, 2018 · 1 comment
Closed

Spark 2.4.0 (Scala 2.12.x) Release #28

morazow opened this issue Nov 9, 2018 · 1 comment

Comments

@morazow
Copy link
Contributor

morazow commented Nov 9, 2018

Just recently Spark 2.4.0 was released and there are many improvements.

Interesting features from this release:

@3cham , @jpizagno the barrier execution can help us with the sub connection issue. The idea is that Spark will wait until all task slots are ready to start. Even though it might not be backward compatible with previous Spark versions, we should keep an eye on barrier execution feature.

@morazow
Copy link
Contributor Author

morazow commented Jan 21, 2019

Hey all,

I am going to close this issue since we introduced already Spark version 2.4.0 in #37.

However, I am also going to create specific issue for Scala 2.12+. In near future, we should be able to compile with Scala 2.12.

@morazow morazow closed this as completed Jan 21, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant