You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
@3cham , @jpizagno the barrier execution can help us with the sub connection issue. The idea is that Spark will wait until all task slots are ready to start. Even though it might not be backward compatible with previous Spark versions, we should keep an eye on barrier execution feature.
The text was updated successfully, but these errors were encountered:
Just recently Spark 2.4.0 was released and there are many improvements.
Interesting features from this release:
@3cham , @jpizagno the barrier execution can help us with the sub connection issue. The idea is that Spark will wait until all task slots are ready to start. Even though it might not be backward compatible with previous Spark versions, we should keep an eye on barrier execution feature.
The text was updated successfully, but these errors were encountered: