Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Shuffle details的一点建议 #41

Open
GenTang opened this issue Oct 8, 2015 · 2 comments
Open

Shuffle details的一点建议 #41

GenTang opened this issue Oct 8, 2015 · 2 comments

Comments

@GenTang
Copy link

GenTang commented Oct 8, 2015

Hi,
最近发现您写的sparkinternals的技术笔记,读完之后觉得非常好,收益匪浅。
但是觉得稍有不足之处就是shuffle details这一章节只介绍了hash based shuffle,但是其实从1.2开始,sort based shuffle已经成为了spark的默认选择,从1.5开始又引入了tungsten-sort。所以个人觉得更新这部分内容可能会更好?

祝好!

@JerryLead
Copy link
Owner

谢谢建议,sort-based之前研究过,但苦于一直没有空闲去总结,一直在写论文,最近也在写毕业论文,准备找工作,等到这段空闲下来会慢慢补充,还会包括调度器等,欢迎交流!

@GenTang
Copy link
Author

GenTang commented Oct 9, 2015

话说,我觉得这篇文章讲得还算比较清楚的。
http://www.cnblogs.com/hseagle/p/3979744.html
希望能对你有帮助。

祝好!

2015-10-09 10:19 GMT+08:00 Lijie Xu notifications@github.com:

谢谢建议,sort-based之前研究过,但苦于一直没有空闲去总结,一直在写论文,最近也在写毕业论文,准备找工作,等到这段空闲下来会慢慢补充,还会包括调度器等,欢迎交流!


Reply to this email directly or view it on GitHub
#41 (comment)
.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants