layout | title | type | navigation | ||||
---|---|---|---|---|---|---|---|
global |
Community |
page singular |
|
For usage questions and help (e.g. how to use this Spark API), it is recommended you use the
StackOverflow tag apache-spark
as it is an active forum for Spark users' questions and answers.
Some quick tips when using StackOverflow:
- Prior to asking submitting questions, please:
- Search StackOverflow's
apache-spark
tag to see if your question has already been answered - Search the nabble archive for user@spark.apache.org
- Search StackOverflow's
- Please follow the StackOverflow code of conduct
- Always use the
apache-spark
tag when asking questions - Please also use a secondary tag to specify components so subject matter experts can more easily find them.
Examples include:
pyspark
,spark-dataframe
,spark-streaming
,spark-r
,spark-mllib
,spark-ml
,spark-graphx
,spark-graphframes
,spark-tensorframes
, etc. - Please do not cross-post between StackOverflow and the mailing lists
- No jobs, sales, or solicitation is permitted on StackOverflow
For broad, opinion based, ask for external resources, debug issues, bugs, contributing to the project, and scenarios, it is recommended you use the user@spark.apache.org mailing list.
- user@spark.apache.org is for usage questions, help, and announcements. (subscribe) (unsubscribe) (archives)
- dev@spark.apache.org is for people who want to contribute code to Spark. (subscribe) (unsubscribe) (archives)
Some quick tips when using email:
- Prior to asking submitting questions, please:
- Search StackOverflow at
apache-spark
to see if your question has already been answered - Search the nabble archive for user@spark.apache.org
- Search StackOverflow at
- Tagging the subject line of your email will help you get a faster response, e.g.
[Spark SQL]: Does Spark SQL support LEFT SEMI JOIN?
- Tags may help identify a topic by:
- Component: Spark Core, Spark SQL, ML, MLlib, GraphFrames, GraphX, TensorFrames, etc
- Level: Beginner, Intermediate, Advanced
- Scenario: Debug, How-to
- For error logs or long code examples, please use GitHub gist and include only a few lines of the pertinent code / log within the email.
- No jobs, sales, or solicitation is permitted on the Apache Spark mailing lists.
Please see the Security page for information on how to report sensitive security vulnerabilities, and for information on known security issues.
Chat rooms are great for quick questions or discussions on specialized topics. The following chat rooms are not officially part of Apache Spark; they are provided for reference only.
- Spark with Scala is for questions and discussions related to using Spark with the Scala programming language.
- Spark Summit Europe 2017. Oct 24 - 26 in Dublin.
- Spark Summit 2017. June 5 - 7 in San Francisco.
- Spark Summit Europe 2016. Oct 25 - 27 in Brussels.
- Spark Summit 2016. June 6 - 8 in San Francisco.
- Spark Summit East 2016. Feb 16 - 18 in New York City.
- Spark Summit Europe 2015. Oct 27 - 29 in Amsterdam.
- Spark Summit 2015. June 15 - 17 in San Francisco.
- Spark Summit East 2015. March 18 - 19 in New York City.
- Spark Summit 2014. June 30 - July 1 2014 in San Francisco.
- Spark Summit 2013. December 2013 in San Francisco.
- Bay Area Spark Meetup. This group has been running since January 2012 in the San Francisco area. The meetup page also contains an archive of past meetups, including videos and slides for most of the recent talks.
- Barcelona Spark Meetup
- Bangalore Spark Meetup
- Berlin Spark Meetup
- Beijing Spark Meetup
- Boston Spark Meetup
- Boulder/Denver Spark Meetup
- Chicago Spark Users
- Christchurch Apache Spark Meetup
- Cincinanati Apache Spark Meetup
- Hangzhou Spark Meetup
- Hyderabad Spark Meetup
- Israel Spark Users
- Ljubljana Spark Meetup
- London Spark Meetup
- Maryland Spark Meetup
- Mumbai Spark Meetup
- Moscow Spark Meetup
- NYC Spark Meetup
- Seattle Spark Meetup
- Shanghai Spark Meetup
- Shenzhen Spark Meetup
- Toronto Apache Spark
- Tokyo Spark Meetup
- Vancouver Spark Meetup
- Washington DC Area Spark Meetup
- Zagreb Spark Meetup
If you'd like your meetup added, email user@spark.apache.org.
The project tracks bugs and new features on JIRA. If you'd like, you can also subscribe to issues@spark.apache.org to receive emails about new issues, and commits@spark.apache.org to get emails about commits.
Our wiki has a list of projects and organizations powered by Spark.
Spark started as a research project at the UC Berkeley AMPLab in 2009, and was open sourced in early 2010. Many of the ideas behind the system are presented in various research papers.
After being released, Spark grew a developer community on GitHub and moved to Apache in 2013. A wide range of contributors now develop the project (over 400 developers from 100 companies).