summaryrefslogblamecommitdiff
path: root/community.md
blob: 3bff6ad9bfc076c1fef6c5c4e3fb0858d80e07ec (plain) (tree)
1
2
3
4
5
6
7
8
9








                     
                               
 
























                                                                                                            
                            



                                                                                              
 

      



                                                                                                                                            

       



                                                                                                                                                    


       















                                                                                                                
 


                           
                    

      
                                                                                                   

       
                                                                                                

       



                                                                                                         

       
                                                                                                 


       

                                                                                                                                                                                                                                                                                         

      
                                                                            
                                                                             
                                                                                                                                                                                                                                             

       
                                                                                

       
                                                                                         

       
                                                                                        

       
                                                                                        

       
                                                                                            

       
                                                                                                 

       
                                                                                 

       
                                                                                                           

       
                                                                                                        

       
                                                                                            

       
                                                                                           

       
                                                                               

       
                                                                                              

       
                                                                          

       
                                                                                     

       
                                                                                 

       
                                                                                    

       
                                                                    

       
                                                                                   

       
                                                                                            

       
                                                                                            

       
                                                                                  

       
                                                                               
       
      
                                                                                

       



                                                                                                              
       
     
 
                                                                                                               



                            
                                                                                                                                                                                                                                                                                                                                                                                                                              


                   
                                                                                                                         








                                                                                                          
                                                             


    

                                                                                              
    
---
layout: global
title: Community
type: "page singular"
navigation:
  weight: 5
  show: true
---

<h2>Apache Spark Community</h2>

<a name="have-questions"></a>
<h3>Have Questions?</h3>

<h4>StackOverflow</h4>

For usage questions and help (e.g. how to use this Spark API), it is recommended you use the 
StackOverflow tag <a href="http://stackoverflow.com/questions/tagged/apache-spark">`apache-spark`</a> 
as it is an active forum for Spark users' questions and answers.

Some quick tips when using StackOverflow:

- Prior to asking submitting questions, please:
  - Search StackOverflow's 
  <a href="http://stackoverflow.com/questions/tagged/apache-spark">`apache-spark`</a> tag to see if 
  your question has already been answered
  - Search the nabble archive for
  <a href="http://apache-spark-user-list.1001560.n3.nabble.com/">users@spark.apache.org</a> 
- Please follow the StackOverflow <a href="http://stackoverflow.com/help/how-to-ask">code of conduct</a>  
- Always use the `apache-spark` tag when asking questions
- Please also use a secondary tag to specify components so subject matter experts can more easily find them.
 Examples include: `pyspark`, `spark-dataframe`, `spark-streaming`, `spark-r`, `spark-mllib`, 
  `spark-ml`, `spark-graphx`, `spark-graphframes`, `spark-tensorframes`, etc. 
- Please do not cross-post between StackOverflow and the mailing lists
- No jobs, sales, or solicitation is permitted on StackOverflow

<a name="mailing-lists"></a>
<h4>Mailing Lists</h4>

For broad, opinion based, ask for external resources, debug issues, bugs, contributing to the 
project, and scenarios, it is recommended you use the user@spark.apache.org mailing list.

<ul>
  <li>
    <a href="http://apache-spark-user-list.1001560.n3.nabble.com">user@spark.apache.org</a> is for usage questions, help, and announcements.
    <a href="mailto:user-subscribe@spark.apache.org?subject=(send%20this%20email%20to%20subscribe)">(subscribe)</a>
    <a href="mailto:user-unsubscribe@spark.apache.org?subject=(send%20this%20email%20to%20unsubscribe)">(unsubscribe)</a>
    <a href="http://apache-spark-user-list.1001560.n3.nabble.com">(archives)</a>
  </li>
  <li>
    <a href="http://apache-spark-developers-list.1001551.n3.nabble.com">dev@spark.apache.org</a> is for people who want to contribute code to Spark.
    <a href="mailto:dev-subscribe@spark.apache.org?subject=(send%20this%20email%20to%20subscribe)">(subscribe)</a>
    <a href="mailto:dev-unsubscribe@spark.apache.org?subject=(send%20this%20email%20to%20unsubscribe)">(unsubscribe)</a>
    <a href="http://apache-spark-developers-list.1001551.n3.nabble.com">(archives)</a>
  </li>
</ul>

Some quick tips when using email:

- Prior to asking submitting questions, please:
  - Search StackOverflow at <a href="http://stackoverflow.com/questions/tagged/apache-spark">`apache-spark`</a> 
  to see if your question has already been answered
  - Search the nabble archive for
  <a href="http://apache-spark-user-list.1001560.n3.nabble.com/">users@spark.apache.org</a> 
- Tagging the subject line of your email will help you get a faster response, e.g. 
`[Spark SQL]: Does Spark SQL support LEFT SEMI JOIN?`
- Tags may help identify a topic by:
  - Component: Spark Core, Spark SQL, ML, MLlib, GraphFrames, GraphX, TensorFrames, etc
  - Level: Beginner, Intermediate, Advanced
  - Scenario: Debug, How-to
- For error logs or long code examples, please use <a href="https://gist.github.com/">GitHub gist</a> 
and include only a few lines of the pertinent code / log within the email.
- No jobs, sales, or solicitation is permitted on the Apache Spark mailing lists.

<a name="events"></a>
<h3>Events and Meetups</h3>

<h4>Conferences</h4>
<ul>
  <li>
    <a href="https://spark-summit.org/">Spark Summit Europe 2015.</a> Oct 27 - Oct 29 in Amsterdam.
  </li>
  <li>
    <a href="http://spark-summit.org/2015">Spark Summit 2015.</a> June 15 - 17 in San Francisco.
  </li>
  <li>
    <a href="http://spark-summit.org/east">Spark Summit East 2015.</a> March 18 - 19 in New York City.
  </li>
  <li>
    <a href="http://spark-summit.org/2014">Spark Summit 2014.</a> June 30 - July 1 2014 in San Francisco.
  </li>
  <li>
    <a href="http://spark-summit.org/2013">Spark Summit 2013.</a> December 2013 in San Francisco.
  </li>
</ul>

<h4>Meetups</h4>
Spark Meetups are grass-roots events organized and hosted by leaders and champions in the community around the world. Check out <a href="http://spark.meetup.com">http://spark.meetup.com</a> to find a Spark meetup in your part of the world. Below is a partial list of Spark meetups.
<ul>
  <li>
    <a href="https://www.meetup.com/spark-users/">Bay Area Spark Meetup.</a>
    This group has been running since January 2012 in the San Francisco area.
    The meetup page also contains an <a href="https://www.meetup.com/spark-users/events/past/">archive of past meetups</a>, including videos and <a href="https://www.meetup.com/spark-users/files/">slides</a> for most of the recent talks.
  </li>
  <li>
    <a href="https://www.meetup.com/Spark-Barcelona/">Barcelona Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Spark_big_data_analytics/">Bangalore Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Berlin-Apache-Spark-Meetup/">Berlin Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/spark-user-beijing-Meetup/">Beijing Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Boston-Apache-Spark-User-Group/">Boston Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Boulder-Denver-Spark-Meetup/">Boulder/Denver Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Chicago-Spark-Users/">Chicago Spark Users</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Christchurch-Apache-Spark-Meetup/">Christchurch Apache Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Cincinnati-Apache-Spark-Meetup/">Cincinanati Apache Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Hangzhou-Apache-Spark-Meetup/">Hangzhou Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Spark-User-Group-Hyderabad/">Hyderabad Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/israel-spark-users/">Israel Spark Users</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Apache-Spark-Ljubljana-Meetup/">Ljubljana Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Spark-London/">London Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Apache-Spark-Maryland/">Maryland Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Mumbai-Spark-Meetup/">Mumbai Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Apache-Spark-in-Moscow/">Moscow Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Spark-NYC/">NYC Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Seattle-Spark-Meetup/">Seattle Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Shanghai-Apache-Spark-Meetup/">Shanghai Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Shenzhen-Apache-Spark-Meetup/">Shenzhen Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Toronto-Apache-Spark">Toronto Apache Spark</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Tokyo-Spark-Meetup/">Tokyo Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Vancouver-Spark/">Vancouver Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Washington-DC-Area-Spark-Interactive/">Washington DC Area Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Apache-Spark-Zagreb-Meetup/">Zagreb Spark Meetup</a>
  </li>
</ul>

<p>If you'd like your meetup added, email <a href="mailto:user@spark.apache.org">user@spark.apache.org</a>.</p>

<a name="issue-tracker"></a>
<h3>Issue Tracker</h3>

<p>The project tracks bugs and new features on <a href="https://issues.apache.org/jira/browse/SPARK">JIRA</a>. If you'd like, you can also subscribe to <a href="https://mail-archives.apache.org/mod_mbox/spark-issues/">issues@spark.apache.org</a> to receive emails about new issues, and <a href="https://mail-archives.apache.org/mod_mbox/spark-commits/">commits@spark.apache.org</a> to get emails about commits.</p>

<h3>Powered By</h3>

<p>Our wiki has a list of <a href="{{site.baseurl}}/powered-by.html">projects and organizations powered by Spark</a>.</p>

<a name="history"></a>
<h3>Project History</h3>


<p>
Spark started as a research project at the <a href="https://amplab.cs.berkeley.edu">UC Berkeley AMPLab</a>
in 2009, and was open sourced in early 2010.
Many of the ideas behind the system are presented in various
<a href="{{site.baseurl}}/research.html">research papers</a>.
</p>

<p>
After being released, Spark grew a developer community on GitHub and moved to Apache in 2013.
A wide range of contributors now develop the project (over 400 developers from 100 companies).
</p>