summaryrefslogtreecommitdiff
path: root/community.md
blob: 3bff6ad9bfc076c1fef6c5c4e3fb0858d80e07ec (plain) (blame)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
---
layout: global
title: Community
type: "page singular"
navigation:
  weight: 5
  show: true
---

<h2>Apache Spark Community</h2>

<a name="have-questions"></a>
<h3>Have Questions?</h3>

<h4>StackOverflow</h4>

For usage questions and help (e.g. how to use this Spark API), it is recommended you use the 
StackOverflow tag <a href="http://stackoverflow.com/questions/tagged/apache-spark">`apache-spark`</a> 
as it is an active forum for Spark users' questions and answers.

Some quick tips when using StackOverflow:

- Prior to asking submitting questions, please:
  - Search StackOverflow's 
  <a href="http://stackoverflow.com/questions/tagged/apache-spark">`apache-spark`</a> tag to see if 
  your question has already been answered
  - Search the nabble archive for
  <a href="http://apache-spark-user-list.1001560.n3.nabble.com/">users@spark.apache.org</a> 
- Please follow the StackOverflow <a href="http://stackoverflow.com/help/how-to-ask">code of conduct</a>  
- Always use the `apache-spark` tag when asking questions
- Please also use a secondary tag to specify components so subject matter experts can more easily find them.
 Examples include: `pyspark`, `spark-dataframe`, `spark-streaming`, `spark-r`, `spark-mllib`, 
  `spark-ml`, `spark-graphx`, `spark-graphframes`, `spark-tensorframes`, etc. 
- Please do not cross-post between StackOverflow and the mailing lists
- No jobs, sales, or solicitation is permitted on StackOverflow

<a name="mailing-lists"></a>
<h4>Mailing Lists</h4>

For broad, opinion based, ask for external resources, debug issues, bugs, contributing to the 
project, and scenarios, it is recommended you use the user@spark.apache.org mailing list.

<ul>
  <li>
    <a href="http://apache-spark-user-list.1001560.n3.nabble.com">user@spark.apache.org</a> is for usage questions, help, and announcements.
    <a href="mailto:user-subscribe@spark.apache.org?subject=(send%20this%20email%20to%20subscribe)">(subscribe)</a>
    <a href="mailto:user-unsubscribe@spark.apache.org?subject=(send%20this%20email%20to%20unsubscribe)">(unsubscribe)</a>
    <a href="http://apache-spark-user-list.1001560.n3.nabble.com">(archives)</a>
  </li>
  <li>
    <a href="http://apache-spark-developers-list.1001551.n3.nabble.com">dev@spark.apache.org</a> is for people who want to contribute code to Spark.
    <a href="mailto:dev-subscribe@spark.apache.org?subject=(send%20this%20email%20to%20subscribe)">(subscribe)</a>
    <a href="mailto:dev-unsubscribe@spark.apache.org?subject=(send%20this%20email%20to%20unsubscribe)">(unsubscribe)</a>
    <a href="http://apache-spark-developers-list.1001551.n3.nabble.com">(archives)</a>
  </li>
</ul>

Some quick tips when using email:

- Prior to asking submitting questions, please:
  - Search StackOverflow at <a href="http://stackoverflow.com/questions/tagged/apache-spark">`apache-spark`</a> 
  to see if your question has already been answered
  - Search the nabble archive for
  <a href="http://apache-spark-user-list.1001560.n3.nabble.com/">users@spark.apache.org</a> 
- Tagging the subject line of your email will help you get a faster response, e.g. 
`[Spark SQL]: Does Spark SQL support LEFT SEMI JOIN?`
- Tags may help identify a topic by:
  - Component: Spark Core, Spark SQL, ML, MLlib, GraphFrames, GraphX, TensorFrames, etc
  - Level: Beginner, Intermediate, Advanced
  - Scenario: Debug, How-to
- For error logs or long code examples, please use <a href="https://gist.github.com/">GitHub gist</a> 
and include only a few lines of the pertinent code / log within the email.
- No jobs, sales, or solicitation is permitted on the Apache Spark mailing lists.

<a name="events"></a>
<h3>Events and Meetups</h3>

<h4>Conferences</h4>
<ul>
  <li>
    <a href="https://spark-summit.org/">Spark Summit Europe 2015.</a> Oct 27 - Oct 29 in Amsterdam.
  </li>
  <li>
    <a href="http://spark-summit.org/2015">Spark Summit 2015.</a> June 15 - 17 in San Francisco.
  </li>
  <li>
    <a href="http://spark-summit.org/east">Spark Summit East 2015.</a> March 18 - 19 in New York City.
  </li>
  <li>
    <a href="http://spark-summit.org/2014">Spark Summit 2014.</a> June 30 - July 1 2014 in San Francisco.
  </li>
  <li>
    <a href="http://spark-summit.org/2013">Spark Summit 2013.</a> December 2013 in San Francisco.
  </li>
</ul>

<h4>Meetups</h4>
Spark Meetups are grass-roots events organized and hosted by leaders and champions in the community around the world. Check out <a href="http://spark.meetup.com">http://spark.meetup.com</a> to find a Spark meetup in your part of the world. Below is a partial list of Spark meetups.
<ul>
  <li>
    <a href="https://www.meetup.com/spark-users/">Bay Area Spark Meetup.</a>
    This group has been running since January 2012 in the San Francisco area.
    The meetup page also contains an <a href="https://www.meetup.com/spark-users/events/past/">archive of past meetups</a>, including videos and <a href="https://www.meetup.com/spark-users/files/">slides</a> for most of the recent talks.
  </li>
  <li>
    <a href="https://www.meetup.com/Spark-Barcelona/">Barcelona Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Spark_big_data_analytics/">Bangalore Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Berlin-Apache-Spark-Meetup/">Berlin Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/spark-user-beijing-Meetup/">Beijing Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Boston-Apache-Spark-User-Group/">Boston Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Boulder-Denver-Spark-Meetup/">Boulder/Denver Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Chicago-Spark-Users/">Chicago Spark Users</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Christchurch-Apache-Spark-Meetup/">Christchurch Apache Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Cincinnati-Apache-Spark-Meetup/">Cincinanati Apache Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Hangzhou-Apache-Spark-Meetup/">Hangzhou Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Spark-User-Group-Hyderabad/">Hyderabad Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/israel-spark-users/">Israel Spark Users</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Apache-Spark-Ljubljana-Meetup/">Ljubljana Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Spark-London/">London Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Apache-Spark-Maryland/">Maryland Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Mumbai-Spark-Meetup/">Mumbai Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Apache-Spark-in-Moscow/">Moscow Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Spark-NYC/">NYC Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Seattle-Spark-Meetup/">Seattle Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Shanghai-Apache-Spark-Meetup/">Shanghai Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Shenzhen-Apache-Spark-Meetup/">Shenzhen Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Toronto-Apache-Spark">Toronto Apache Spark</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Tokyo-Spark-Meetup/">Tokyo Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Vancouver-Spark/">Vancouver Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Washington-DC-Area-Spark-Interactive/">Washington DC Area Spark Meetup</a>
  </li>
  <li>
    <a href="https://www.meetup.com/Apache-Spark-Zagreb-Meetup/">Zagreb Spark Meetup</a>
  </li>
</ul>

<p>If you'd like your meetup added, email <a href="mailto:user@spark.apache.org">user@spark.apache.org</a>.</p>

<a name="issue-tracker"></a>
<h3>Issue Tracker</h3>

<p>The project tracks bugs and new features on <a href="https://issues.apache.org/jira/browse/SPARK">JIRA</a>. If you'd like, you can also subscribe to <a href="https://mail-archives.apache.org/mod_mbox/spark-issues/">issues@spark.apache.org</a> to receive emails about new issues, and <a href="https://mail-archives.apache.org/mod_mbox/spark-commits/">commits@spark.apache.org</a> to get emails about commits.</p>

<h3>Powered By</h3>

<p>Our wiki has a list of <a href="{{site.baseurl}}/powered-by.html">projects and organizations powered by Spark</a>.</p>

<a name="history"></a>
<h3>Project History</h3>


<p>
Spark started as a research project at the <a href="https://amplab.cs.berkeley.edu">UC Berkeley AMPLab</a>
in 2009, and was open sourced in early 2010.
Many of the ideas behind the system are presented in various
<a href="{{site.baseurl}}/research.html">research papers</a>.
</p>

<p>
After being released, Spark grew a developer community on GitHub and moved to Apache in 2013.
A wide range of contributors now develop the project (over 400 developers from 100 companies).
</p>