aboutsummaryrefslogtreecommitdiff
path: root/repl
Commit message (Collapse)AuthorAgeFilesLines
* Remove activation of profiles by defaultMikhail Bautin2013-01-311-11/+0
| | | | | See the discussion at https://github.com/mesos/spark/pull/355 for why default profile activation is a problem.
* Replace old 'master' term with 'driver'.Stephen Haberman2013-01-251-1/+1
|
* Add an Avro dependency to REPL to make it compile with Hadoop 2Mikhail Bautin2013-01-221-0/+10
|
* Add Maven build file for streaming, and fix some issues in SBT fileMatei Zaharia2013-01-201-0/+14
| | | | | | As part of this, changed our Scala 2.9.2 Kafka library to be available as a local Maven repository, following the example in (http://blog.dub.podval.org/2010/01/maven-in-project-repository.html)
* Merge branch 'master' into streamingTathagata Das2013-01-151-0/+11
|\ | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/rdd/CoGroupedRDD.scala core/src/main/scala/spark/rdd/FilteredRDD.scala docs/_layouts/global.html docs/index.md run
| * Rename environment variable for hadoop profiles to hadoopVersionShivaram Venkataraman2013-01-121-2/+2
| |
| * Activate hadoop2 profile in pom.xml with -Dhadoop=2Shivaram Venkataraman2013-01-101-0/+6
| |
| * Activate hadoop1 if property hadoop is missing. hadoop2 can be activated nowShivaram Venkataraman2013-01-081-1/+3
| | | | | | | | by using -Dhadoop -Phadoop2.
| * Activate hadoop1 profile by default for maven buildsShivaram Venkataraman2013-01-071-0/+3
| |
* | Changed locations for unit test logs.Tathagata Das2013-01-071-2/+2
|/
* Fixed repl maven build to produce artifacts with the appropriate hadoop ↵Thomas Dudziak2012-12-185-197/+7
| | | | classifier and extracted repl fat-jar and debian packaging into a separate project to make Maven happy
* Shaded repl jar for hadoop1 profile needs to include hadoop classesThomas Dudziak2012-12-101-0/+3
|
* Merge pull request #318 from tomdz/masterMatei Zaharia2012-12-101-1/+3
|\ | | | | Minor tweaks to the debian build
| * Minor tweaks to the debian buildThomas Dudziak2012-12-101-1/+3
| |
* | Use the same output directories that SBT had in subprojectsMatei Zaharia2012-12-101-0/+2
|/ | | | This will make it easier to make the "run" script work with a Maven build
* Updated versions in the pom.xml files to match current masterThomas Dudziak2012-11-271-1/+1
|
* Addressed code review commentsThomas Dudziak2012-11-271-0/+1
|
* Include the configuration templates in the debian packageThomas Dudziak2012-11-201-0/+11
|
* Added maven and debian build filesThomas Dudziak2012-11-205-0/+338
|
* Bump up version to 0.7.0-SNAPSHOT for master branchMatei Zaharia2012-10-221-1/+1
|
* Update version to 0.6.1-SNAPSHOT to show this is in developmentMatei Zaharia2012-10-221-1/+1
|
* Uncomment Maven publishing stuff and set version to 0.6.0Matei Zaharia2012-10-131-1/+1
|
* Removed the need to sleep in tests due to waiting for Akka to shut downMatei Zaharia2012-10-071-0/+2
|
* Write all unit test output to a fileMatei Zaharia2012-10-011-4/+6
|
* Fixed several bugs that caused weird behavior with files in spark-shell:Matei Zaharia2012-09-301-1/+22
| | | | | | | | | - SizeEstimator was following through a ClassLoader field of Hadoop JobConfs, which referenced the whole interpreter, Scala compiler, etc. Chaos ensued, giving an estimated size in the tens of gigabytes. - Broadcast variables in local mode were only stored as MEMORY_ONLY and never made accessible over a server, so they fell out of the cache when they were deemed too large and couldn't be reloaded.
* Set log level in tests to WARNMatei Zaharia2012-08-231-0/+8
|
* Some refactoring to make cluster scheduler pluggable.Matei Zaharia2012-07-061-1/+0
|
* Update version number for dev branchMatei Zaharia2012-06-151-1/+1
|
* Changed version in master branch to 0.5.1-SNAPSHOT for furtherMatei Zaharia2012-06-131-1/+1
| | | | development.
* Updated version number to 0.5.0Matei Zaharia2012-06-121-1/+1
|
* Merge branch 'master' into mesos-0.9Matei Zaharia2012-06-031-1/+1
|\ | | | | | | | | Conflicts: core/src/main/scala/spark/Executor.scala
| * Make spark.repl.Main.interp_ publicly accessible (so Shark can get ridReynold Xin2012-05-301-1/+1
| | | | | | | | of a weird file dediated to accessing this variable).
* | Further fixes to how Mesos is found and usedMatei Zaharia2012-03-171-1/+1
|/
* Update REPL code to use our own version of JLineReader, which fixes #89.Matei Zaharia2011-11-073-8/+8
| | | | | I'm not entirely sure why this broke in the jump from Scala 2.9.0.1 to 2.9.1 -- maybe something about name resolution changed?
* Upgrade to Scala 2.9.1.Ismael Juma2011-08-311-2/+2
| | | | | | | | | Interestingly, the version in Maven is 2.9.1, but SBT outputs file to the 2.9.1.final directory inside target. A couple of small changes in SparkIMain were also required. All tests pass and ./spark-shell launches successfully.
* Use process instead of main as the latter is deprecated.Ismael Juma2011-08-021-1/+1
|
* Merge branch 'master' into scala-2.9Matei Zaharia2011-07-141-1/+1
|\ | | | | | | | | | | Conflicts: project/build.properties repl/src/main/scala/spark/repl/SparkInterpreterLoop.scala
| * Update version number to 0.4-SNAPSHOTMatei Zaharia2011-07-141-1/+1
| |
| * Print version number 0.3 in REPLMatei Zaharia2011-06-261-1/+1
| |
* | Ensure logging is initialized before any Spark threads run in the REPLMatei Zaharia2011-05-311-0/+6
| |
* | Another fix ported forward for the REPLMatei Zaharia2011-05-312-2/+8
| |
* | Further fixes to interpreter (adding in some code generation changes IMatei Zaharia2011-05-313-4/+15
| | | | | | | | | | missed before and setting SparkEnv properly on the threads that execute each line in the 2.9 interpreter).
* | Ported code generation changes from 2.8 interpreter (to use a class forMatei Zaharia2011-05-312-8/+40
| | | | | | | | | | | | | | each line's object rather than a singleton object so that we can ship these classes to worker nodes). This is pretty hairy stuff, which would be nice to avoid in the future by integrating with the interpreter some other way.
* | Various work to use the 2.9 interpreterMatei Zaharia2011-05-3118-2499/+2804
|/
* Move REPL classes to separate module.Ismael Juma2011-05-2712-0/+3013