aboutsummaryrefslogtreecommitdiff
path: root/stage1/Stage1.scala
Commit message (Collapse)AuthorAgeFilesLines
* add process library with extracted and new functionsChristopher Vogt2017-06-151-0/+1
|
* io performance tweak: cache cbtLastModifiedChristopher Vogt2017-03-271-2/+9
|
* better error than NullPointerException when directory does not existChristopher Vogt2017-03-191-2/+2
|
* Get rid of the hacky "essential" plugins separationChristopher Vogt2017-03-191-2/+4
| | | | | | | Let’s keep move them back into stage2 again instead for reduction of complexity, cbt build speed and convenience of fewer manual dependencies. And for that let cbt just include eval from the start.
* fix file watching for realChristopher Vogt2017-03-121-7/+15
| | | | | | | last file watching update didn’t work well enough. This now - rips out barbary watch service as it seems buggy crashing the jvm - make cbt exclusively write files to watch to a file - uses fswatch instead watching all files in that file
* fix bugs with argument passing to testsChristopher Vogt2017-03-121-3/+2
|
* drop "direct" arg already in shell scriptChristopher Vogt2017-03-121-1/+1
|
* revamp loop featureChristopher Vogt2017-03-121-7/+11
| | | | | | | | | | | | | | | | | | | | | now CBT and builds pass their file names to the current build via the context. The build then simply blocks until any file changes. Then it returns with a special exit code, which the bash script picks up and restarts CBT. Thats works well for looping over project files. It works less well for looping over builds and CBT itself. For this a build has to success once, so that the .cbt-loop.tmp file exists. Then looping works for cbt and builds, but the file list is not updated in case of compile errors, etc. Fixes - https://github.com/cvogt/cbt/issues/406 - https://github.com/cvogt/cbt/issues/405 - https://github.com/cvogt/cbt/issues/202 - https://github.com/cvogt/cbt/issues/50 - https://github.com/cvogt/cbt/issues/22 We should improve for 1.0 in https://github.com/cvogt/cbt/issues/419 to handle looping over build files and cbt itself smarter.
* a few hopefully simplifying rewirings in the implicitsChristopher Vogt2017-02-221-10/+7
|
* implicitly pass classloader, might make code easierChristopher Vogt2017-02-141-24/+21
| | | | | and prepares for allowing `run` and `runFlat` at Dependency instead of Build level
* let Stage1 handle Stage2 exit codeChristopher Vogt2017-02-091-1/+1
|
* idempotent change propagationChristopher Vogt2017-02-091-50/+50
| | | | | | using lastModified instead of a non-idempotent needsUpdate flag this fixes a bug where dependees would not be rebuilt if cbt exited or was killed after dependencies were already rebuilt.
* memoize task results across classes within a single runChristopher Vogt2017-02-091-6/+9
|
* make full dependencies available to compile instead of only classpathChristopher Vogt2017-02-011-1/+1
| | | | | this will make it possible to access lastModified times and cache them in the following commits
* replace flawed concurrent hashmap cache with consistent replacementChristopher Vogt2017-02-011-2/+2
| | | | | | | | | | | | | | | | | | | | | | | The concurrent hashmap approach to classloader caching was flawed. Assume you have two concurrently running builds A and B and projects P2 and P3 depending on project P1. And assume a time sequence where A compiles P1, then compiles P2, then P1’s sources change, then B compiles P1, then A compiles P3. At the end P2 and P3 will have different versions of P1 as their parent classloaders. This is inconsistent. The easiest way to work around this is making sure only one thread is changing the classloader cache during it’s entire run. This would mean either no concurrency or what we have done here, which is letting threads work on a copy of the cache and replace the original cache in the end using an atomic operation. This means the thread that finishes last wins, but for caching that’s fine. Worst case some things aren’t cached in a concurrent execution. This change also means that we don’t need concurrent hashmaps for the classloader cache anymore since no two theads will access the same hashmap. We still need a concurrent hashmap for the class caches inside of the classloaders as multiple threads can access the same classloaders.
* Merge separate hashmaps for persistent cache into oneChristopher Vogt2017-02-011-21/+8
| | | | | | | This isn’t type-safe, but re-using that same hashmap for both keys and classloaders allows to reduce the number of members in Context. Also we can re-use the same hashMap for other things as well in the coming commits, e.g. timestamps.
* small refactoring simplifying Stage2Christopher Vogt2016-11-131-2/+7
|
* more sanity checks for cbt's classloadersChristopher Vogt2016-11-101-12/+27
|
* Upgrade zinc to 0.3.12Christopher Vogt2016-11-091-1/+1
|
* filter out 'direct' meta task earlier from the argsChristopher Vogt2016-11-081-1/+1
|
* built-in plugin structure improvementsChristopher Vogt2016-06-191-1/+4
| | | | | | - move plugins into cbt namespace - enable scalac warnings in builds by default - merged language flags into AdvancedScala trait
* show scalac warnings to stage1 and stage2 compilationChristopher Vogt2016-06-191-1/+1
|
* Get rid of Build default imports to reduce noise in build files. This also ↵Christopher Vogt2016-06-151-1/+0
| | | | changes builds from using immutable.Seq to using Predef.Seq in favor of simplicity over purity. This has been discussed on gitter.
* rename admin into tools, which seems more appropriateChristopher Vogt2016-05-021-2/+2
|
* Remove unnecessary code. .classLoader should already do thisChristopher Vogt2016-04-291-4/+1
|
* Fix use compatibility interfaces from main cbtChristopher Vogt2016-04-291-9/+10
|
* Fix building cbt as a cbt projectChristopher Vogt2016-04-291-2/+2
|
* Reproducible builds, composing different CBT version and various improvementsChristopher Vogt2016-04-281-30/+119
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | One large commit, because it is was hard to do these things in isolation or to separate them now. CBT now knows how to load other versions of itself - Support for reproducible builds (!), by providing a CBT git URL and hash to tie build to - Support for composing builds using different CBT versions (!) - introduce (in compatibility/) Java interfaces all CBT versions need to stay compatible with, so they can talk to each other. And put extension methods to these interfaces in cbt package object Class loading - add some sanity checks for class loading - improve class loader invalidation to fix bugs - implement caching in Java land class loaders. In particular to prevent the system class loader to repeatedly generate ClassNotFound exceptions in each sink of the class loader DAG for non JDK classes (meaning major speed up for projects with many classes). - getting rid of transient class loader cache unifying into "persistent" one instead (which is still wrong as invalidation eventually needs to invalidate entire sub graphs of the class loading DAG, not single class loaders. Seems like we'll have to abandon the hashmap based approach and tie caching to dependency objects) Other Caching - cache dependencies extracted from xml files, which was one major time killer, but invalidate cache when cbt changed (maven dependency user facing api needs simplification now!) - memorize last successful compile time in the file system rather than memory, to guard against unnecessary recompiling even across launches (or when using cbt direct) Structural improvements - Factor out ClassLoaderCache on Java land into its own class. - Port MultiClassLoader to Java land, to better compose classloaders in NailgunLauncher. - Remove many global constants and variables (in object paths and in NailgunLauncher) and pass them through instead. Needed for composing of builds. - move more code from resolver into Lib for less entanglement with classes (needed to compatibility interfaces) and better re-usability - remove canBeCached. Everything can be cached now, but we need to be careful about correct invalidation. - remove build announcing produced jars. We can add if ever needed. - change callNullary to return exit code instead of Unit as preparation for next commit introducing "recursive" ScalaTest - Makes ScalaTest support work (still a bit too inflexible, but mostly works well)
* Fix stage2 classloader not being stored in transient cacheChristopher Vogt2016-04-071-1/+3
| | | | | and thus being re-created on second and subsequent runs. Also use classloader from cache for Builds rather than new one, which should properly make Build dependencies work.
* Temporarily cache classloaders for potentially changing filesChristopher Vogt2016-04-061-1/+3
| | | | to avoid creating classloaders for the same files more than once, which leads to conflicts.
* Pass ClassLoaderCache from stage1 to stage2 instead of wrongly creating ↵Christopher Vogt2016-04-061-2/+4
| | | | another one. This should improve behavior of transient cache.
* Finally get rid of JDK 8 dependenciesChristopher Vogt2016-04-041-6/+5
|
* Implement alternative resolversChristopher Vogt2016-04-031-11/+2
| | | | | | | | | | | | This commit also - requires Dependencies to explicitly implement canBeCached - unifies some logic for dependency downloading - moves SBT-like dependency DSL into its own trait - error message showing build directory for exceptions in builds Not splitting this up in favor of faster progress to 1.0. The user facing API can probably be slightly improved using implicits inside of BasicBuild, but we can do that later.
* propagate info if cbt has changed across builds, so they can be re-compiledChristopher Vogt2016-04-021-5/+5
|
* Properly cache classloader for stage2 and make CbtDependency work correctly.Christopher Vogt2016-04-021-12/+4
| | | | This fixes the issues with crashes loading stage2 introduces in 57de43907e05d4cd3986e2994e0e3bff93e09b4e. Also should be faster when using nailgun.
* Classloaders aren't referentially transparent, so we should not compare them ↵Christopher Vogt2016-04-021-1/+1
| | | | structurally. (didn't cause any problem right now, but could some day)
* Makes zinc usage smarter, so we do not need to call it when no files changed ↵Christopher Vogt2016-03-301-10/+14
| | | | | | (and safe up to 0.1s for each call) There still seem to be 2 bugs related to CBT development in the code. One if you simpy save a stage1 file unchanged and re-run cbt, it fails to call Stage2.run reflectively. Also in case of compile errors in stage1, a TrappedExitCode exception is thrown and not caught.
* Typed passing of values from Stage1 to Stage2Christopher Vogt2016-03-301-26/+51
| | | | (thing can still be cleaned up)
* replace Scala reflection with Java reflection seems to fix the weird ↵Christopher Vogt2016-03-281-1/+0
| | | | exceptions that happened in the previous commit. Also gets rid of scala.reflect dependency in stage2.
* Early classloading improvementsChristopher Vogt2016-03-281-13/+10
| | | | | | | | | - Changed launcher to already load zinc - use code generation to generate necessary dependencies - changed resolver to linearize dependency DAG in a way that guarantees that every transitive dependee of a node in the DAG is a transitive dependee of that node in the linear sequence - move exit code trapping code into java so it can be used for zinc early There seems to be a bug in this version, where CBT crashes about half of the time with a "object is not an instance of declaring class" Exception during running the task from the build object via reflection.
* better handle classloaders for watchservice and reflect. even more speedup.Christopher Vogt2016-03-201-5/+26
|
* Refactored ClassLoaderCache to use key locked cache to pave the way for ↵Christopher Vogt2016-03-191-2/+5
| | | | caching classloaders hierarchically without deadlocks
* move decision about admin tasks or not from bash into ScalaChristopher Vogt2016-03-191-10/+2
|
* Separate CheckAliveChristopher Vogt2016-03-191-6/+0
|
* Add support for git dependenciesChristopher Vogt2016-03-181-1/+1
| | | | pair coded with @chavxo
* Add feature for starting the Scala REPL in arbitrary versions, propagate ↵Christopher Vogt2016-03-091-2/+4
| | | | logger as implicits
* cleanup: whitespace changes, separated more things into their own files, use ↵Christopher Vogt2016-03-071-2/+2
| | | | ++ for strings everywhere. Added ++ method to File and URL and use it in many places
* trap and pass exit codes throug the app, pass logger on to tests, remove the ↵Christopher Vogt2016-03-061-13/+13
| | | | lib. qualification from Stage1 for better readability
* Make Init private so its not a part of the public interface.Matt Farmer2016-03-061-1/+1
|
* Some style cleanups in Stage1.Matt Farmer2016-03-051-36/+47
|