aboutsummaryrefslogtreecommitdiff
path: root/stage2/Stage2.scala
Commit message (Collapse)AuthorAgeFilesLines
* Unify reflectively loading builds from directories.Christopher Vogt2017-03-201-6/+5
| | | | | | | | | | THis is mostly cleanup and a little bit feature. Before it was done partially in 3 places, BuildBuild, loadRoot and GitDependency. Now DirectoryDependencies also support referencing sub-builds. Also introduce scalariform for the first few files of cbt's core code :).
* fix file watching for realChristopher Vogt2017-03-121-33/+4
| | | | | | | last file watching update didn’t work well enough. This now - rips out barbary watch service as it seems buggy crashing the jvm - make cbt exclusively write files to watch to a file - uses fswatch instead watching all files in that file
* revamp loop featureChristopher Vogt2017-03-121-40/+39
| | | | | | | | | | | | | | | | | | | | | now CBT and builds pass their file names to the current build via the context. The build then simply blocks until any file changes. Then it returns with a special exit code, which the bash script picks up and restarts CBT. Thats works well for looping over project files. It works less well for looping over builds and CBT itself. For this a build has to success once, so that the .cbt-loop.tmp file exists. Then looping works for cbt and builds, but the file list is not updated in case of compile errors, etc. Fixes - https://github.com/cvogt/cbt/issues/406 - https://github.com/cvogt/cbt/issues/405 - https://github.com/cvogt/cbt/issues/202 - https://github.com/cvogt/cbt/issues/50 - https://github.com/cvogt/cbt/issues/22 We should improve for 1.0 in https://github.com/cvogt/cbt/issues/419 to handle looping over build files and cbt itself smarter.
* treat subdirectores as subbuilds via cmd lineChristopher Vogt2017-02-221-2/+2
|
* allow DirectoryDependencies on BuildBuildsChristopher Vogt2017-02-181-3/+3
| | | | | | | | | this fixes a bug where finalBuild would over eagerly go down all the way down to the outermost build instead of stopping at the one requested. Now it checks the new argument and stops there. This is necessary to allow having one build depend on another build in order to embed it in a type-safe way and have access to it’s tasks.
* simplify and add features to reflective task lookup codeChristopher Vogt2017-02-181-6/+2
| | | | | | | | | | | | | Code is much simpler now. Now cbt sub-tasks are separated by . instead of spaces to unify the syntax with method calls Scala. Also the reflective code now works not only on builds but any kind of values, so zero argument members of any types of return values can simply be called. This is also a large step towards detangling the reflective lookup from cbt and turning it into a fully fletched shell to Scala "native" call solution.
* Add support for nested builds and use it to replace cross compilationChristopher Vogt2017-02-131-12/+2
| | | | | | | | command which was previously hard-coded This will allow multi-project builds, too but we should first fix caching across instances and GitDependencies on sub-builds within other repositories.
* let Stage1 handle Stage2 exit codeChristopher Vogt2017-02-091-2/+5
|
* idempotent change propagationChristopher Vogt2017-02-091-2/+2
| | | | | | using lastModified instead of a non-idempotent needsUpdate flag this fixes a bug where dependees would not be rebuilt if cbt exited or was killed after dependencies were already rebuilt.
* memoize task results across classes within a single runChristopher Vogt2017-02-091-2/+2
|
* replace flawed concurrent hashmap cache with consistent replacementChristopher Vogt2017-02-011-2/+3
| | | | | | | | | | | | | | | | | | | | | | | The concurrent hashmap approach to classloader caching was flawed. Assume you have two concurrently running builds A and B and projects P2 and P3 depending on project P1. And assume a time sequence where A compiles P1, then compiles P2, then P1’s sources change, then B compiles P1, then A compiles P3. At the end P2 and P3 will have different versions of P1 as their parent classloaders. This is inconsistent. The easiest way to work around this is making sure only one thread is changing the classloader cache during it’s entire run. This would mean either no concurrency or what we have done here, which is letting threads work on a copy of the cache and replace the original cache in the end using an atomic operation. This means the thread that finishes last wins, but for caching that’s fine. Worst case some things aren’t cached in a concurrent execution. This change also means that we don’t need concurrent hashmaps for the classloader cache anymore since no two theads will access the same hashmap. We still need a concurrent hashmap for the class caches inside of the classloaders as multiple threads can access the same classloaders.
* Merge separate hashmaps for persistent cache into oneChristopher Vogt2017-02-011-2/+1
| | | | | | | This isn’t type-safe, but re-using that same hashmap for both keys and classloaders allows to reduce the number of members in Context. Also we can re-use the same hashMap for other things as well in the coming commits, e.g. timestamps.
* fixes interacting with BuildBuilds from the cli and cleans up.Christopher Vogt2016-11-131-1/+1
| | | | | Before this when doing `build/$ cbt dependencies` cbt would not show up because cbt would be using a BaseBuild, not a BuildBuild. Not it does.
* small refactoring simplifying Stage2Christopher Vogt2016-11-131-7/+2
|
* Remove version from context, we can now use dynamic overridesChristopher Vogt2016-11-091-1/+0
|
* add context based task result cacheChristopher Vogt2016-11-081-0/+1
|
* filter out 'direct' meta task earlier from the argsChristopher Vogt2016-11-081-2/+1
|
* fix task name appearing in args (#132)Christopher Vogt2016-09-131-1/+1
|
* Get rid of Build default imports to reduce noise in build files. This also ↵Christopher Vogt2016-06-151-4/+0
| | | | changes builds from using immutable.Seq to using Predef.Seq in favor of simplicity over purity. This has been discussed on gitter.
* read sonatype credentials from cbt installation, not from other checked out ↵Christopher Vogt2016-05-261-0/+1
| | | | version
* fix exit code returnChristopher Vogt2016-04-291-6/+6
|
* Fix use compatibility interfaces from main cbtChristopher Vogt2016-04-291-3/+1
|
* Fix building cbt as a cbt projectChristopher Vogt2016-04-291-1/+1
|
* Reproducible builds, composing different CBT version and various improvementsChristopher Vogt2016-04-281-5/+31
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | One large commit, because it is was hard to do these things in isolation or to separate them now. CBT now knows how to load other versions of itself - Support for reproducible builds (!), by providing a CBT git URL and hash to tie build to - Support for composing builds using different CBT versions (!) - introduce (in compatibility/) Java interfaces all CBT versions need to stay compatible with, so they can talk to each other. And put extension methods to these interfaces in cbt package object Class loading - add some sanity checks for class loading - improve class loader invalidation to fix bugs - implement caching in Java land class loaders. In particular to prevent the system class loader to repeatedly generate ClassNotFound exceptions in each sink of the class loader DAG for non JDK classes (meaning major speed up for projects with many classes). - getting rid of transient class loader cache unifying into "persistent" one instead (which is still wrong as invalidation eventually needs to invalidate entire sub graphs of the class loading DAG, not single class loaders. Seems like we'll have to abandon the hashmap based approach and tie caching to dependency objects) Other Caching - cache dependencies extracted from xml files, which was one major time killer, but invalidate cache when cbt changed (maven dependency user facing api needs simplification now!) - memorize last successful compile time in the file system rather than memory, to guard against unnecessary recompiling even across launches (or when using cbt direct) Structural improvements - Factor out ClassLoaderCache on Java land into its own class. - Port MultiClassLoader to Java land, to better compose classloaders in NailgunLauncher. - Remove many global constants and variables (in object paths and in NailgunLauncher) and pass them through instead. Needed for composing of builds. - move more code from resolver into Lib for less entanglement with classes (needed to compatibility interfaces) and better re-usability - remove canBeCached. Everything can be cached now, but we need to be careful about correct invalidation. - remove build announcing produced jars. We can add if ever needed. - change callNullary to return exit code instead of Unit as preparation for next commit introducing "recursive" ScalaTest - Makes ScalaTest support work (still a bit too inflexible, but mostly works well)
* cross building and automatic snaphot idsChristopher Vogt2016-04-071-3/+16
| | | | | Adds support for cross building for multiple scala versions And for automatically appending -SNAPSHOT to the id, when publishing a snapshot.
* Pass ClassLoaderCache from stage1 to stage2 instead of wrongly creating ↵Christopher Vogt2016-04-061-1/+1
| | | | another one. This should improve behavior of transient cache.
* Correctly interact with build in cwd instead of loading it's managed build ↵Christopher Vogt2016-04-061-4/+3
| | | | in case of a BuildBuild.
* Finally get rid of JDK 8 dependenciesChristopher Vogt2016-04-041-4/+2
|
* propagate info if cbt has changed across builds, so they can be re-compiledChristopher Vogt2016-04-021-1/+1
|
* Typed passing of values from Stage1 to Stage2Christopher Vogt2016-03-301-14/+12
| | | | (thing can still be cleaned up)
* replace Scala reflection with Java reflection seems to fix the weird ↵Christopher Vogt2016-03-281-2/+3
| | | | exceptions that happened in the previous commit. Also gets rid of scala.reflect dependency in stage2.
* Refactored ClassLoaderCache to use key locked cache to pave the way for ↵Christopher Vogt2016-03-191-1/+1
| | | | caching classloaders hierarchically without deadlocks
* re-enable usage page testsChristopher Vogt2016-03-111-2/+1
|
* fix compile looking to only trigger on the provided files, not other files ↵Christopher Vogt2016-03-091-2/+4
| | | | in the same directories
* cleanup: whitespace changes, separated more things into their own files, use ↵Christopher Vogt2016-03-071-2/+2
| | | | ++ for strings everywhere. Added ++ method to File and URL and use it in many places
* trap and pass exit codes throug the app, pass logger on to tests, remove the ↵Christopher Vogt2016-03-061-21/+22
| | | | lib. qualification from Stage1 for better readability
* Impl readability improvements in Stage2Matt Farmer2016-03-061-14/+25
|
* Some style cleanups in Stage1.Matt Farmer2016-03-051-2/+2
|
* CBT Version 1.0-BETAChristopher Vogt2016-03-041-0/+47