aboutsummaryrefslogtreecommitdiff
path: root/bin/cuirass.in
Commit message (Collapse)AuthorAge
* base: Let sqlite handle deduplication of the list of pending derivations.Ludovic Courtès2018-04-05
| | | | | | | | | | | | | | | | | | | | | | | | | Previously we would make a SQL query that would return many build jobs, and then call 'delete-duplicates' on that. This was extremely wasteful because the list of returned by the query was huge leading to a heap of several tens of GiB on a big database, and 'delete-duplicates' would lead to more GC and it would take ages. Furthermore, since 'delete-duplicates' is written in C as of Guile 2.2.3, it is uninterruptible from Fiber's viewpoint. Consequently, the kernel thread running the 'restart-builds' fiber would never schedule other fibers, which could lead to deadlocks--e.g., since fibers are scheduled on a circular shuffled list of kernel threads, once every N times, a web server fiber would be sent to that kernel thread and not be serviced. * src/cuirass/base.scm (shuffle-jobs): Remove. (shuffle-derivations): New procedure. (spawn-builds): Take a list of derivations instead of a list of jobs. (restart-builds): Remove 'builds' parameter. Remove 'delete-duplicates' call. Remove done/remaining partitioning. (build-packages): Adjust to pass 'spawn-builds' a list of derivations. * bin/cuirass.in (main): Remove computation of PENDING. Remove second parameter in call to 'restart-builds'.
* cuirass: Line-buffer stdout and stderr.Ludovic Courtès2018-03-25
| | | | * bin/cuirass.in (main): Add 'setvbuf' calls.
* cuirass: Clear the build queue when starting.Ludovic Courtès2018-02-14
| | | | | * src/cuirass/base.scm (clear-build-queue): New procedure. * bin/cuirass.in (main): Call it.
* cuirass: Add '--threads' and put an upper bound on the default.Ludovic Courtès2018-02-05
| | | | | * bin/cuirass.in (show-help, %options): Add "--threads". (main): Honor it. Pass #:parallelism to 'run-fibers'.
* cuirass: Log resource usage statistics regularly.Ludovic Courtès2018-01-29
| | | | | * src/cuirass/logging.scm (log-monitoring-stats): New procedure. * bin/cuirass.in (main): Add a fiber that calls it regularly.
* cuirass: Place web server fiber on its own core.Ludovic Courtès2018-01-27
| | | | | * bin/cuirass.in (main): Pass #:parallel? to 'spawn-fiber' for the web server.
* cuirass: Add 'essential-task' and wrap the main fibers in it.Ludovic Courtès2018-01-27
| | | | | * src/cuirass/utils.scm (essential-task): New procedure. * bin/cuirass.in (main): Wrap each fiber in 'essential-task'.
* cuirass: Reduce Fiber's tick rate.Ludovic Courtès2018-01-26
| | | | * bin/cuirass.in (main): Pass #:hz to 'run-fibers'.
* cuirass: Catch exceptions in the main fiber and stop everything.Ludovic Courtès2018-01-26
| | | | | | * bin/cuirass.in (main): Add 'exit-channel' and read from it. Catch exceptions in the main fiber and write to that channel upon error.
* cuirass: Log pending build request.Ludovic Courtès2018-01-26
| | | | * bin/cuirass.in (main): Print message while fetching pending builds.
* cuirass: Fix scope mismatch.Ludovic Courtès2018-01-23
| | | | | | | | | | Previously STORE would be closed on the first context switch, before 'restart-builds' has completed, leading to an error (writing to a closed port). * src/cuirass/base.scm (restart-builds): Remove 'store' parameter. Wrap body in 'with-store'. * bin/cuirass.in (main): Adjust accordingly.
* cuirass: Add missing import.Ludovic Courtès2018-01-23
| | | | * bin/cuirass.in: Import (guix store).
* base: Restart pending builds upfront.Ludovic Courtès2018-01-23
| | | | | | | | * src/cuirass/database.scm (db-get-builds)[format-where-clause]: Honor (status pending) filter. * src/cuirass/base.scm (restart-builds): New procedure. * bin/cuirass.in (main): Fetch pending builds. Start fiber that invokes 'restart-builds' on them.
* Call 'run-cuirass-server' outside of a fiber.Ludovic Courtès2018-01-23
| | | | | | | | This seems to fix a bug whereby the server would never process the FD returned by 'accept'. * bin/cuirass.in (main): Move 'run-cuirass-server' outside of 'spawn-fiber'.
* Introduce concurrency with Fibers.Ludovic Courtès2018-01-22
| | | | | | | | | | | | | | | * README: Mark Fibers as required. * configure.ac: Check for Guile 2.2 only. Check for (fibers). * bin/cuirass.in (main): Use (fibers). Run 'process-specs' and web server in separate fibers. * src/cuirass/base.scm (with-store): New macro. (non-blocking-port): New procedure. (evaluate): Use 'non-blocking-port'. Use 'read-string' followed by 'read'. (process-specs): Move 'db-add-stamp' right after 'string=?' comparison. Run evaluation and subsequent builds in a separate fiber. * src/cuirass/http.scm (run-cuirass-server): Pass 'fibers as the second argument to 'run-server'. Use 'log-message' instead of 'format'. * src/cuirass/database.scm (with-database): Remove 'dynamic-wind'.
* Initialize libgit's TLS certificate directory once and for all.Ludovic Courtès2018-01-22
| | | | | | * src/cuirass/base.scm (prepare-git): New procedure. Body moved from... (process-specs): ... here. Remove it. * bin/cuirass.in (main): Call 'prepare-git'.
* cuirass: Add --listen command line option.Jan Nieuwenhuizen2017-09-18
| | | | | | | | * bin/cuirass.in (show-help): Add help for --listen option. (%options): Add listen option. (main): Pass host to run-cuirass-server. * doc/cuirass.texi (Invocation): Add --listen option. * src/cuirass/http.scm (run-cuirass-server): Add named #:host parameter.
* cuirass: Add fallback parameter.Mathieu Othacehe2017-07-12
| | | | | | | | * src/cuirass/base.scm (%fallback?): New exported parameter. (process-specs)[set-build-options]: Pass fallback parameter. * bin/cuirass.in (%options): Add fallback. (main): Set %fallback? parameter. (show-help): Update.
* cuirass: Stop λ/lambda mixing.Mathieu Othacehe2017-07-06
| | | | | | | | | | | | | * bin/cuirass.in: Replace λ by lambda. * bin/evaluate.in: Ditto. * build-aux/guix.scm: Ditto. * examples/gnu-system.scm: Ditto. * examples/guix-track-git.scm: Ditto. * src/cuirass.scm: Ditto. * src/cuirass/base.scm: Ditto. * src/cuirass/database.scm: Ditto. * src/cuirass/ui.scm: Ditto. * src/cuirass/utils.scm: Remove λ* macro.
* utils: Remove useless procedures.Mathieu Othacehe2017-07-01
| | | | | | | | | | | * src/cuirass/utils.scm (mkdir-p, make-user-module, call-with-temporary-directory, with-directory-excursion): Remove because already defined in guix. * tests/utils (with-directory-excursion): Remove associated test. * src/cuirass/base.scm: Use (guix build utils) to provide procedure removed from (cuirass utils). * bin/evaluate.in: Ditto. * bin/cuirass.in: Use "make-user-module" provided by (guix ui).
* cuirass: Add "--load-path" option.Mathieu Othacehe2017-01-29
| | | | | | | | | | | | * bin/cuirass.in (%options): Add "--load-path" and "-L" command line options. (show-help): Adapt. * src/cuirass/base.scm (%guix-package-path): New parameter. (set-guix-package-path!): New procedure. (evaluate): Call "evaluate" script with '%guix-package-path'. * bin/evaluate.in (main): Match 'guix-package-path' command line argument and handle it. Signed-off-by: Mathieu Lirzin <mthl@gnu.org>
* cuirass: Add "--port" command line option.Mathieu Lirzin2016-12-28
| | | | | | | | * bin/cuirass.in (%options): Add "--port" and "-p" command line options. (show-help): Adapt. (main): Set default to 8080. Call 'run-cuirass-server' with this. * src/cuirass/http.scm (run-cuirass-server): Display the port number. * doc/cuirass.texi (Invocation): Document new option.
* build: Set Guile load paths in 'pre-inst-env'.Mathieu Lirzin2016-12-28
| | | | | | | | | | | | | | | | This reverts most of 4f0d665746e0c6efe43c0f281e0eaac5012c79da. The load paths are still hard coded after installation, however 'pre-inst-env' wrapper is used for defining them in the local build environment. This is more convenient for running the tests manually or launching a Guile REPL with all the Cuirass modules accessible. * build-aux/pre-inst-env.in (GUILE_LOAD_PATH, GUILE_LOAD_COMPILED_PATH): New variables. * bin/cuirass.in: Comment Guile load paths. * Makefile.am (local_load_path, local_load_compiled_path): Delete. (AM_TESTS_ENVIRONMENT): Don't set Guile load paths. (do_subst): Use install directories for Guile load paths. (install-exec-hook): Uncomment 'cuirass' hard coded load paths.
* cuirass: Hard code Guile load paths.Mathieu Lirzin2016-11-12
| | | | | | | | | | | | | * configure.ac (bin/cuirass, bin/evaluate): Let 'make' generate them. * bin/cuirass.in: Hard code load paths to find Cuirass modules. * Makefile.am (do_subst): Update substitution. (bin/cuirass, bin/evaluate): New rules. (EXTRA_DIST): Distribute 'bin/cuirass.in' and 'bin/evaluate.in'. (MOSTLYCLEANFILES): Add '$(bin_SCRIPTS)'. (install-exec-hook): New target. (local_load_path, local_load_compiled_path): New variables. (AM_TESTS_ENVIRONMENT): Set Guile load paths. * build-aux/pre-inst-env.in: Don't modify Guile load paths.
* cuirass: Run HTTP server.Mathieu Lirzin2016-11-03
| | | | | | * src/cuirass.scm: Re-export (cuirass http) module. * bin/cuirass.in (main): Run HTTP server and move the 'process-specs' loop in another thread.
* cuirass: Check specifications from the database inside the loop.Mathieu Lirzin2016-11-03
| | | | * bin/cuirass (main): Remove 'let' before main loop.
* cuirass: Optionally support using of substitutes.Jan Nieuwenhuizen2016-09-23
| | | | | | | | * bin/cuirass.in (options): Add --use-substitutes. (show-help): Idem. (main): Set %use-substitutes?. Signed-off-by: Mathieu Lirzin <mthl@gnu.org>
* cuirass: Use 'let' instead of 'let*'.Mathieu Lirzin2016-08-02
| | | | * bin/cuirass.in (main): Use 'let' instead of 'let*'.
* Add (cuirass) module.Mathieu Lirzin2016-08-02
| | | | | | | | | | * src/cuirass.scm: New file. * Makefile.am (guilesitedir, dist_guilesite_DATA) (nodist_guilesite_DATA): New variables. (pkgmoduledir): Refer to 'guilesitedir'. (CLEANFILES): Add 'nodist_guilesite_DATA'. * bin/cuirass.in: Use (cuirass) module. * bin/evaluate.in: Likewise.
* cuirass: Move procedures to (cuirass base) module.Mathieu Lirzin2016-07-27
| | | | | | * bin/cuirass.in (fetch-repository, compile, evaluate, build-packages) (process-specs): Move to ... src/cuirass/base.scm: ... here.
* cuirass: show-help: Use 'poll' terminology.Mathieu Lirzin2016-07-27
| | | | * bin/cuirass.in (show-help): Use 'poll' terminology.
* cuirass: Modify default interval value.Mathieu Lirzin2016-07-27
| | | | * bin/cuirass.in (main): Change default interval value.
* cuirass: Make specification argument optional.Mathieu Lirzin2016-07-27
| | | | | | | * bin/cuirass.in (%options): Add 'specifications' option. (main): Use it instead of the non-option command line arguments. (show-help): Adapt. * README (Example): Adapt.
* Use stamps to poll repositories.Mathieu Lirzin2016-07-26
|
* database: Add 'db-add-build' procedure.Mathieu Lirzin2016-07-25
|
* evaluate: Store evaluations in evaluate script.Mathieu Lirzin2016-07-25
|
* cuirass: Use database to store specifications.Mathieu Lirzin2016-07-25
|
* cuirass: evaluate: Fix docstring.Mathieu Lirzin2016-07-25
|
* evaluate: Use 'read' instead of 'eval-string'.Mathieu Lirzin2016-07-25
|
* schema: Separate 'Evaluations' from 'Builds'.Mathieu Lirzin2016-07-25
| | | | Adapt src/cuirass/database.scm and its tests.
* maint: Update file headers.Mathieu Lirzin2016-07-25
|
* cuirass: Fix specification file error message.Mathieu Lirzin2016-07-25
|
* Move '%program-name' to (cuirass ui) module.Mathieu Lirzin2016-07-25
|
* cuirass: Fix 'show-help'.Mathieu Lirzin2016-07-14
|
* Remove unnecessary (cuirass job) module.Mathieu Lirzin2016-07-13
|
* Evaluate derivations in a separate process.Mathieu Lirzin2016-07-13
| | | | | This fixes a bug where different Guix branches gave the same derivations.
* cuirass: process-spec: Use 'when' instead of 'and'.Mathieu Lirzin2016-07-04
| | | | This is done because 'set-load-path!' returns a undefined value.
* Fix single char for 'database' in %options.Mathieu Lirzin2016-07-03
|
* cuirass: Add '--one-shot' command line argument.Mathieu Lirzin2016-07-02
|
* cuirass: Remove '--use-file' command line argument.Mathieu Lirzin2016-07-02
|
generated by cgit v1.2.3 (git 2.45.0) at 2025-02-16 15:27:57 +0000