summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAge
* cuirass: Place web server fiber on its own core.Ludovic Courtès2018-01-27
| | | | | * bin/cuirass.in (main): Pass #:parallel? to 'spawn-fiber' for the web server.
* cuirass: Add 'essential-task' and wrap the main fibers in it.Ludovic Courtès2018-01-27
| | | | | * src/cuirass/utils.scm (essential-task): New procedure. * bin/cuirass.in (main): Wrap each fiber in 'essential-task'.
* http: Reject methods other than GET.Ludovic Courtès2018-01-26
| | | | | * src/cuirass/http.scm (url-handler): Check whether REQUEST's method is 'GET, and return 405 if not.
* http: Provide the correct values for 'finished' and 'busy'.Ludovic Courtès2018-01-26
| | | | | | | | This should placate 'guix-hydra-queued-builds', for instance, which checks these values to choose between "Running" and "Scheduled". * src/cuirass/http.scm (build->hydra-build): Provide the correct value for #:finished and #:busy.
* database: Open the database in "write-ahead log" mode.Ludovic Courtès2018-01-26
| | | | | | | Suggested by Ricardo Wurmus. * src/cuirass/database.scm (wal-mode): New procedure. (db-open): Use it.
* base: 'build-event-output-port' no longer reads past the buffer.Ludovic Courtès2018-01-26
| | | | | | | | | Fixes a bug whereby 'build-event-output-port' would sometimes read more than COUNT from BV, which would usually result in a 'decoding-error' exception from 'utf8->string'. * src/cuirass/base.scm (build-event-output-port)[write!]: Use 'bytevector-range' to honor COUNT and OFFSET.
* utils: Add 'bytevector-range'.Ludovic Courtès2018-01-26
| | | | | * src/cuirass/utils.scm (%weak-references): New variable. (bytevector-range): New procedure.
* base: Make repository fetching and compilation non-blocking.Ludovic Courtès2018-01-26
| | | | | | | | Previously these calls would effectively suspend execution of all the fibers until they had completed. * src/cuirass/base.scm (process-specs): Wrap 'fetch-repository' and 'compile' calls in 'non-blocking'.
* utils: Add 'non-blocking' macro.Ludovic Courtès2018-01-26
| | | | | * src/cuirass/utils.scm (%non-blocking): New procedure. (non-blocking): New macro.
* cuirass: Reduce Fiber's tick rate.Ludovic Courtès2018-01-26
| | | | * bin/cuirass.in (main): Pass #:hz to 'run-fibers'.
* cuirass: Catch exceptions in the main fiber and stop everything.Ludovic Courtès2018-01-26
| | | | | | * bin/cuirass.in (main): Add 'exit-channel' and read from it. Catch exceptions in the main fiber and write to that channel upon error.
* logging: Add 'with-time-logging' and use it.Ludovic Courtès2018-01-26
| | | | | | * src/cuirass/logging.scm (call-with-time-logging): New procedure. (with-time-logging): New macro. * src/cuirass/http.scm (handle-builds-request): Use it.
* cuirass: Log pending build request.Ludovic Courtès2018-01-26
| | | | * bin/cuirass.in (main): Print message while fetching pending builds.
* http: Run test within 'run-fibers'.Ludovic Courtès2018-01-26
| | | | * tests/http.scm ("http")["cuirass-run"]: Run server with 'run-fibers'.
* base: Do not restart builds that turn out to have succeeded already.Ludovic Courtès2018-01-26
| | | | | * src/cuirass/base.scm (restart-builds): Mark as succeeded the subset of VALID with at least one valid output.
* base: Do not pass bogus store file names to 'db-update-build-status!'.Ludovic Courtès2018-01-26
| | | | | | * src/cuirass/base.scm (handle-build-event)[valid?]: New procedure. Use it when handling 'build-started', 'build-succeeded', and 'build-failed' events.
* http: Log incoming connections and requests.Ludovic Courtès2018-01-26
| | | | | * src/web/server/fiberized.scm (socket-loop): Add 'log-message' call. * src/cuirass/http.scm (url-handler): Likewise.
* http: Use our own 'fiberized' web server backend.Ludovic Courtès2018-01-25
| | | | | | * src/web/server/fiberized.scm: New file. * Makefile.am (dist_pkgmodule_DATA): Add it. * src/cuirass/http.scm (run-cuirass-server): Use it.
* base: Delete duplicate builds when restarting them.Ludovic Courtès2018-01-25
| | | | | * src/cuirass/base.scm (build-derivation=?): New procedure. (restart-builds): Call 'delete-duplicates' on BUILDS.
* base: Remove unneeded import.Ludovic Courtès2018-01-25
| | | | * src/cuirass/base.scm: Remove unneeded #:use-module.
* http: Sort /api/latestbuilds and /api/queue by time.Ludovic Courtès2018-01-25
| | | | | | | * src/cuirass/database.scm (db-get-builds)[format-order-clause]: Add 'order' clauses. * src/cuirass/http.scm (url-handler): Default to (order finish-time) for /latestbuilds and (order submission-time) for /queue.
* database: Turn 'sqlite-exec' into a macro.Ludovic Courtès2018-01-25
| | | | | * src/cuirass/database.scm (%sqlite-exec): New procedure. (sqlite-exec): New macro.
* base: Build derivations in batches.Ludovic Courtès2018-01-25
| | | | | | | | This works around a scalability issue in guix-daemon when passing a long list of derivations to 'build-derivations'. * src/cuirass/base.scm (spawn-builds): New procedure. (restart-builds, build-packages): Use it.
* http: Adjust test to include #:derivation.Ludovic Courtès2018-01-25
| | | | | | This is a followup to commit c89c117c12792cbc4996035feb670c2535dcb105. * tests/http.scm (build-query-result): Add #:derivation.
* base: Buffer input pipe of the 'evaluate' process.Ludovic Courtès2018-01-25
| | | | * src/cuirass/base.scm (read/non-blocking): Add 'setvbuf' call.
* base: Extract 'read/non-blocking'.Ludovic Courtès2018-01-25
| | | | | * src/cuirass/base.scm (read/non-blocking): New procedure. (evaluate): Use it instead of inline code.
* database: 'db-update-build-status!' takes a #:log-file parameter.Ludovic Courtès2018-01-24
| | | | | | * src/cuirass/database.scm (sqlite-exec): Use (ice-9 format). (db-update-build-status!): Add #:log-file parameter and honor it. * tests/database.scm ("database")["db-update-build-status!"]: Test it.
* base: Be more verbose about restarted builds.Ludovic Courtès2018-01-24
| | | | | | | * src/cuirass/base.scm (handle-build-event): Remove unused 'log-port' parameter. (restart-builds): Wrap 'build-derivations' in 'guard'. Add 'log-message' calls.
* ui: Bump copyright year in '--version' output.Ludovic Courtès2018-01-24
| | | | * src/cuirass/ui.scm (show-version): Update year.
* http: /build: Include the derivation.Ludovic Courtès2018-01-24
| | | | * src/cuirass/http.scm (build->hydra-build): Add #:derivation.
* base: Populate the 'Outputs' table.Ludovic Courtès2018-01-24
| | | | | | | | | Fixes a regression introduced in d7306a4f48a666a008091bfeb94d1fdb32b46948 whereby 'register' would pass the empty list as #:outputs to 'db-add-build'. * src/cuirass/base.scm (build-packages)[register]: Always include outputs.
* http: /build: Gracefully handle empty output list.Ludovic Courtès2018-01-24
| | | | * src/cuirass/http.scm (url-handler): Add case for empty #:outputs.
* base: Always set 'keep-going' when opening the store.Ludovic Courtès2018-01-23
| | | | | | | | Previously 'restart-builds' would lack it, for instance. * src/cuirass/base.scm (process-specs): Move 'set-build-options' call to... (with-store): ... here.
* cuirass: Fix scope mismatch.Ludovic Courtès2018-01-23
| | | | | | | | | | Previously STORE would be closed on the first context switch, before 'restart-builds' has completed, leading to an error (writing to a closed port). * src/cuirass/base.scm (restart-builds): Remove 'store' parameter. Wrap body in 'with-store'. * bin/cuirass.in (main): Adjust accordingly.
* cuirass: Add missing import.Ludovic Courtès2018-01-23
| | | | * bin/cuirass.in: Import (guix store).
* http: Implement /api/queue.Ludovic Courtès2018-01-23
| | | | | | | | * src/cuirass/http.scm (url-handler): Add /api/queue handler. * tests/http.scm ("http"): Add a BUILD2 and DERIVATION2, and rename BUILD and DERIVATION accordingly. ("/build/2", "/build/2/log/raw"): Rename to /42. ("/api/queue?nr=100"): New test.
* base: Restart pending builds upfront.Ludovic Courtès2018-01-23
| | | | | | | | * src/cuirass/database.scm (db-get-builds)[format-where-clause]: Honor (status pending) filter. * src/cuirass/base.scm (restart-builds): New procedure. * bin/cuirass.in (main): Fetch pending builds. Start fiber that invokes 'restart-builds' on them.
* http: /api/latestbuilds only returns finished builds.Ludovic Courtès2018-01-23
| | | | | | | * src/cuirass/database.scm (db-get-builds)[format-where-clause]: Honor (status done) filter. * src/cuirass/http.scm (url-handler): Always add (status done) to the filters passed to 'handle-builds-request'.
* database: Use US spelling for "canceled".Ludovic Courtès2018-01-23
| | | | | * src/cuirass/database.scm (build-status): Use US spelling for "canceled".
* base: Add missing argument.Ludovic Courtès2018-01-23
| | | | | * src/cuirass/base.scm (build-packages): In 'filter-map' call, add missing argument to 'db-get-build'.
* base: Use 'log-message' some more.Ludovic Courtès2018-01-23
| | | | | * src/cuirass/base.scm (build-packages): Use 'log-message' instead of 'format'.
* base: Update build status and start/stop time according to build log.Ludovic Courtès2018-01-23
| | | | | | | | | | | Now the database is updated as things are built, rather than after the whole batch of derivation builds has completed. * src/cuirass/base.scm (handle-build-event): Call 'db-update-build-status!'. (build-packages)[register]: Set #:starttime and #:stoptime to 0. Set #:status to 'scheduled'. Define 'build-ids' and use it to determine the overall result.
* database: Add 'db-update-build-status!'.Ludovic Courtès2018-01-23
| | | | | | | | | * src/cuirass/database.scm (build-status): Add 'scheduled' and 'started'. (db-add-build): Make sure #:timestamp, #:starttime, #:stoptime, and #:status are integers. (db-update-build-status!): New procedure. * tests/database.scm ("database")["db-update-build-status!"]: New test.
* tests: Fix malformed Emacs local variable line.Ludovic Courtès2018-01-23
| | | | * tests/database.scm: Add missing "eval:".
* Add a 'build-status' enumeration.Ludovic Courtès2018-01-23
| | | | | | | * src/cuirass/utils.scm (define-enumeration): New macro. * src/cuirass/database.scm (build-status): New macro. * src/cuirass/base.scm (build-packages)[hydra-build-status]: Remove. Use the 'build-status' macro instead.
* Call 'run-cuirass-server' outside of a fiber.Ludovic Courtès2018-01-23
| | | | | | | | This seems to fix a bug whereby the server would never process the FD returned by 'accept'. * bin/cuirass.in (main): Move 'run-cuirass-server' outside of 'spawn-fiber'.
* Fix scope mismatch.Ludovic Courtès2018-01-23
| | | | | * src/cuirass/base.scm (process-specs): Add new 'with-database' within the fiber.
* Introduce concurrency with Fibers.Ludovic Courtès2018-01-22
| | | | | | | | | | | | | | | * README: Mark Fibers as required. * configure.ac: Check for Guile 2.2 only. Check for (fibers). * bin/cuirass.in (main): Use (fibers). Run 'process-specs' and web server in separate fibers. * src/cuirass/base.scm (with-store): New macro. (non-blocking-port): New procedure. (evaluate): Use 'non-blocking-port'. Use 'read-string' followed by 'read'. (process-specs): Move 'db-add-stamp' right after 'string=?' comparison. Run evaluation and subsequent builds in a separate fiber. * src/cuirass/http.scm (run-cuirass-server): Pass 'fibers as the second argument to 'run-server'. Use 'log-message' instead of 'format'. * src/cuirass/database.scm (with-database): Remove 'dynamic-wind'.
* database: Change default file name to /var/run/cuirass/cuirass.db.Ludovic Courtès2018-01-22
| | | | | * src/cuirass/database.scm (%package-database): Change default file name from /var/cuirass.db (or similar) to /var/run/cuirass/cuirass.db.
* Improve build event logging.Ludovic Courtès2018-01-22
| | | | | * src/cuirass/base.scm (handle-build-event): Add 'build-failed'; shorten message for 'build-remote'.