aboutsummaryrefslogtreecommitdiff
path: root/scripts/guix-data-service-process-job.in
Commit message (Collapse)AuthorAge
* Remove drain? #t from process jobChristopher Baines2024-01-18
| | | | As it now uses more fibers.
* Add meaningful parallelism to processing jobsChristopher Baines2024-01-18
| | | | | | | | | | | Make parallel use of inferiors when computing channel instance derivations, and when extracting information about a revision. This should allow for some horizontal scalability, reducing the impact of additional systems for which derivations need computing. This commit also fixes an apparent issue with package replacements, as previously the wrong id was used, and this hid some issues around deduplication.
* Set %file-port-name-canonicalization when processing jobsChristopher Baines2023-12-04
| | | | Just in case this helps with performance.
* Use fibers when processing new revisionsChristopher Baines2023-11-05
| | | | | | | | Just have one fiber at the moment, but this will enable using fibers for parallelism in the future. Fibers seemed to cause problems with the logging setup, which was a bit odd in the first place. So move logging to the parent process which is better anyway.
* Allow skipping processing system testsChristopher Baines2023-02-08
| | | | | | | | | | | Generating system test derivations are difficult, since you generally need to do potentially expensive builds for the system you're generating the system tests for. You might not want to disable grafts for instance because you might be trying to test whatever the test is testing in the context of grafts being enabled. I'm looking at skipping the system tests on data.guix.gnu.org, because they're not used and quite expensive to compute.
* Remove development code from the process job scriptChristopher Baines2020-09-28
|
* Add a JSON page for repository branchesChristopher Baines2020-09-27
|
* Replace debug-set! with setenv COLUMNSChristopher Baines2020-09-26
| | | | As that actually seems to work.
* Change the locale codeset representationChristopher Baines2020-09-26
| | | | | | | | | | | From the normalized one, to the one actually contained within glibc. Recent versions of glibc also contain symlinks linking the normalized codeset to the locales with the .UTF-8 ending, but older ones do not. Maybe handling codeset normalisation for queries would be good, but the locale values ending in .UTF-8 are more compatible and allow the code to be simplified. For querying, maybe there should be a locales table which handles different representations.
* Set the locale at the start of the process jobs scriptChristopher Baines2020-09-20
| | | | | | This might help with the odd [1] errors regarding PostgreSQL queries. 1: invalid byte sequence for encoding "UTF8":
* Increase the stack trace width when processing jobsChristopher Baines2020-09-20
| | | | As this might result in more useful error messages.
* Add a process-job commandChristopher Baines2019-07-12
This allows easily processing an individual job by id. This may be useful to use manually, but also when processing jobs in parallel, as forking doesn't work well with the libpq library used by squee.