aboutsummaryrefslogtreecommitdiff
path: root/guix-build-coordinator
Commit message (Collapse)AuthorAge
...
* Call wait-condition-variable with longer timeoutsChristopher Baines2023-11-15
| | | | | | The hook processing threads seem to be getting stuck in wait-condition-variable where the timeout is in the past. Maybe setting a longer timeout will help avoid this.
* Remove some caching from reading derivationsChristopher Baines2023-11-11
| | | | As I'm not sure this is helpful.
* Try to avoid the metrics endpoint timing outChristopher Baines2023-11-10
| | | | As this makes it harder to debug issues.
* Add a with-fibers-timeout utilityChristopher Baines2023-11-10
|
* Include the derivation_outputs in the data service eventChristopher Baines2023-10-16
| | | | If possible.
* Add new send-events-for-selected-builds procedureChristopher Baines2023-10-16
| | | | Which is helpful when backfilling data in the data service.
* Use start-stack in make-worker-thread-channelChristopher Baines2023-10-06
| | | | | | | | | | Not sure what this does, but it seems to work around Guile crashing in (backtrace) like: Backtrace: In guix-build-coordinator/utils/fibers.scm: Exception thrown while printing backtrace: In procedure vector-ref: Argument 2 out of range: 99
* Don't output the whole log for substituting derivationsChristopher Baines2023-08-31
| | | | Just the last bit, as it could be very long.
* Exit when the server fails to startChristopher Baines2023-08-29
| | | | To avoid the process half working.
* Replace request-builds-list by fold-buildsChristopher Baines2023-08-29
| | | | As this can wait until the stream is finished and properly close the port.
* Add more logging around hooksChristopher Baines2023-08-29
|
* Fix some logging messagesChristopher Baines2023-08-29
|
* Stop closing the ports for json seq responsesChristopher Baines2023-08-29
| | | | As this breaks reading the stream.
* Properly close the port when making client requestsChristopher Baines2023-08-23
|
* Try and ensure that the worker threads don't disappearChristopher Baines2023-08-22
| | | | Add some top level exception handling to guard against errors anywhere.
* Increase the open file limitChristopher Baines2023-08-22
| | | | To hopefully make investigating why excessive ports/open files are being used.
* Use srfi-71 in the guix-data-service moduleChristopher Baines2023-08-22
|
* Try and enable core dumpsChristopher Baines2023-08-20
|
* Pass the store in to substitute-derivationChristopher Baines2023-08-20
| | | | To avoid an additional store connection.
* Use less database read threadsChristopher Baines2023-08-20
| | | | As I'm not sure that having so many read threads is helpful.
* Use less fibers threads and cooperative schedulingChristopher Baines2023-08-20
| | | | Since I'm not sure preemption or more threads are useful.
* Include metric for file descriptorsChristopher Baines2023-08-20
|
* Switch to a more rigorous method for finding potential source refsChristopher Baines2023-08-10
|
* Ignore self output references when looking for potential source refsChristopher Baines2023-08-10
|
* Ensure references doesn't contain the empty stringChristopher Baines2023-08-10
|
* Simplify substitute-derivationChristopher Baines2023-08-10
| | | | Assume ensure-path is available.
* Fix some log outputChristopher Baines2023-08-10
|
* Name more threadsChristopher Baines2023-08-09
| | | | To help with debugging.
* Don't use threads for substituting derivationsChristopher Baines2023-08-09
| | | | Instead use non-blocking store connections like Cuirass does.
* Name the fibers threadsChristopher Baines2023-08-09
| | | | To make debugging easier.
* Fix read-derivation getting the filenameChristopher Baines2023-08-03
|
* Keep less derivation files open when reading derivationsChristopher Baines2023-08-03
| | | | | This probably isn't the main problem with having too many open files, but it might help avoid bursts of open files.
* Remove crude fetching inputs timeoutChristopher Baines2023-08-02
| | | | As this breaks builds that rely on fetching large inputs.
* Reduce fibers parallelismChristopher Baines2023-07-24
| | | | To reduce the number of threads, as lots is probably unnecessary.
* Make client requests mostly suspendableChristopher Baines2023-07-24
|
* Add some logging to the build success publish hookChristopher Baines2023-07-08
|
* Improve the build-success-publish-hook for referenced source filesChristopher Baines2023-07-07
| | | | | | | Previously it would always connect to the store and substitute the derivation if necessary. Now it checks first to see if there are some references from the outputs that aren't from the inputs, and if that's the case, it goes on to check if these are source files that need publishing.
* Try and get backtraces when current output port seems brokenChristopher Baines2023-06-04
| | | | | | | | | With the "conversion to port encoding failed" (#62590) error, I'm seeing the "error: when processing" logs, but the backtrace doesn't get logged, maybe because it's going to the current output port, which might be broken? Anyway, try sending the backtrace to the current error port, in the hope that this port is still working.
* Don't call report-bytes-hashed with #fChristopher Baines2023-05-24
| | | | Just log the line instead.
* Show backtraces for perform-upload errorsChristopher Baines2023-05-23
|
* Better handle the output hashing being completed for upload requestsChristopher Baines2023-05-23
| | | | | This currently causes an error on the server side and a timeout on the client side.
* Tweak logging around agent output submissionChristopher Baines2023-05-22
|
* Better handle upload requests with no contentChristopher Baines2023-05-22
| | | | | The idea with these is to allow the agent to resume waiting for the coordinator to finish computing the output hash.
* Fix not updating about uploads based on timeChristopher Baines2023-05-22
|
* Remove unused make-base64-output-portChristopher Baines2023-05-20
|
* Change listing builds to work as a streamChristopher Baines2023-05-19
| | | | | | | | | | Both in terms of getting the data from the database, and sending it to the client. This avoids the use of the after-id and ordering by id when listing builds, which makes listing builds faster. It does mean that the database reads may last for a while (which can be a problem), but maybe that can be addressed in other ways.
* Speed up listing buildsChristopher Baines2023-05-17
| | | | | Remove the complicated JOIN on tags and just use subqueries, also remove a redundant join on derivations and don't order the results.
* Improve work queue and thread pool exception loggingChristopher Baines2023-05-17
|
* Guard against the stat call failingChristopher Baines2023-05-17
| | | | If the file doesn't exist.
* Add more information to job raised exception logsChristopher Baines2023-05-14
|