aboutsummaryrefslogtreecommitdiff
path: root/guix-build-coordinator
Commit message (Collapse)AuthorAge
...
* Don't pass time to wait-condition-variableChristopher Baines2023-12-02
| | | | | | | | | | My intent here was to avoid threads waiting indefinitely for a signal. Unfortunately, it seems that specifying a timeout can result in wait-condition-variable entering an endless loop internally (#67194). Hopefully avoid this by not passing a time to wait-condition-variable. Maybe some new threads/fibers will need adding that periodically signal these condition variables to replicate the timeout behaviour.
* Extend %file-port-name-canonicalization to hook threadsChristopher Baines2023-11-30
|
* Set %file-port-name-canonicalization to avoid readlink syscallsChristopher Baines2023-11-28
| | | | As Guix does.
* Actually use a separate store connectionChristopher Baines2023-11-23
| | | | Fix the obvious bug in 3711cd8f1d901b424b2073dc54be4eec83c95482.
* Remove set-store-connection-timeoutChristopher Baines2023-11-20
| | | | As non blocking connections are being used now.
* Use a temporary store connection for substituting derivationsChristopher Baines2023-11-20
|
* Use port timeouts when checking substitutesChristopher Baines2023-11-20
| | | | As I think this is better than the alarm syscall.
* Switch to (mostly) non blocking store connections in the agentChristopher Baines2023-11-20
| | | | Pending #67245.
* Pass the store in to delete-outputsChristopher Baines2023-11-20
|
* Pass the store in to get-output-detailsChristopher Baines2023-11-20
|
* Don't shadow store in the agentChristopher Baines2023-11-20
|
* Re-enable fiber preemptionChristopher Baines2023-11-18
| | | | As some fibers might be running for too long.
* Avoid readlink syscalls when reading derivationsChristopher Baines2023-11-17
| | | | | | | | | strace -c reports over 10,000 readlink syscalls when reading the derivation for the hello package. By just setting the %file-port-name-canonicalization fluid, this drops to less than 10. I'm not sure if this actually improves performance, but doing less is surely better.
* Track the metrics endpoint durationChristopher Baines2023-11-17
|
* Call wait-condition-variable with longer timeoutsChristopher Baines2023-11-15
| | | | | | The hook processing threads seem to be getting stuck in wait-condition-variable where the timeout is in the past. Maybe setting a longer timeout will help avoid this.
* Remove some caching from reading derivationsChristopher Baines2023-11-11
| | | | As I'm not sure this is helpful.
* Try to avoid the metrics endpoint timing outChristopher Baines2023-11-10
| | | | As this makes it harder to debug issues.
* Add a with-fibers-timeout utilityChristopher Baines2023-11-10
|
* Include the derivation_outputs in the data service eventChristopher Baines2023-10-16
| | | | If possible.
* Add new send-events-for-selected-builds procedureChristopher Baines2023-10-16
| | | | Which is helpful when backfilling data in the data service.
* Use start-stack in make-worker-thread-channelChristopher Baines2023-10-06
| | | | | | | | | | Not sure what this does, but it seems to work around Guile crashing in (backtrace) like: Backtrace: In guix-build-coordinator/utils/fibers.scm: Exception thrown while printing backtrace: In procedure vector-ref: Argument 2 out of range: 99
* Don't output the whole log for substituting derivationsChristopher Baines2023-08-31
| | | | Just the last bit, as it could be very long.
* Exit when the server fails to startChristopher Baines2023-08-29
| | | | To avoid the process half working.
* Replace request-builds-list by fold-buildsChristopher Baines2023-08-29
| | | | As this can wait until the stream is finished and properly close the port.
* Add more logging around hooksChristopher Baines2023-08-29
|
* Fix some logging messagesChristopher Baines2023-08-29
|
* Stop closing the ports for json seq responsesChristopher Baines2023-08-29
| | | | As this breaks reading the stream.
* Properly close the port when making client requestsChristopher Baines2023-08-23
|
* Try and ensure that the worker threads don't disappearChristopher Baines2023-08-22
| | | | Add some top level exception handling to guard against errors anywhere.
* Increase the open file limitChristopher Baines2023-08-22
| | | | To hopefully make investigating why excessive ports/open files are being used.
* Use srfi-71 in the guix-data-service moduleChristopher Baines2023-08-22
|
* Try and enable core dumpsChristopher Baines2023-08-20
|
* Pass the store in to substitute-derivationChristopher Baines2023-08-20
| | | | To avoid an additional store connection.
* Use less database read threadsChristopher Baines2023-08-20
| | | | As I'm not sure that having so many read threads is helpful.
* Use less fibers threads and cooperative schedulingChristopher Baines2023-08-20
| | | | Since I'm not sure preemption or more threads are useful.
* Include metric for file descriptorsChristopher Baines2023-08-20
|
* Switch to a more rigorous method for finding potential source refsChristopher Baines2023-08-10
|
* Ignore self output references when looking for potential source refsChristopher Baines2023-08-10
|
* Ensure references doesn't contain the empty stringChristopher Baines2023-08-10
|
* Simplify substitute-derivationChristopher Baines2023-08-10
| | | | Assume ensure-path is available.
* Fix some log outputChristopher Baines2023-08-10
|
* Name more threadsChristopher Baines2023-08-09
| | | | To help with debugging.
* Don't use threads for substituting derivationsChristopher Baines2023-08-09
| | | | Instead use non-blocking store connections like Cuirass does.
* Name the fibers threadsChristopher Baines2023-08-09
| | | | To make debugging easier.
* Fix read-derivation getting the filenameChristopher Baines2023-08-03
|
* Keep less derivation files open when reading derivationsChristopher Baines2023-08-03
| | | | | This probably isn't the main problem with having too many open files, but it might help avoid bursts of open files.
* Remove crude fetching inputs timeoutChristopher Baines2023-08-02
| | | | As this breaks builds that rely on fetching large inputs.
* Reduce fibers parallelismChristopher Baines2023-07-24
| | | | To reduce the number of threads, as lots is probably unnecessary.
* Make client requests mostly suspendableChristopher Baines2023-07-24
|
* Add some logging to the build success publish hookChristopher Baines2023-07-08
|