aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAge
...
* Pass the store in to get-output-detailsChristopher Baines2023-11-20
|
* Don't shadow store in the agentChristopher Baines2023-11-20
|
* Re-enable fiber preemptionChristopher Baines2023-11-18
| | | | As some fibers might be running for too long.
* Avoid readlink syscalls when reading derivationsChristopher Baines2023-11-17
| | | | | | | | | strace -c reports over 10,000 readlink syscalls when reading the derivation for the hello package. By just setting the %file-port-name-canonicalization fluid, this drops to less than 10. I'm not sure if this actually improves performance, but doing less is surely better.
* Track the metrics endpoint durationChristopher Baines2023-11-17
|
* Call wait-condition-variable with longer timeoutsChristopher Baines2023-11-15
| | | | | | The hook processing threads seem to be getting stuck in wait-condition-variable where the timeout is in the past. Maybe setting a longer timeout will help avoid this.
* Remove some caching from reading derivationsChristopher Baines2023-11-11
| | | | As I'm not sure this is helpful.
* Try to avoid the metrics endpoint timing outChristopher Baines2023-11-10
| | | | As this makes it harder to debug issues.
* Add a with-fibers-timeout utilityChristopher Baines2023-11-10
|
* Include the derivation_outputs in the data service eventChristopher Baines2023-10-16
| | | | If possible.
* Add new send-events-for-selected-builds procedureChristopher Baines2023-10-16
| | | | Which is helpful when backfilling data in the data service.
* Use start-stack in make-worker-thread-channelChristopher Baines2023-10-06
| | | | | | | | | | Not sure what this does, but it seems to work around Guile crashing in (backtrace) like: Backtrace: In guix-build-coordinator/utils/fibers.scm: Exception thrown while printing backtrace: In procedure vector-ref: Argument 2 out of range: 99
* Don't output the whole log for substituting derivationsChristopher Baines2023-08-31
| | | | Just the last bit, as it could be very long.
* Exit when the server fails to startChristopher Baines2023-08-29
| | | | To avoid the process half working.
* Replace request-builds-list by fold-buildsChristopher Baines2023-08-29
| | | | As this can wait until the stream is finished and properly close the port.
* Add more logging around hooksChristopher Baines2023-08-29
|
* Fix some logging messagesChristopher Baines2023-08-29
|
* Stop closing the ports for json seq responsesChristopher Baines2023-08-29
| | | | As this breaks reading the stream.
* Properly close the port when making client requestsChristopher Baines2023-08-23
|
* Try and ensure that the worker threads don't disappearChristopher Baines2023-08-22
| | | | Add some top level exception handling to guard against errors anywhere.
* Increase the open file limitChristopher Baines2023-08-22
| | | | To hopefully make investigating why excessive ports/open files are being used.
* Use srfi-71 in the guix-data-service moduleChristopher Baines2023-08-22
|
* Try and enable core dumpsChristopher Baines2023-08-20
|
* Pass the store in to substitute-derivationChristopher Baines2023-08-20
| | | | To avoid an additional store connection.
* Use less database read threadsChristopher Baines2023-08-20
| | | | As I'm not sure that having so many read threads is helpful.
* Use less fibers threads and cooperative schedulingChristopher Baines2023-08-20
| | | | Since I'm not sure preemption or more threads are useful.
* Include metric for file descriptorsChristopher Baines2023-08-20
|
* Switch to a more rigorous method for finding potential source refsChristopher Baines2023-08-10
|
* Ignore self output references when looking for potential source refsChristopher Baines2023-08-10
|
* Ensure references doesn't contain the empty stringChristopher Baines2023-08-10
|
* Simplify substitute-derivationChristopher Baines2023-08-10
| | | | Assume ensure-path is available.
* Fix some log outputChristopher Baines2023-08-10
|
* Name more threadsChristopher Baines2023-08-09
| | | | To help with debugging.
* Don't use threads for substituting derivationsChristopher Baines2023-08-09
| | | | Instead use non-blocking store connections like Cuirass does.
* Name the fibers threadsChristopher Baines2023-08-09
| | | | To make debugging easier.
* Fix read-derivation getting the filenameChristopher Baines2023-08-03
|
* Keep less derivation files open when reading derivationsChristopher Baines2023-08-03
| | | | | This probably isn't the main problem with having too many open files, but it might help avoid bursts of open files.
* Add missing bracketChristopher Baines2023-08-02
|
* Support canceling builds that are depended onChristopher Baines2023-08-02
|
* Remove crude fetching inputs timeoutChristopher Baines2023-08-02
| | | | As this breaks builds that rely on fetching large inputs.
* Reduce fibers parallelismChristopher Baines2023-07-24
| | | | To reduce the number of threads, as lots is probably unnecessary.
* Make client requests mostly suspendableChristopher Baines2023-07-24
|
* Add some logging to the build success publish hookChristopher Baines2023-07-08
|
* Add some retrying when performing bulk operationsChristopher Baines2023-07-08
|
* Update guix-dev.scmChristopher Baines2023-07-08
|
* Improve the build-success-publish-hook for referenced source filesChristopher Baines2023-07-07
| | | | | | | Previously it would always connect to the store and substitute the derivation if necessary. Now it checks first to see if there are some references from the outputs that aren't from the inputs, and if that's the case, it goes on to check if these are source files that need publishing.
* Fix some stream issuesChristopher Baines2023-06-16
|
* Try and get backtraces when current output port seems brokenChristopher Baines2023-06-04
| | | | | | | | | With the "conversion to port encoding failed" (#62590) error, I'm seeing the "error: when processing" logs, but the backtrace doesn't get logged, maybe because it's going to the current output port, which might be broken? Anyway, try sending the backtrace to the current error port, in the hope that this port is still working.
* Set GC_RETRY_SIGNALS=0 for the agentChristopher Baines2023-06-02
| | | | As I've seen the "Signals delivery fails constantly" crash in the agent now.
* Don't call report-bytes-hashed with #fChristopher Baines2023-05-24
| | | | Just log the line instead.