aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAge
* Increase the open file limitChristopher Baines2023-08-22
| | | | To hopefully make investigating why excessive ports/open files are being used.
* Use srfi-71 in the guix-data-service moduleChristopher Baines2023-08-22
|
* Try and enable core dumpsChristopher Baines2023-08-20
|
* Pass the store in to substitute-derivationChristopher Baines2023-08-20
| | | | To avoid an additional store connection.
* Use less database read threadsChristopher Baines2023-08-20
| | | | As I'm not sure that having so many read threads is helpful.
* Use less fibers threads and cooperative schedulingChristopher Baines2023-08-20
| | | | Since I'm not sure preemption or more threads are useful.
* Include metric for file descriptorsChristopher Baines2023-08-20
|
* Switch to a more rigorous method for finding potential source refsChristopher Baines2023-08-10
|
* Ignore self output references when looking for potential source refsChristopher Baines2023-08-10
|
* Ensure references doesn't contain the empty stringChristopher Baines2023-08-10
|
* Simplify substitute-derivationChristopher Baines2023-08-10
| | | | Assume ensure-path is available.
* Fix some log outputChristopher Baines2023-08-10
|
* Name more threadsChristopher Baines2023-08-09
| | | | To help with debugging.
* Don't use threads for substituting derivationsChristopher Baines2023-08-09
| | | | Instead use non-blocking store connections like Cuirass does.
* Name the fibers threadsChristopher Baines2023-08-09
| | | | To make debugging easier.
* Fix read-derivation getting the filenameChristopher Baines2023-08-03
|
* Keep less derivation files open when reading derivationsChristopher Baines2023-08-03
| | | | | This probably isn't the main problem with having too many open files, but it might help avoid bursts of open files.
* Add missing bracketChristopher Baines2023-08-02
|
* Support canceling builds that are depended onChristopher Baines2023-08-02
|
* Remove crude fetching inputs timeoutChristopher Baines2023-08-02
| | | | As this breaks builds that rely on fetching large inputs.
* Reduce fibers parallelismChristopher Baines2023-07-24
| | | | To reduce the number of threads, as lots is probably unnecessary.
* Make client requests mostly suspendableChristopher Baines2023-07-24
|
* Add some logging to the build success publish hookChristopher Baines2023-07-08
|
* Add some retrying when performing bulk operationsChristopher Baines2023-07-08
|
* Update guix-dev.scmChristopher Baines2023-07-08
|
* Improve the build-success-publish-hook for referenced source filesChristopher Baines2023-07-07
| | | | | | | Previously it would always connect to the store and substitute the derivation if necessary. Now it checks first to see if there are some references from the outputs that aren't from the inputs, and if that's the case, it goes on to check if these are source files that need publishing.
* Fix some stream issuesChristopher Baines2023-06-16
|
* Try and get backtraces when current output port seems brokenChristopher Baines2023-06-04
| | | | | | | | | With the "conversion to port encoding failed" (#62590) error, I'm seeing the "error: when processing" logs, but the backtrace doesn't get logged, maybe because it's going to the current output port, which might be broken? Anyway, try sending the backtrace to the current error port, in the hope that this port is still working.
* Set GC_RETRY_SIGNALS=0 for the agentChristopher Baines2023-06-02
| | | | As I've seen the "Signals delivery fails constantly" crash in the agent now.
* Don't call report-bytes-hashed with #fChristopher Baines2023-05-24
| | | | Just log the line instead.
* Show backtraces for perform-upload errorsChristopher Baines2023-05-23
|
* Better handle the output hashing being completed for upload requestsChristopher Baines2023-05-23
| | | | | This currently causes an error on the server side and a timeout on the client side.
* Tweak logging around agent output submissionChristopher Baines2023-05-22
|
* Better handle upload requests with no contentChristopher Baines2023-05-22
| | | | | The idea with these is to allow the agent to resume waiting for the coordinator to finish computing the output hash.
* Fix not updating about uploads based on timeChristopher Baines2023-05-22
|
* Remove unused make-base64-output-portChristopher Baines2023-05-20
|
* Change listing builds to work as a streamChristopher Baines2023-05-19
| | | | | | | | | | Both in terms of getting the data from the database, and sending it to the client. This avoids the use of the after-id and ordering by id when listing builds, which makes listing builds faster. It does mean that the database reads may last for a while (which can be a problem), but maybe that can be addressed in other ways.
* Fix listing builds stopping earlyChristopher Baines2023-05-17
|
* Don't print out "build-canceled" for each canceled buildChristopher Baines2023-05-17
|
* Speed up listing buildsChristopher Baines2023-05-17
| | | | | Remove the complicated JOIN on tags and just use subqueries, also remove a redundant join on derivations and don't order the results.
* Improve work queue and thread pool exception loggingChristopher Baines2023-05-17
|
* Guard against the stat call failingChristopher Baines2023-05-17
| | | | If the file doesn't exist.
* Add more information to job raised exception logsChristopher Baines2023-05-14
|
* Add extra log line when hashing outputsChristopher Baines2023-05-14
|
* Not being able to log reliably is frustrating :(Christopher Baines2023-05-14
| | | | | | I'm seeing things like this, which I'm guessing relate to logging failing: 2023-05-14 13:40:44 (ERROR): exception in output hash thread: #<&compound-exception components: (#<&error> #<&origin origin: "put-char"> #<&message message: "conversion to port encoding failed"> #<&irritants irritants: 84> #<&exception-with-kind-and-args kind: encoding-error args: ("put-char" "conversion to port encoding failed" 84 #<output: file 1> #\2)>)>
* Guard against logging failures in the output hash threadChristopher Baines2023-05-14
|
* Set the name of the hash management threadChristopher Baines2023-05-14
| | | | For debugging purposes.
* Move some loggingChristopher Baines2023-05-14
| | | | So if it fails, it doesn't leave things in an inconsistent state.
* Add more logging around computing hashesChristopher Baines2023-05-14
|
* Fix missing logger argumentChristopher Baines2023-05-14
|