aboutsummaryrefslogtreecommitdiff
path: root/guix-build-coordinator/agent.scm
Commit message (Collapse)AuthorAge
...
* Fix spacing in a logging messageChristopher Baines2022-05-21
|
* Add more logging and timeouts around fetching inputsChristopher Baines2022-05-21
|
* Add some extra logging when an output has been submittedChristopher Baines2022-04-09
|
* Remove double retry-on-error for submitting outputsChristopher Baines2022-04-09
| | | | As submit-output retries on failure.
* Fix timeout when fetching inputsChristopher Baines2022-04-08
| | | | The timeout is in seconds, not milliseconds.
* Don't require reading the derivation after the build has happenedChristopher Baines2022-01-19
| | | | As it might have been garbage collected.
* Add correct guard to deleting compressed outputsChristopher Baines2022-01-09
|
* Delete compressed outputs after a build finishes successfullyChristopher Baines2021-12-27
| | | | Otherwise these files just build up.
* Have the agent add temporary roots on various store itemsChristopher Baines2021-12-24
| | | | So that it's hopefully not affected by garbage collection activity.
* Log unknown store protocol error messagesChristopher Baines2021-12-24
|
* Fix displaying the total bytes for uploads in progressChristopher Baines2021-12-19
|
* Fix logging deleting temporary filesChristopher Baines2021-12-19
|
* Cleanup temporary files on startupChristopher Baines2021-12-19
|
* Compress outputs in the thread for the buildChristopher Baines2021-12-19
| | | | | Since this can take a significant amount of CPU, and doing this upfront helps when there's lots of outputs to upload.
* Change the post build actions thread pool sizeChristopher Baines2021-12-19
| | | | | To be that of the number of parallel uploads, since that is what this now controls.
* Report the total bytes when reporting upload progressChristopher Baines2021-12-19
|
* Stop using with-upload-slot for queuing uploadsChristopher Baines2021-12-19
| | | | As that's handled by the thread pool instead.
* Don't use an unlimited number of threads for post build actionsChristopher Baines2021-12-19
| | | | | | Otherwise, when there's a large queue of outputs to upload, there will be a large number of threads, which can cause issues like exhausting file descriptors.
* Drop parallel uploads to 1 againChristopher Baines2021-11-26
| | | | | | I've seen agents crashing with the "Too many heap sections: Increase MAXHINCR or MAX_HEAP_SECTS" error, hopefully reducing the parallel uploads will help avoid this.
* Improve some way numbers are displayedChristopher Baines2021-11-22
|
* Compress outputs outside of the upload slotChristopher Baines2021-11-20
| | | | | So that the only thing taking place in the upload slot, is the actual upload, which should improve throughput.
* Increase the number of parallel uploads to 2Christopher Baines2021-11-15
| | | | Now that resuming partial uploads is supported, I think this should be OK.
* Handle failures around fetching buildsChristopher Baines2021-11-15
| | | | Without just stopping the agent.
* Report upload status more frequentlyChristopher Baines2021-11-15
|
* Drop parallel uploads to 1Christopher Baines2021-10-08
| | | | | As I think this could help with reliability. Once the Guile GnuTLS bindings are updated, this can potentially be increased.
* Move retrying uploads out of the with-upload-slot regionChristopher Baines2021-08-07
| | | | | Such that the retry happens with a fresh slot (and the associated tracking information).
* Increase upload mutex waiting timeChristopher Baines2021-08-07
|
* Report on uploads regularlyChristopher Baines2021-08-07
| | | | If there's a queue.
* Support thread-stop-delay for the work queuesChristopher Baines2021-06-20
| | | | | | | This is useful when builds finish quickly since there could be more than 2 idle threads, and then threads start stopping. This way, each thread waits 20 seconds before stopping, which should be enough time for new builds to be fetched.
* Tweak some indentationChristopher Baines2021-06-19
|
* agent: Tweak the number of builds to fetch.Christopher Baines2021-06-19
| | | | | Include the jobs from the post build queue too, since they'll still be allocated.
* Increase the thread start delayChristopher Baines2021-06-10
|
* Increase some agent max silent time valuesChristopher Baines2021-06-10
|
* Fix the thread-start-delay time calculationChristopher Baines2021-06-10
| | | | To actually use max-parallel-builds.
* Perform post build actions outside the main work queueChristopher Baines2021-06-09
| | | | | | This means that the main work queue can start more jobs while others are being finished off, which is particularly important now that the parallelism of uploading outputs is limited.
* Limit the parallelism of output uploadsChristopher Baines2021-06-08
| | | | | And report the progress periodically. This can be a bottleneck if the upload speed is slow, and the machine is fast at building things.
* Improve retrying for missing log filesChristopher Baines2021-05-28
|
* Avoid some threads and locks when running on the hurdChristopher Baines2021-02-15
| | | | I've see the process hang on the hurd, and I think this might help.
* Add a log message at the end of a buildChristopher Baines2021-02-14
| | | | So it's clearer that it's ended.
* Fix use of assocChristopher Baines2021-02-12
|
* Allow agents to skip submitting build outputsChristopher Baines2021-01-16
| | | | | | | | | If the coordinator isn't going to use the outputs, because they've already been built for example, then save some time by not processing and submitting them. This will probably need to get more configurable on the coordinator side in the future.
* Start migrating derivation-inputs to derivation_inputsChristopher Baines2021-01-16
| | | | As I think underscores are more idiomatic in JSON.
* Rework the agent messaging modulesChristopher Baines2021-01-15
|
* Use methods for the agent messagingChristopher Baines2021-01-15
| | | | This will allow adding more agent messaging approaches.
* Tweak agent queue timingsChristopher Baines2021-01-12
| | | | | Wait slightly longer between starting new threads, and give more time for new jobs to arrive for running threads.
* Work on the agent thread handling some moreChristopher Baines2021-01-06
| | | | | Various changes, hopefully improvements. Inactive threads should stop promptly, and new threads should start promptly when new builds arrive.
* Give more time for substitute downloadsChristopher Baines2021-01-03
| | | | | By the agent. Turns out 10 minutes isn't long enough for some large and slow downloads.
* Fix the stdin based status display when running under the shepherdChristopher Baines2021-01-03
| | | | | The current input port is #<input: file 0>, which gives eof when read from, so detect this and stop trying to read from it.
* Add debugging code for the agent status outputChristopher Baines2021-01-03
| | | | As this doesn't seem to be working properly when running under the shepherd.
* Ensure the agent fetches builds if it doesn't have anyChristopher Baines2021-01-02
|
generated by cgit v1.2.3 (git 2.25.4) at 2024-05-26 20:45:40 +0000