aboutsummaryrefslogtreecommitdiff
path: root/guix-build-coordinator/agent.scm
Commit message (Collapse)AuthorAge
* Reset the upload progress when appropriateChristopher Baines2022-10-14
|
* Add some more logging when agents submit outputsChristopher Baines2022-10-14
|
* Allow specifying the maximum number of allocated buildsChristopher Baines2022-10-10
| | | | For an agent.
* Properly handle build failure statusesChristopher Baines2022-09-02
|
* Don't record the build as failed if the exception is unknownChristopher Baines2022-09-02
| | | | As this can cause spurious failures.
* Fix adding GC roots for built outputsChristopher Baines2022-09-02
|
* Allow changing the agent parallel uploadsChristopher Baines2022-07-06
|
* Move getting output details soon after the outputs are generatedChristopher Baines2022-07-05
| | | | Like compressing the outputs, it's worth doing this sooner rather than later.
* Add temp roots for built outputsChristopher Baines2022-07-05
| | | | In case these need sending to the coordinator.
* Set thread names to help with debuggingChristopher Baines2022-06-15
|
* Fix spacing in a logging messageChristopher Baines2022-05-21
|
* Add more logging and timeouts around fetching inputsChristopher Baines2022-05-21
|
* Add some extra logging when an output has been submittedChristopher Baines2022-04-09
|
* Remove double retry-on-error for submitting outputsChristopher Baines2022-04-09
| | | | As submit-output retries on failure.
* Fix timeout when fetching inputsChristopher Baines2022-04-08
| | | | The timeout is in seconds, not milliseconds.
* Don't require reading the derivation after the build has happenedChristopher Baines2022-01-19
| | | | As it might have been garbage collected.
* Add correct guard to deleting compressed outputsChristopher Baines2022-01-09
|
* Delete compressed outputs after a build finishes successfullyChristopher Baines2021-12-27
| | | | Otherwise these files just build up.
* Have the agent add temporary roots on various store itemsChristopher Baines2021-12-24
| | | | So that it's hopefully not affected by garbage collection activity.
* Log unknown store protocol error messagesChristopher Baines2021-12-24
|
* Fix displaying the total bytes for uploads in progressChristopher Baines2021-12-19
|
* Fix logging deleting temporary filesChristopher Baines2021-12-19
|
* Cleanup temporary files on startupChristopher Baines2021-12-19
|
* Compress outputs in the thread for the buildChristopher Baines2021-12-19
| | | | | Since this can take a significant amount of CPU, and doing this upfront helps when there's lots of outputs to upload.
* Change the post build actions thread pool sizeChristopher Baines2021-12-19
| | | | | To be that of the number of parallel uploads, since that is what this now controls.
* Report the total bytes when reporting upload progressChristopher Baines2021-12-19
|
* Stop using with-upload-slot for queuing uploadsChristopher Baines2021-12-19
| | | | As that's handled by the thread pool instead.
* Don't use an unlimited number of threads for post build actionsChristopher Baines2021-12-19
| | | | | | Otherwise, when there's a large queue of outputs to upload, there will be a large number of threads, which can cause issues like exhausting file descriptors.
* Drop parallel uploads to 1 againChristopher Baines2021-11-26
| | | | | | I've seen agents crashing with the "Too many heap sections: Increase MAXHINCR or MAX_HEAP_SECTS" error, hopefully reducing the parallel uploads will help avoid this.
* Improve some way numbers are displayedChristopher Baines2021-11-22
|
* Compress outputs outside of the upload slotChristopher Baines2021-11-20
| | | | | So that the only thing taking place in the upload slot, is the actual upload, which should improve throughput.
* Increase the number of parallel uploads to 2Christopher Baines2021-11-15
| | | | Now that resuming partial uploads is supported, I think this should be OK.
* Handle failures around fetching buildsChristopher Baines2021-11-15
| | | | Without just stopping the agent.
* Report upload status more frequentlyChristopher Baines2021-11-15
|
* Drop parallel uploads to 1Christopher Baines2021-10-08
| | | | | As I think this could help with reliability. Once the Guile GnuTLS bindings are updated, this can potentially be increased.
* Move retrying uploads out of the with-upload-slot regionChristopher Baines2021-08-07
| | | | | Such that the retry happens with a fresh slot (and the associated tracking information).
* Increase upload mutex waiting timeChristopher Baines2021-08-07
|
* Report on uploads regularlyChristopher Baines2021-08-07
| | | | If there's a queue.
* Support thread-stop-delay for the work queuesChristopher Baines2021-06-20
| | | | | | | This is useful when builds finish quickly since there could be more than 2 idle threads, and then threads start stopping. This way, each thread waits 20 seconds before stopping, which should be enough time for new builds to be fetched.
* Tweak some indentationChristopher Baines2021-06-19
|
* agent: Tweak the number of builds to fetch.Christopher Baines2021-06-19
| | | | | Include the jobs from the post build queue too, since they'll still be allocated.
* Increase the thread start delayChristopher Baines2021-06-10
|
* Increase some agent max silent time valuesChristopher Baines2021-06-10
|
* Fix the thread-start-delay time calculationChristopher Baines2021-06-10
| | | | To actually use max-parallel-builds.
* Perform post build actions outside the main work queueChristopher Baines2021-06-09
| | | | | | This means that the main work queue can start more jobs while others are being finished off, which is particularly important now that the parallelism of uploading outputs is limited.
* Limit the parallelism of output uploadsChristopher Baines2021-06-08
| | | | | And report the progress periodically. This can be a bottleneck if the upload speed is slow, and the machine is fast at building things.
* Improve retrying for missing log filesChristopher Baines2021-05-28
|
* Avoid some threads and locks when running on the hurdChristopher Baines2021-02-15
| | | | I've see the process hang on the hurd, and I think this might help.
* Add a log message at the end of a buildChristopher Baines2021-02-14
| | | | So it's clearer that it's ended.
* Fix use of assocChristopher Baines2021-02-12
|