Commit message (Collapse) | Author | Age | |
---|---|---|---|
* | Reset the upload progress when appropriate | Christopher Baines | 2022-10-14 |
| | |||
* | Add some more logging when agents submit outputs | Christopher Baines | 2022-10-14 |
| | |||
* | Allow specifying the maximum number of allocated builds | Christopher Baines | 2022-10-10 |
| | | | | For an agent. | ||
* | Properly handle build failure statuses | Christopher Baines | 2022-09-02 |
| | |||
* | Don't record the build as failed if the exception is unknown | Christopher Baines | 2022-09-02 |
| | | | | As this can cause spurious failures. | ||
* | Fix adding GC roots for built outputs | Christopher Baines | 2022-09-02 |
| | |||
* | Allow changing the agent parallel uploads | Christopher Baines | 2022-07-06 |
| | |||
* | Move getting output details soon after the outputs are generated | Christopher Baines | 2022-07-05 |
| | | | | Like compressing the outputs, it's worth doing this sooner rather than later. | ||
* | Add temp roots for built outputs | Christopher Baines | 2022-07-05 |
| | | | | In case these need sending to the coordinator. | ||
* | Set thread names to help with debugging | Christopher Baines | 2022-06-15 |
| | |||
* | Fix spacing in a logging message | Christopher Baines | 2022-05-21 |
| | |||
* | Add more logging and timeouts around fetching inputs | Christopher Baines | 2022-05-21 |
| | |||
* | Add some extra logging when an output has been submitted | Christopher Baines | 2022-04-09 |
| | |||
* | Remove double retry-on-error for submitting outputs | Christopher Baines | 2022-04-09 |
| | | | | As submit-output retries on failure. | ||
* | Fix timeout when fetching inputs | Christopher Baines | 2022-04-08 |
| | | | | The timeout is in seconds, not milliseconds. | ||
* | Don't require reading the derivation after the build has happened | Christopher Baines | 2022-01-19 |
| | | | | As it might have been garbage collected. | ||
* | Add correct guard to deleting compressed outputs | Christopher Baines | 2022-01-09 |
| | |||
* | Delete compressed outputs after a build finishes successfully | Christopher Baines | 2021-12-27 |
| | | | | Otherwise these files just build up. | ||
* | Have the agent add temporary roots on various store items | Christopher Baines | 2021-12-24 |
| | | | | So that it's hopefully not affected by garbage collection activity. | ||
* | Log unknown store protocol error messages | Christopher Baines | 2021-12-24 |
| | |||
* | Fix displaying the total bytes for uploads in progress | Christopher Baines | 2021-12-19 |
| | |||
* | Fix logging deleting temporary files | Christopher Baines | 2021-12-19 |
| | |||
* | Cleanup temporary files on startup | Christopher Baines | 2021-12-19 |
| | |||
* | Compress outputs in the thread for the build | Christopher Baines | 2021-12-19 |
| | | | | | Since this can take a significant amount of CPU, and doing this upfront helps when there's lots of outputs to upload. | ||
* | Change the post build actions thread pool size | Christopher Baines | 2021-12-19 |
| | | | | | To be that of the number of parallel uploads, since that is what this now controls. | ||
* | Report the total bytes when reporting upload progress | Christopher Baines | 2021-12-19 |
| | |||
* | Stop using with-upload-slot for queuing uploads | Christopher Baines | 2021-12-19 |
| | | | | As that's handled by the thread pool instead. | ||
* | Don't use an unlimited number of threads for post build actions | Christopher Baines | 2021-12-19 |
| | | | | | | Otherwise, when there's a large queue of outputs to upload, there will be a large number of threads, which can cause issues like exhausting file descriptors. | ||
* | Drop parallel uploads to 1 again | Christopher Baines | 2021-11-26 |
| | | | | | | I've seen agents crashing with the "Too many heap sections: Increase MAXHINCR or MAX_HEAP_SECTS" error, hopefully reducing the parallel uploads will help avoid this. | ||
* | Improve some way numbers are displayed | Christopher Baines | 2021-11-22 |
| | |||
* | Compress outputs outside of the upload slot | Christopher Baines | 2021-11-20 |
| | | | | | So that the only thing taking place in the upload slot, is the actual upload, which should improve throughput. | ||
* | Increase the number of parallel uploads to 2 | Christopher Baines | 2021-11-15 |
| | | | | Now that resuming partial uploads is supported, I think this should be OK. | ||
* | Handle failures around fetching builds | Christopher Baines | 2021-11-15 |
| | | | | Without just stopping the agent. | ||
* | Report upload status more frequently | Christopher Baines | 2021-11-15 |
| | |||
* | Drop parallel uploads to 1 | Christopher Baines | 2021-10-08 |
| | | | | | As I think this could help with reliability. Once the Guile GnuTLS bindings are updated, this can potentially be increased. | ||
* | Move retrying uploads out of the with-upload-slot region | Christopher Baines | 2021-08-07 |
| | | | | | Such that the retry happens with a fresh slot (and the associated tracking information). | ||
* | Increase upload mutex waiting time | Christopher Baines | 2021-08-07 |
| | |||
* | Report on uploads regularly | Christopher Baines | 2021-08-07 |
| | | | | If there's a queue. | ||
* | Support thread-stop-delay for the work queues | Christopher Baines | 2021-06-20 |
| | | | | | | | This is useful when builds finish quickly since there could be more than 2 idle threads, and then threads start stopping. This way, each thread waits 20 seconds before stopping, which should be enough time for new builds to be fetched. | ||
* | Tweak some indentation | Christopher Baines | 2021-06-19 |
| | |||
* | agent: Tweak the number of builds to fetch. | Christopher Baines | 2021-06-19 |
| | | | | | Include the jobs from the post build queue too, since they'll still be allocated. | ||
* | Increase the thread start delay | Christopher Baines | 2021-06-10 |
| | |||
* | Increase some agent max silent time values | Christopher Baines | 2021-06-10 |
| | |||
* | Fix the thread-start-delay time calculation | Christopher Baines | 2021-06-10 |
| | | | | To actually use max-parallel-builds. | ||
* | Perform post build actions outside the main work queue | Christopher Baines | 2021-06-09 |
| | | | | | | This means that the main work queue can start more jobs while others are being finished off, which is particularly important now that the parallelism of uploading outputs is limited. | ||
* | Limit the parallelism of output uploads | Christopher Baines | 2021-06-08 |
| | | | | | And report the progress periodically. This can be a bottleneck if the upload speed is slow, and the machine is fast at building things. | ||
* | Improve retrying for missing log files | Christopher Baines | 2021-05-28 |
| | |||
* | Avoid some threads and locks when running on the hurd | Christopher Baines | 2021-02-15 |
| | | | | I've see the process hang on the hurd, and I think this might help. | ||
* | Add a log message at the end of a build | Christopher Baines | 2021-02-14 |
| | | | | So it's clearer that it's ended. | ||
* | Fix use of assoc | Christopher Baines | 2021-02-12 |
| |