| Commit message (Expand) | Author | Age |
* | Use Guile Knots | Christopher Baines | 2025-01-13 |
* | Try to prioritise some database operations•••At the moment, hooks can get stuck behind new builds being submitted due to
the slow writes. Try to manage this by prioritising the write operations from
the hooks.
| Christopher Baines | 2024-10-14 |
* | Add make-discrete-priority-queueing-channels | Christopher Baines | 2024-10-14 |
* | Track errors when reading/substituting derivations | Christopher Baines | 2024-07-12 |
* | Instrument the utility thread pool delays | Christopher Baines | 2024-07-12 |
* | Increase the number of utility threads | Christopher Baines | 2024-07-12 |
* | Split code for checking whether to store builds•••To better separate out when a derivation is read, and when it's not. This
should ensure that derivations aren't being read inside the transaction to
submit builds.
| Christopher Baines | 2024-07-09 |
* | Remove the workaround for with-store/non-blocking•••As this is fixed in Guix now.
| Christopher Baines | 2024-07-04 |
* | Revert "Add dbstat metrics"•••It's not fast enough.
This reverts commit 09daad84faea3577acf5f1627e4bfed699b10a5d.
| Christopher Baines | 2024-07-04 |
* | Log the current state of the reader threads | Christopher Baines | 2024-07-02 |
* | Track the procedures the worker threads are running | Christopher Baines | 2024-07-02 |
* | Reduce the sleep in the worker threads | Christopher Baines | 2024-07-02 |
* | Remove now redundant use of the writer thread channel•••As there are no longer in memory tables.
| Christopher Baines | 2024-07-02 |
* | Try not using the busy timeout•••I'm not quite sure what effect this will have, but it's probably better to do
the waiting in Guile rather than SQLite.
| Christopher Baines | 2024-07-02 |
* | Add dbstat metrics | Christopher Baines | 2024-07-02 |
* | Don't use a chunked response for the metrics | Christopher Baines | 2024-06-30 |
* | Add option to skip updating derived priorities when submitting builds•••As I think this can be skipped if you're submitting a batch of interdependent
builds with the same priority.
| Christopher Baines | 2024-06-25 |
* | Fix build prioritisation | Christopher Baines | 2024-06-25 |
* | Add a utility thread pool•••And use this to read derivations.
| Christopher Baines | 2024-06-25 |
* | Remove support for chunked requests•••This was a hack to work around reading the entire request/response body in to
memory, and is no longer needed.
| Christopher Baines | 2024-06-23 |
* | Add missing loop when fetching builds to allocate | Christopher Baines | 2024-06-23 |
* | Don't abuse the reader threads to read derivations•••To avoid causing any issues with them.
| Christopher Baines | 2024-06-23 |
* | Return copies of the list from the allocation plan fiber•••To avoid the authoritative data structures from being modified.
| Christopher Baines | 2024-06-22 |
* | Remove the ATTACH DATABASE line•••As it's no longer used.
| Christopher Baines | 2024-06-22 |
* | Add some logging in to build-coordinator-fetch-build-to-allocate | Christopher Baines | 2024-06-22 |
* | Add some logging to the hook work queues | Christopher Baines | 2024-06-19 |
* | Move the allocation plan in to memory•••Rather than using an in memory SQLite table, since I think this might be
causing issues when opening new SQLite reader threads.
| Christopher Baines | 2024-06-19 |
* | Reduce the nar size threshold•••Unreasoned, but this'll compress more nars.
| Christopher Baines | 2024-06-15 |
* | Change with-port-timeouts to use seconds for the timeout | Christopher Baines | 2024-06-10 |
* | Don't retry canceling builds if they're already canceled | Christopher Baines | 2024-06-10 |
* | Validate derivation names for builds•••As I've managed to submit derivation names with \r in.
| Christopher Baines | 2024-06-09 |
* | Don't ignore missing_inputs setup failures when allocating•••As if there is an issue substituting the input, this can cause the build to
fail to start over and over again, potentially retrying downloading the inputs
over and over again.
This will mean that the setup failures will need clearing manually before the
build can be tried again, but this is probably a good thing.
| Christopher Baines | 2024-06-07 |
* | Avoid using select and use poll instead•••I don't trust select, as I think I'm seeing it make blocking read calls. I
don't know if that's coming from here, but better to just avoid it.
| Christopher Baines | 2024-06-07 |
* | Support controlling adding timestamps to the log output•••So this can be turned off when the shepherd is adding the timestamps.
| Christopher Baines | 2024-06-06 |
* | Strip whitespace from derivation names•••As this can trip things up.
| Christopher Baines | 2024-06-06 |
* | Support customising the default-build-missing-inputs-hook behaviour | Christopher Baines | 2024-06-06 |
* | Retry more when substituting derivations•••And don't use the no substitutes fallback.
| Christopher Baines | 2024-06-06 |
* | Always use a thread to read derivations | Christopher Baines | 2024-06-06 |
* | Close the uncompressed output port explicitly•••As this ensures the data is written. This resolves some issues with bytes
missing from the end of nars.
| Christopher Baines | 2024-06-05 |
* | Make imports from (guix build utils) explicit | Christopher Baines | 2024-06-05 |
* | Omit none as a compression in narinfos•••To match the guix publish behaviour.
| Christopher Baines | 2024-06-05 |
* | Enable recompressing nars in the publish hook•••The implementation is intended to be generic, but the new default behaviour
either keeps the lzip compressed nar, or if the compressed nar isn't much
smaller than the compressed one, decompresses it.
This also changes the API for the post-publish-hook and
combined-post-publish-hook, since they now get called with a list of narinfos,
rather than a list of narinfos and files.
| Christopher Baines | 2024-05-19 |
* | Use threads for reading derivations•••As it is quite slow on bayfront at least.
| Christopher Baines | 2024-05-15 |
* | Work around the broken with-store/non-blocking | Christopher Baines | 2024-05-15 |
* | Use just one cooperative thread•••To try and simplify things.
| Christopher Baines | 2024-05-15 |
* | Order messages to the writer thread channel•••So that they're processed in a first come first served manor.
| Christopher Baines | 2024-05-15 |
* | Handled fetching details of canceled builds | Christopher Baines | 2024-05-15 |
* | Export port timeout error predicates | Christopher Baines | 2024-05-15 |
* | Use with-store/non-blocking from guix•••As it opens a non-blocking connection, rather than doing a blocking handshake
then making the socket non-blocking.
| Christopher Baines | 2024-05-14 |
* | Fix the no-fibers-wait in with-fibers-port-timeouts | Christopher Baines | 2024-05-14 |