Commit message (Collapse) | Author | Age | |
---|---|---|---|
* | WIPwip-s3 | Christopher Baines | 2020-05-07 |
| | |||
* | WIP | Christopher Baines | 2020-05-07 |
| | |||
* | WIP | Christopher Baines | 2020-05-07 |
| | |||
* | WIP | Christopher Baines | 2020-05-07 |
| | |||
* | Disable grafts when using Guix in .envrc | Christopher Baines | 2020-05-07 |
| | | | | | On some systems where I'm using this and direnv, but without substitutes, grafts become too expensive to use. | ||
* | Retry fetching derivations for the agent | Christopher Baines | 2020-05-06 |
| | |||
* | Move retry-on-error to utils | Christopher Baines | 2020-05-06 |
| | | | | So that it can be used outside of the http module. | ||
* | Support compressing data upfront to reduce transfer times | Christopher Baines | 2020-05-05 |
| | | | | For sending larger outputs back to the coordinator. | ||
* | Fix the failed to fetch substitutes for error message | Christopher Baines | 2020-05-05 |
| | |||
* | Don't raise an exception when substitutes fail | Christopher Baines | 2020-05-05 |
| | |||
* | Fix some indentation in agent.scm | Christopher Baines | 2020-05-05 |
| | |||
* | Better guard against build setup issues | Christopher Baines | 2020-05-05 |
| | | | | I've seen an agent miss dependencies, so this should help guard against that. | ||
* | Update the unimplemented features bit in the README | Christopher Baines | 2020-05-04 |
| | |||
* | Fix the removal of missing input setup failures in the allocator | Christopher Baines | 2020-05-01 |
| | | | | | Previously it was ignoring all setup failures when a single one of the outputs for a single setup failure should be available. | ||
* | Fix the finished output for missing inputs | Christopher Baines | 2020-05-01 |
| | |||
* | Extend guix-build-coordinator show build to work with outputs | Christopher Baines | 2020-05-01 |
| | | | | | It will show the builds for the output. This commit also adds more information in to the output. | ||
* | Add guix-build-coordinator build show ... | Christopher Baines | 2020-05-01 |
| | | | | A way of getting information out about a build. | ||
* | Add datastore-list-setup-failures-for-build | Christopher Baines | 2020-05-01 |
| | |||
* | Remove peek that snuck in | Christopher Baines | 2020-05-01 |
| | |||
* | Handle no directories to look at in has-substiutes-no-cache? | Christopher Baines | 2020-05-01 |
| | |||
* | Avoid using has-substitutes? if one isn't available | Christopher Baines | 2020-05-01 |
| | | | | | | | | | Because 404's for substitutes are cached for 3 hours (I think this is the current behaviour in Guix), this can mean that even though a substitute might become available, you migth have to wait up to 3 hours to be able to use it. To try and avoid this circumstance, check if a substitute is available without using the daemon, and only ask it if there should be one available. | ||
* | Try to better order the builds | Christopher Baines | 2020-05-01 |
| | | | | | | As well as sorting by priority, this now looks at which builds are missing outputs, and which builds will provide those outputs and tries to order the builds providing the outputs before the builds that need them. | ||
* | Use two separate channels and sets of threads for SQLite operations | Christopher Baines | 2020-05-01 |
| | | | | | | | Originally, I didn't quite grasp that SQLite can't handle concurrent writes. Now that I'm pretty sure this is the case, use a dedicated channel backed with one thread so that the writes are serialised at the application level. I think this might help avoid some segfaults I've been seeing. | ||
* | Stop if the build command fails | Christopher Baines | 2020-04-30 |
| | |||
* | Avoid errors in call-with-time-tracking if the registry isn't set | Christopher Baines | 2020-04-30 |
| | |||
* | Add --ignore-if-build-for-outputs-exists | Christopher Baines | 2020-04-30 |
| | |||
* | Improve the sqlite exception handling | Christopher Baines | 2020-04-30 |
| | | | | Use #:unwind? #t in more cases. | ||
* | Handle exceptions in the build allocator thread | Christopher Baines | 2020-04-29 |
| | |||
* | Have the build priorities propagate between builds | Christopher Baines | 2020-04-29 |
| | | | | | | | | | This should at least do a better job of boosting the priority of builds required to perform builds which have high priorities. I'm expecting this to result in contiguous chunks of builds with all the same priority, and the ordering within those chunks isn't yet decided intelligently. | ||
* | Only return setup failures for unprocessed builds | Christopher Baines | 2020-04-29 |
| | | | | The ones for processed builds aren't relevent to the allocator. | ||
* | Move output-has-successful-build? out from filter-builds-for-agent | Christopher Baines | 2020-04-29 |
| | | | | As it's not dependent on the agent. | ||
* | List unprocessed builds in priority order | Christopher Baines | 2020-04-29 |
| | | | | So that the allocator can use the ordering. | ||
* | Memoize output-has-successful-build? | Christopher Baines | 2020-04-29 |
| | | | | This is called for the same outputs multiple times, so memoize the result. | ||
* | Add a useful comment | Christopher Baines | 2020-04-29 |
| | |||
* | Use a hash-table for setup failures, rather than an alist | Christopher Baines | 2020-04-29 |
| | | | | This will probably perform better when there are lots of step failures. | ||
* | Switch around which order to join build_results on | Christopher Baines | 2020-04-29 |
| | | | | | This order seems to result in a better query plan, avoiding scanning the entire builds table. | ||
* | Add a couple of indexes that should speed up allocating builds | Christopher Baines | 2020-04-29 |
| | |||
* | Increase the number of times to retry agent requests | Christopher Baines | 2020-04-29 |
| | |||
* | Improve the error handling in datastore-store-build-result | Christopher Baines | 2020-04-29 |
| | |||
* | Check that the agent uuid is a string | Christopher Baines | 2020-04-28 |
| | | | | It can be #f if no agent is allocated the build. | ||
* | Start timing the duration of a couple of coordinator actions | Christopher Baines | 2020-04-28 |
| | |||
* | Fix the datastore-list-builds-for-output metric name | Christopher Baines | 2020-04-28 |
| | |||
* | Retry file uploads to the coordinator | Christopher Baines | 2020-04-28 |
| | | | | | Previously SIGPIPE killed the agent. This should avoid that and have the agent retry. | ||
* | Remove some left over debugging | Christopher Baines | 2020-04-28 |
| | |||
* | Fix the histogram implementation | Christopher Baines | 2020-04-28 |
| | | | | | | At least a bit, don't just update a single bucket on observations, but update all the relevant buckets (all buckets with a upper bound <= than the value being observed). | ||
* | Fix --update-database | Christopher Baines | 2020-04-28 |
| | |||
* | Create an index on derivation_outputs.output | Christopher Baines | 2020-04-28 |
| | | | | | This is important to speed up looking for derivations that provide an output, that's used in the allocation process. | ||
* | Fix metric namespacing in a few places | Christopher Baines | 2020-04-28 |
| | |||
* | Track the duration of the build allocation | Christopher Baines | 2020-04-28 |
| | |||
* | Start tracking the duration of a few datastore functions | Christopher Baines | 2020-04-28 |
| |