Commit message (Collapse) | Author | Age | |
---|---|---|---|
* | Introduce an outputs table | Christopher Baines | 2021-05-21 |
| | |||
* | Line buffer the queue builds script output | Christopher Baines | 2021-05-14 |
| | | | | So that the output is more consistent. | ||
* | Simplify the work queue loop | Christopher Baines | 2021-05-14 |
| | |||
* | Buffer the network socket used for streaming http requests | Christopher Baines | 2021-05-13 |
| | | | | As this helps improve throughput. | ||
* | Use a bigger buffer when uploading logs | Christopher Baines | 2021-05-13 |
| | | | | As I think this might make it faster. | ||
* | Increase the basic build allocation strategy default planned builds | Christopher Baines | 2021-04-27 |
| | | | | | Mostly so the coordinator for building patches plans more builds at once, since the allocator is very slow at the moment. | ||
* | Stop agent threads only when 2 or more are idle | Christopher Baines | 2021-04-23 |
| | | | | | | If the jobs are really quick, I think the one running thread keeps stopping and starting, and that stops the agent starting more threads. I think this change might help. | ||
* | Handle receiving outputs as a bytevector | Christopher Baines | 2021-04-23 |
| | | | | This can happen if the request doesn't arrive in chunks. | ||
* | Remove non-existent export | Christopher Baines | 2021-04-20 |
| | |||
* | Make some SQLite related improvements | Christopher Baines | 2021-04-20 |
| | | | | | Don't keep database connections around forever as this relates to cached query plans, and also run the optimize pragma when closing connections. | ||
* | Support destructors and lifetimes for worker threads | Christopher Baines | 2021-04-20 |
| | |||
* | Support finding blocking builds not including cancelled ones | Christopher Baines | 2021-04-16 |
| | | | | As including cancelled ones can make the query much slower. | ||
* | Handle receiving logs as bytevectors | Christopher Baines | 2021-04-09 |
| | | | | I think this can happen if the log doesn't arrive as a chunked HTTP request. | ||
* | Fix the foreign key constraint on setup_failure_missing_inputs | Christopher Baines | 2021-04-08 |
| | | | | It was broken in a previous migration. | ||
* | Always join against the derivations table | Christopher Baines | 2021-04-04 |
| | | | | | As that's now needed for the derivation name in datastore-list-failed-builds-with-blocking-count. | ||
* | Truncate the WAL if it exceeds 100MiB | Christopher Baines | 2021-04-04 |
| | | | | As database performance seems to start to drop off around this point. | ||
* | Fix tagging builds | Christopher Baines | 2021-04-02 |
| | |||
* | Always include derivation join | Christopher Baines | 2021-04-02 |
| | |||
* | Fix | Christopher Baines | 2021-03-30 |
| | |||
* | Fix more build id/uuid issues | Christopher Baines | 2021-03-30 |
| | |||
* | Fix | Christopher Baines | 2021-03-30 |
| | |||
* | Fix types in the allocated_builds table | Christopher Baines | 2021-03-30 |
| | |||
* | Stop quoting number build ids | Christopher Baines | 2021-03-30 |
| | |||
* | Fix more type issues | Christopher Baines | 2021-03-30 |
| | |||
* | Fix incorrect parameter | Christopher Baines | 2021-03-30 |
| | |||
* | Fix GROUP BY | Christopher Baines | 2021-03-30 |
| | |||
* | Add missing GROUP BY | Christopher Baines | 2021-03-30 |
| | | | | This was removed in error in 57932a3d80ba6e41bb349487372f990cf56063d1. | ||
* | Fix datastore-fetch-build-ids... not returnning uuids | Christopher Baines | 2021-03-30 |
| | |||
* | Fix issue with numeric build IDs in strings | Christopher Baines | 2021-03-30 |
| | |||
* | Start the allocator and hook threads later | Christopher Baines | 2021-03-29 |
| | | | | It's important that this code doesn't run until Sqitch has run. | ||
* | Use numeric ids for the derivations and builds | Christopher Baines | 2021-03-29 |
| | | | | | Using natural IDs was nice at the start, but just doesn't scale. This migration cuts the database size, and potentially speeds up queries as well. | ||
* | Only show blocking builds which actually block at least one build | Christopher Baines | 2021-03-29 |
| | | | | Otherwise this turns in to a list of mostly canceled builds. | ||
* | Add some error handling for POST builds | Christopher Baines | 2021-03-27 |
| | |||
* | Include cancelled builds when looking for blocking builds | Christopher Baines | 2021-03-27 |
| | | | | As a build being cancelled can explain why others can't progress. | ||
* | Fix the build-failure-retry-hook | Christopher Baines | 2021-03-26 |
| | |||
* | Add Guile GC related metrics | Christopher Baines | 2021-03-25 |
| | | | | | I'm seeing mmap(PROT_NONE) failed crashes, and maybe these metrics will help in understanding what's going on. | ||
* | Fix bug in datastore-fetch-build-to-allocate | Christopher Baines | 2021-03-07 |
| | |||
* | Make the build failure retry hook more flexible | Christopher Baines | 2021-03-06 |
| | | | | | | | | Now a procedure can be passed in, which should return arguments for the builds to submit. I'm looking at using this to spread retries across a range of machines for example, by specifying different tags for each of the retries. | ||
* | Add a new dynamic authentication approach | Christopher Baines | 2021-02-28 |
| | | | | | | This avoids the need to create agents upfront, which could be useful when creating many childhurd VMs or using scheduling tools to dynamically run agents. | ||
* | Move request-query-parameters to utils | Christopher Baines | 2021-02-28 |
| | |||
* | Prepare for the addition of a (guix substitutes) module | Christopher Baines | 2021-02-23 |
| | | | | | | | If and when this happens, some proceduces will be moved. This change might avoid things breaking. https://issues.guix.gnu.org/45409 | ||
* | Ignore canceled builds when considering builds for related derivations | Christopher Baines | 2021-02-20 |
| | |||
* | Add exception handling for the submit outputs hook | Christopher Baines | 2021-02-18 |
| | |||
* | Fix processing the hook names | Christopher Baines | 2021-02-18 |
| | |||
* | Stop hardcoding hook names in the argument processing | Christopher Baines | 2021-02-18 |
| | |||
* | Add a hook for determining whether agents should submit outputs | Christopher Baines | 2021-02-17 |
| | | | | | This should make it possible to check properly whether the outputs are needed, instead of just assuming they are not if there's been a successful build. | ||
* | Avoid some threads and locks when running on the hurd | Christopher Baines | 2021-02-15 |
| | | | | I've see the process hang on the hurd, and I think this might help. | ||
* | Increase the derivation ordered allocator default planned builds | Christopher Baines | 2021-02-15 |
| | | | | | As the derivation ordered allocator is quite slow when there's a large number of builds to consider. | ||
* | Revert "Speed up the explicit WAL checkpoints" | Christopher Baines | 2021-02-14 |
| | | | | | | I'm not sure this is helping. This reverts commit ac6a85af9770fa2e2ac33ac20fbdf91103b32f21. | ||
* | Tweak the S3 publish hook to avoid issues for not submitted outputs | Christopher Baines | 2021-02-14 |
| | | | | | | | | | | | | Agents can skip submitting outputs where those outputs have already been received, this saves some work when all the information is communicated in the build status. The publish hook worked with this change, because it checks for narinfo files, and would not bother about the missing outputs if the corresponding narinfo existed. This didn't quite work with the s3 publish hook though, but these changes address that by getting the two hooks to write and check for narinfo files in the same location. |