Commit message (Collapse) | Author | Age | |
---|---|---|---|
* | Add retrying around inserting channel instance derivations | Christopher Baines | 2024-08-29 |
| | |||
* | Stop using profiles for channel instances | Christopher Baines | 2024-08-27 |
| | | | | | Just use the store item instead. This should avoid issues where the profile gets GC'd. | ||
* | Handle concatenated data in package-derivation-data->names-and-versions | Christopher Baines | 2024-08-22 |
| | | | | | As this broke when constructing the package-data from separate queries per system. | ||
* | Further reduce the chunk size | Christopher Baines | 2024-08-20 |
| | |||
* | Increase the WAL threshold | Christopher Baines | 2024-08-20 |
| | |||
* | Make the free space requirement configurable | Christopher Baines | 2024-08-20 |
| | |||
* | Increase the inferior idle seconds | Christopher Baines | 2024-08-18 |
| | |||
* | Improve the implementation of checking for idle resources | Christopher Baines | 2024-08-18 |
| | |||
* | Improve logging around use of inferiors | Christopher Baines | 2024-08-17 |
| | |||
* | Log the number of inferiors when reporting WAL issues | Christopher Baines | 2024-08-16 |
| | | | | And reduce the threshold. | ||
* | Check the WAL size more frequently when using inferiors | Christopher Baines | 2024-08-16 |
| | | | | | | Since getting an inferior from the pool can take some time, it's not sufficient to just check prior to attempting to fetch an inferior from the pool. Instead set a timeout and check periodically. | ||
* | Check the WAL size before computing lint warnings | Christopher Baines | 2024-08-16 |
| | | | | | As even though this might not use the store, the inferior still holds a store connection open. | ||
* | Use more threads for the server | Christopher Baines | 2024-08-14 |
| | | | | Just in case this avoids writing responses blocking new requests coming in. | ||
* | Move the resource pools to a different thread | Christopher Baines | 2024-08-14 |
| | | | | As the server thread can block for a while when writing big responses. | ||
* | Allow setting the scheduler for a resource pool | Christopher Baines | 2024-08-14 |
| | |||
* | Tweak handling web server errors | Christopher Baines | 2024-08-14 |
| | |||
* | Name the resource pools | Christopher Baines | 2024-08-14 |
| | |||
* | Include the pool name in the resource pool timeout exception | Christopher Baines | 2024-08-14 |
| | |||
* | Make resource pools a record | Christopher Baines | 2024-08-14 |
| | | | | So that the name is known when requesting a resource from the pool. | ||
* | Use system-ids for inserting distribution counts | Christopher Baines | 2024-08-12 |
| | |||
* | Add more logging to backfilling ↵ | Christopher Baines | 2024-08-12 |
| | | | | guix_revision_package_derivation_distribution_counts | ||
* | Reduce chunk size | Christopher Baines | 2024-08-12 |
| | | | | To try and respond quicker when the WAL is growing. | ||
* | Check the WAL size for each chunk | Christopher Baines | 2024-08-12 |
| | | | | | | Rather than for each system and target, as this should mean the response (pausing and allowing inferiors and store connections to be closed) is quicker. | ||
* | Start trying to handle GC happening while processing revisions | Christopher Baines | 2024-08-12 |
| | |||
* | Parallelise inserting package derivation distribution counts | Christopher Baines | 2024-08-10 |
| | |||
* | Get the test suite working again | Christopher Baines | 2024-08-07 |
| | |||
* | Move inserting derivations in to the load-new-guix-revision module | Christopher Baines | 2024-08-07 |
| | | | | | And start to more closely integrate it. This makes it possible to start making it faster by doing more in parallel. | ||
* | Add the fiberize utility | Christopher Baines | 2024-08-07 |
| | |||
* | Stream the render-revision-package-derivations JSON response | Christopher Baines | 2024-08-05 |
| | | | | As it can be large. | ||
* | Fix the pool metrics | Christopher Baines | 2024-07-29 |
| | |||
* | Tweak timeouts in resource-pool-stats | Christopher Baines | 2024-07-29 |
| | |||
* | Try using 2 threads for the server | Christopher Baines | 2024-07-26 |
| | |||
* | Add worker thread utils | Christopher Baines | 2024-07-20 |
| | |||
* | Compute package derivations in chunks | Christopher Baines | 2024-07-19 |
| | | | | | | This allows for keeping the inferiors and store connections around for a more constant period, and allows closing the store connections and allowing the guix-daemon to clear the WAL file if needed. | ||
* | Reduce the WAL size threshold | Christopher Baines | 2024-07-19 |
| | |||
* | Rewrite the key parts of loading data to be even more parallel | Christopher Baines | 2024-07-19 |
| | | | | | | | Use a pool for the database connection, and a fibers promise for the package ids, and run other parts of the process in parallel too. This change also means that inserting starts as soon as some data is available, rather than when all the data is available. | ||
* | Add more fibers utilities | Christopher Baines | 2024-07-19 |
| | |||
* | Insert package derivations earlier | Christopher Baines | 2024-07-19 |
| | |||
* | Return two values from channel->source-and-derivations-by-system | Christopher Baines | 2024-07-19 |
| | |||
* | Avoid long running store connections | Christopher Baines | 2024-07-19 |
| | | | | As I think this can cause the guix-daemon WAL to grow excessively. | ||
* | Catch and ignore the new cross build derivation errors | Christopher Baines | 2024-07-18 |
| | |||
* | Refactor opening store connections when processing jobs | Christopher Baines | 2024-07-18 |
| | | | | And set the #:built-in-builders. | ||
* | Re-work the fibers scheduling | Christopher Baines | 2024-07-16 |
| | | | | | | | | Use a single thread for receiving and responding to requests, and delegate the processing of the requests to a separate set of threads. I'm hoping this will avoid the processing of requests affecting accepting new connections, or the sending of responses. | ||
* | Use a bigger buffer for requests/responses | Christopher Baines | 2024-07-16 |
| | | | | As I'm hoping this will increase the data throughput for responses. | ||
* | Stream the package derivation page since it can be large | Christopher Baines | 2024-07-16 |
| | |||
* | Add more time logging in to insert-missing-derivations | Christopher Baines | 2024-07-16 |
| | |||
* | Log more timing infromation about inserting derivations | Christopher Baines | 2024-07-16 |
| | |||
* | Stop inserting missing source file nars | Christopher Baines | 2024-07-16 |
| | | | | | This was more an issue several years ago, so this code is not really needed now. | ||
* | Try and speed up large package derivation comparisions | Christopher Baines | 2024-07-12 |
| | |||
* | Fix delete-revisions-from-branch | Christopher Baines | 2024-07-07 |
| |