Commit message (Collapse) | Author | Age | |
---|---|---|---|
* | Instrument the resource pool checkout timeoutsHEADmaster | Christopher Baines | 10 days |
| | |||
* | Add support for tracking resource pool checkout timeouts | Christopher Baines | 10 days |
| | |||
* | Close store connections earlier | Christopher Baines | 10 days |
| | | | | | As I think the temporary roots on the long running store connection should be sufficient. | ||
* | Add error handling for startup failures | Christopher Baines | 2024-04-02 |
| | |||
* | Guard against logging failing | Christopher Baines | 2024-04-02 |
| | | | | As I've seen this happening where there are errors writing to FD 1. | ||
* | Move sleep to start of spawn-port-monitoring-fiber | Christopher Baines | 2024-04-02 |
| | |||
* | Switch to spawn for running sqitch | Christopher Baines | 2024-04-02 |
| | | | | As system* seems to break sigaction picking up SIGINT. | ||
* | Close unused PostgreSQL connections | Christopher Baines | 2024-04-01 |
| | | | | As they take up memory, so free some by closing them. | ||
* | Remove the per-thread PostgreSQL connection code | Christopher Baines | 2024-04-01 |
| | | | | As this has been replaced by a fibers resource pool. | ||
* | Move backfilling in to the server module and use the connection pool | Christopher Baines | 2024-04-01 |
| | | | | To avoid using the old PostgreSQL connection per thread code. | ||
* | Stop using a inferior-package-derivations lock | Christopher Baines | 2024-03-31 |
| | | | | | As this isn't for correctness reasons, but resource usage. I'm hoping to manage this differently. | ||
* | Make changes for the guile-prometheus update | Christopher Baines | 2024-03-30 |
| | |||
* | Fallback when building channel instances | Christopher Baines | 2024-03-13 |
| | |||
* | Don't start new jobs when there's low disk space | Christopher Baines | 2024-03-11 |
| | |||
* | Attempt to avoid issues with the guix-daemon WAL | Christopher Baines | 2024-03-08 |
| | |||
* | Allow prioritising jobs from specific repositories | Christopher Baines | 2024-03-07 |
| | | | | To help the QA data service prioritise branches over patches. | ||
* | Report the size of the guix database and WAL file | Christopher Baines | 2024-03-05 |
| | | | | Since the Guix daemon doesn't export these metrics, instrument it here. | ||
* | Add exception handling to the process-jobs script | Christopher Baines | 2024-03-05 |
| | | | | As I'm seeing this exit on beid, but I'm not sure why. | ||
* | Further fix handling exceptions when computing channel instances | Christopher Baines | 2024-02-13 |
| | |||
* | Copy the port monitoring fiber from the build coordinator | Christopher Baines | 2024-02-13 |
| | | | | As the data service has the same issue where it stops listening on the port. | ||
* | Instrument resource pool checkout failures | Christopher Baines | 2024-02-10 |
| | | | | As I've got no idea why the resource pools sometimes stop working. | ||
* | Improve exception handling for channel instance derivations | Christopher Baines | 2024-02-03 |
| | |||
* | Cleanup some with-time-logging | Christopher Baines | 2024-02-02 |
| | |||
* | Compute lint warnings in parallel | Christopher Baines | 2024-02-01 |
| | |||
* | Speed up loading package metadata | Christopher Baines | 2024-02-01 |
| | | | | By batching the SQL queries. | ||
* | Ignore inferior-protocol-error when computing channel instances | Christopher Baines | 2024-02-01 |
| | | | | | Since this seems to happen for i586-gnu for core-updates currently and I can't seem to reproduce the issue locally or work out what's wrong. | ||
* | Fix exception handling in call-with-temporary-thread | Christopher Baines | 2024-02-01 |
| | |||
* | Split up handling of package description data | Christopher Baines | 2024-01-31 |
| | | | | To hopefully see which part is slow. | ||
* | Speed up fetching package replacements | Christopher Baines | 2024-01-31 |
| | |||
* | Add more logging in when computing channel instance derivations | Christopher Baines | 2024-01-31 |
| | | | | | As there's an issue with current core-updates that I'm struggling to track down. | ||
* | Add some time logging in to inferior-packages-plus-replacements | Christopher Baines | 2024-01-28 |
| | |||
* | Make sure to keep roots for channel instance derivations | Christopher Baines | 2024-01-28 |
| | |||
* | Remove even more time logging | Christopher Baines | 2024-01-28 |
| | |||
* | Improve logging when computing a channel instance derivation fails | Christopher Baines | 2024-01-27 |
| | |||
* | Log the time to call inferior-packages-plus-replacements | Christopher Baines | 2024-01-27 |
| | | | | As I think this is currently quite slow. | ||
* | Remove some time logging | Christopher Baines | 2024-01-27 |
| | | | | As this is a bit noisy. | ||
* | Try to fix issues with derivations being GC'ed | Christopher Baines | 2024-01-19 |
| | |||
* | Remove drain? #t from process job | Christopher Baines | 2024-01-18 |
| | | | | As it now uses more fibers. | ||
* | Fixup tests | Christopher Baines | 2024-01-18 |
| | |||
* | Add meaningful parallelism to processing jobs | Christopher Baines | 2024-01-18 |
| | | | | | | | | | | | Make parallel use of inferiors when computing channel instance derivations, and when extracting information about a revision. This should allow for some horizontal scalability, reducing the impact of additional systems for which derivations need computing. This commit also fixes an apparent issue with package replacements, as previously the wrong id was used, and this hid some issues around deduplication. | ||
* | Split and instrument parts of inferior-packages->package-metadata-ids | Christopher Baines | 2024-01-18 |
| | | | | As parts of it are slow. | ||
* | Rewrite part of insert-missing-data-and-return-all-ids to avoid filter | Christopher Baines | 2024-01-18 |
| | | | | | As filter can use part of the input list, which then prevents modifying the filtered list. | ||
* | Fix par-map& | Christopher Baines | 2024-01-18 |
| | | | | To actually work in parallel. | ||
* | Show backtraces when using parallel fibers and resource pools | Christopher Baines | 2024-01-18 |
| | |||
* | Make it possible to destroy a resource pool | Christopher Baines | 2024-01-18 |
| | | | | And implement removing idle resources. | ||
* | Have delete-duplicates/sort! take a equality procedure | Christopher Baines | 2024-01-18 |
| | | | | And change the default, as eq? doesn't always work. | ||
* | Add back inferior heap size reporting | Christopher Baines | 2024-01-18 |
| | | | | I'm sure this was present before, but maybe lost during some refactoring. | ||
* | Use delete-duplicates/sort! in inferior-packages->license-set-ids | Christopher Baines | 2024-01-18 |
| | | | | As it should offer a speedup over delete-duplicates. | ||
* | Use delete-duplicates/sort! in insert-missing-data-and-return-all-ids | Christopher Baines | 2024-01-18 |
| | | | | As it's faster than delete-duplicates for large amounts of data. | ||
* | Use libc-locales-for-target | Christopher Baines | 2023-12-04 |
| | | | | To help find the right glibc-locales to use. |