aboutsummaryrefslogtreecommitdiff
path: root/guix-data-service/jobs
Commit message (Collapse)AuthorAge
* Allow using the heap profiler in the inferiorChristopher Baines14 days
|
* More efficiently create some vectorsChristopher Baines14 days
| | | | | And instrument the inferior memory after creating the gds-inferior-packages vector.
* Do more when cleaning inferiorsChristopher Baines14 days
| | | | Not sure if this actually helps, but it might do.
* Add log-tag when inserting channel instance derivationsChristopher Baines14 days
|
* Always assume that resource pool waiters will stick aroundChristopher Baines2024-11-05
| | | | As I think this is a more efficient design.
* Move the inferior cleanup to the end of each system+targetChristopher Baines2024-11-04
|
* RefactorChristopher Baines2024-11-03
|
* Use a separate db connection in channel-derivations-by-system-promiseChristopher Baines2024-11-02
| | | | As this can run in parallel with something else using conn.
* Finish chasing the call-with-resource-pool bugChristopher Baines2024-10-31
| | | | | | | | This took a while to find as process-job would just get stuck, and this wasn't directly related to any particular change, just that more fibers increased the chance of hitting it. This commit includes lots of the things I changed while debugging.
* Add a commentChristopher Baines2024-10-27
|
* Rework inserting derivationsChristopher Baines2024-10-27
| | | | To add more parallelism.
* Use a common derivation-ids-hash-tableChristopher Baines2024-10-27
| | | | | | To allow for calling derivation-file-names->derivation-ids in parallel across multiple fibers, using the PostgreSQL connection fiber to perform atomic operations.
* Include the package version in the "error when computing" messagesChristopher Baines2024-10-27
| | | | As this helps when there are lots of packages with the same name.
* Ensure the guix derivations are stored prior to attempting to substituteChristopher Baines2024-10-27
|
* Fix extract-information-from messageChristopher Baines2024-10-27
|
* Increase parallelism when loading revisionsChristopher Baines2024-10-27
|
* Use a dedicated fiber for heap size monitoringChristopher Baines2024-10-27
|
* Fix free-disk-space callChristopher Baines2024-10-13
| | | | As the WAL file might not exist.
* Make the WAL threshold more flexibleChristopher Baines2024-10-10
| | | | | | So that the WAL can grow more when there's sufficient space. When the inferiors are closed it takes time to restart them, so doing this less should speed up processing revisions.
* Add retrying around inserting channel instance derivationsChristopher Baines2024-08-29
|
* Stop using profiles for channel instancesChristopher Baines2024-08-27
| | | | | Just use the store item instead. This should avoid issues where the profile gets GC'd.
* Further reduce the chunk sizeChristopher Baines2024-08-20
|
* Increase the WAL thresholdChristopher Baines2024-08-20
|
* Increase the inferior idle secondsChristopher Baines2024-08-18
|
* Improve logging around use of inferiorsChristopher Baines2024-08-17
|
* Log the number of inferiors when reporting WAL issuesChristopher Baines2024-08-16
| | | | And reduce the threshold.
* Check the WAL size more frequently when using inferiorsChristopher Baines2024-08-16
| | | | | | Since getting an inferior from the pool can take some time, it's not sufficient to just check prior to attempting to fetch an inferior from the pool. Instead set a timeout and check periodically.
* Check the WAL size before computing lint warningsChristopher Baines2024-08-16
| | | | | As even though this might not use the store, the inferior still holds a store connection open.
* Use system-ids for inserting distribution countsChristopher Baines2024-08-12
|
* Reduce chunk sizeChristopher Baines2024-08-12
| | | | To try and respond quicker when the WAL is growing.
* Check the WAL size for each chunkChristopher Baines2024-08-12
| | | | | | Rather than for each system and target, as this should mean the response (pausing and allowing inferiors and store connections to be closed) is quicker.
* Start trying to handle GC happening while processing revisionsChristopher Baines2024-08-12
|
* Parallelise inserting package derivation distribution countsChristopher Baines2024-08-10
|
* Get the test suite working againChristopher Baines2024-08-07
|
* Move inserting derivations in to the load-new-guix-revision moduleChristopher Baines2024-08-07
| | | | | And start to more closely integrate it. This makes it possible to start making it faster by doing more in parallel.
* Compute package derivations in chunksChristopher Baines2024-07-19
| | | | | | This allows for keeping the inferiors and store connections around for a more constant period, and allows closing the store connections and allowing the guix-daemon to clear the WAL file if needed.
* Reduce the WAL size thresholdChristopher Baines2024-07-19
|
* Rewrite the key parts of loading data to be even more parallelChristopher Baines2024-07-19
| | | | | | | Use a pool for the database connection, and a fibers promise for the package ids, and run other parts of the process in parallel too. This change also means that inserting starts as soon as some data is available, rather than when all the data is available.
* Insert package derivations earlierChristopher Baines2024-07-19
|
* Return two values from channel->source-and-derivations-by-systemChristopher Baines2024-07-19
|
* Avoid long running store connectionsChristopher Baines2024-07-19
| | | | As I think this can cause the guix-daemon WAL to grow excessively.
* Catch and ignore the new cross build derivation errorsChristopher Baines2024-07-18
|
* Refactor opening store connections when processing jobsChristopher Baines2024-07-18
| | | | And set the #:built-in-builders.
* Log more timing infromation about inserting derivationsChristopher Baines2024-07-16
|
* Block asyncs when starting inferiorsChristopher Baines2024-06-24
| | | | Because this code deals with global state, like environment variables.
* Support setting environment variables in the inferiorChristopher Baines2024-06-24
| | | | When processing jobs, this is mostly to allow setting GUIX_DOWNLOAD_METHODS.
* Fix WAL thresholdChristopher Baines2024-05-13
| | | | As it was too small.
* Attempt to avoid the WAL growing excessivelyChristopher Baines2024-04-25
|
* Use non-blocking inferior-eval-with-store in for glibc-localesChristopher Baines2024-04-25
|
* Further change job store connection handlingChristopher Baines2024-04-25
| | | | | The guix-dameon WAL is still growing excessively, so avoid doing anything with the long running store connection except registering temporary roots.
generated by cgit v1.2.3 (git 2.45.0) at 2024-11-22 12:25:10 +0000