| Commit message (Expand) | Author | Age |
... | |
* | Fix sorting license sets | Christopher Baines | 2024-11-08 |
* | Fix starting with an empty database | Christopher Baines | 2024-11-08 |
* | Have the background resource pool users be very patient | Christopher Baines | 2024-11-05 |
* | Always assume that resource pool waiters will stick around•••As I think this is a more efficient design.
| Christopher Baines | 2024-11-05 |
* | Move the inferior cleanup to the end of each system+target | Christopher Baines | 2024-11-04 |
* | Refactor | Christopher Baines | 2024-11-03 |
* | Use a separate db connection in channel-derivations-by-system-promise•••As this can run in parallel with something else using conn.
| Christopher Baines | 2024-11-02 |
* | Increase the sleep-operation time for telling waiters to retry•••As this being too short was leading call-with-resource-pool to get stuck.
| Christopher Baines | 2024-10-31 |
* | Finish chasing the call-with-resource-pool bug•••This took a while to find as process-job would just get stuck, and this wasn't
directly related to any particular change, just that more fibers increased the
chance of hitting it.
This commit includes lots of the things I changed while debugging.
| Christopher Baines | 2024-10-31 |
* | Tweak the resource pool return behaviour•••If there's lots of contention for the resource pool, there will be lots of
waiters, so telling all of them to retry whenever a resource is returned seems
wasteful. This commit adds a new option (assume-reliable-waiters?) which will
have the resource pool try to give a returned resource to the oldest waiter,
if this fails, it'll go back to the old behaviour of telling all waiters to
retry.
| Christopher Baines | 2024-10-31 |
* | Ensure that call-with-resource-from-pool doesn't get stuck•••As I think this was happening when it missed the resource-pool-retry-checkout
reply from the resource pool. Handle this case by periodically retrying with a
configurable timeout.
| Christopher Baines | 2024-10-31 |
* | Add call-with-default-io-waiters•••As this is useful when starting threads from a fibers context.
| Christopher Baines | 2024-10-31 |
* | Add new fibers utilities•••The new fibers-map uses the same batching approach that fibers-for-each uses,
and fibers-map-with-progress allows tracking on the results while the map is
happening.
| Christopher Baines | 2024-10-31 |
* | Add make-queueing-channel•••From the build coordinator.
| Christopher Baines | 2024-10-31 |
* | Add a comment | Christopher Baines | 2024-10-27 |
* | Rework inserting derivations•••To add more parallelism.
| Christopher Baines | 2024-10-27 |
* | Use a common derivation-ids-hash-table•••To allow for calling derivation-file-names->derivation-ids in parallel across
multiple fibers, using the PostgreSQL connection fiber to perform atomic
operations.
| Christopher Baines | 2024-10-27 |
* | Add placeholder derivation source file nar procedures | Christopher Baines | 2024-10-27 |
* | Include the package version in the "error when computing" messages•••As this helps when there are lots of packages with the same name.
| Christopher Baines | 2024-10-27 |
* | Ensure the guix derivations are stored prior to attempting to substitute | Christopher Baines | 2024-10-27 |
* | Add fibers-promise-reset | Christopher Baines | 2024-10-27 |
* | Fix extract-information-from message | Christopher Baines | 2024-10-27 |
* | Increase parallelism when loading revisions | Christopher Baines | 2024-10-27 |
* | Use a dedicated fiber for heap size monitoring | Christopher Baines | 2024-10-27 |
* | Fix free-disk-space call•••As the WAL file might not exist.
| Christopher Baines | 2024-10-13 |
* | Make the WAL threshold more flexible•••So that the WAL can grow more when there's sufficient space. When the
inferiors are closed it takes time to restart them, so doing this less should
speed up processing revisions.
| Christopher Baines | 2024-10-10 |
* | Vacuum some tables when deleting derivations | Christopher Baines | 2024-10-04 |
* | Don't use the reserved pool for HTML/JSON responses•••Just use it for providing substitutes.
| Christopher Baines | 2024-09-08 |
* | Include background pool metrics | Christopher Baines | 2024-09-08 |
* | Increase the resource pool default timeout a little | Christopher Baines | 2024-09-08 |
* | Speed up package-description-and-synopsis-locale-options-guix-revision | Christopher Baines | 2024-09-08 |
* | Don't timeout waiting for background pool connections | Christopher Baines | 2024-09-08 |
* | Add a new background connection pool•••Mostly to constrain the build server event handlers.
| Christopher Baines | 2024-09-08 |
* | Speed up select-builds-with-context-by-derivation-output | Christopher Baines | 2024-09-07 |
* | Add an index on builds.build_server_build_id•••As this is used when rendering builds.
| Christopher Baines | 2024-09-07 |
* | Timeout when trying to process build events•••As if they relate to derivations that are currently being inserted, they'll
have to wait until the job is processed.
| Christopher Baines | 2024-09-03 |
* | Add retrying around inserting channel instance derivations | Christopher Baines | 2024-08-29 |
* | Stop using profiles for channel instances•••Just use the store item instead. This should avoid issues where the profile
gets GC'd.
| Christopher Baines | 2024-08-27 |
* | Handle concatenated data in package-derivation-data->names-and-versions•••As this broke when constructing the package-data from separate queries per
system.
| Christopher Baines | 2024-08-22 |
* | Further reduce the chunk size | Christopher Baines | 2024-08-20 |
* | Increase the WAL threshold | Christopher Baines | 2024-08-20 |
* | Make the free space requirement configurable | Christopher Baines | 2024-08-20 |
* | Increase the inferior idle seconds | Christopher Baines | 2024-08-18 |
* | Improve the implementation of checking for idle resources | Christopher Baines | 2024-08-18 |
* | Improve logging around use of inferiors | Christopher Baines | 2024-08-17 |
* | Log the number of inferiors when reporting WAL issues•••And reduce the threshold.
| Christopher Baines | 2024-08-16 |
* | Check the WAL size more frequently when using inferiors•••Since getting an inferior from the pool can take some time, it's not
sufficient to just check prior to attempting to fetch an inferior from the
pool. Instead set a timeout and check periodically.
| Christopher Baines | 2024-08-16 |
* | Check the WAL size before computing lint warnings•••As even though this might not use the store, the inferior still holds a store
connection open.
| Christopher Baines | 2024-08-16 |
* | Use more threads for the server•••Just in case this avoids writing responses blocking new requests coming in.
| Christopher Baines | 2024-08-14 |
* | Move the resource pools to a different thread•••As the server thread can block for a while when writing big responses.
| Christopher Baines | 2024-08-14 |