aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAge
...
* Rename with-fibers-port-timeouts to with-port-timeoutsChristopher Baines2024-03-23
| | | | As it works with or without fibers.
* Tweak the server metricsChristopher Baines2024-03-22
| | | | | | Remove code in guile-prometheus, and use the new process collector. Also switch to using a non-namespaced registry for these non nar-herder specific collectors.
* Spawn cached compression fibers on the maintenance schedulerChristopher Baines2024-03-15
| | | | So they don't interact with the main scheduler.
* Add more TTL optionsChristopher Baines2024-03-15
| | | | | | I'm really not sure about this caching stuff, but these options should provide the flexibility to change the TTLs the nar-herder advertises gracefully.
* Update metrics while removing narsChristopher Baines2024-03-15
| | | | Rather than waiting until the end.
* Use cooperative fibers for maintenanceChristopher Baines2024-03-14
|
* Initialise the recent changes countChristopher Baines2024-03-14
|
* Stop updating the nar_files_total metric twiceChristopher Baines2024-03-14
|
* Instrument the recent changes countChristopher Baines2024-03-14
|
* Instrument the recent changes limitChristopher Baines2024-03-14
| | | | This doesn't change, but it's useful to have the value as a metric.
* Initialise the storage metricsChristopher Baines2024-03-13
| | | | This used to happen, and this commit brings it back.
* Have guild emit more warningsChristopher Baines2024-02-04
|
* Update .envrc to work with the newer direnvChristopher Baines2024-02-04
|
* Don't allow the mirror and removal channel to be unspecifiedChristopher Baines2023-11-23
| | | | As this is truthy.
* Move most functionality out of the start scriptChristopher Baines2023-09-12
| | | | As this can make debugging easier.
* Make with-fibers-port-timeouts work without fibersChristopher Baines2023-09-12
| | | | | As it's easy to try and use code in both contexts, so try and support that.
* Improve backtraces through call-with-cached-connectionChristopher Baines2023-09-12
|
* Update retry-on-error procedure from the Guix Build CoordinatorChristopher Baines2023-09-12
|
* Use recent changes to trigger the removal of narsChristopher Baines2023-09-12
| | | | | Both when the nar has been removed from the database, and to check if it should no longer be stored.
* Improve the metric handling furtherChristopher Baines2023-09-12
| | | | | This should avoid the metric being adjusted before it's been set initially.
* Remove get-nar-filesChristopher Baines2023-09-12
| | | | As it doesn't scale well.
* Use fold-nar-files for check-storageChristopher Baines2023-09-12
| | | | To avoid calling get-nar-files, as this doesn't scale well.
* Don't use JIT on aarch64Christopher Baines2023-09-12
| | | | | As there's bugs which cause parts of the program to execute more than once https://github.com/wingo/fibers/issues/83
* Add more logging around requesting recent changesChristopher Baines2023-09-12
|
* Cleanup handling of the nar_files_total metricChristopher Baines2023-09-12
|
* Remove the get-nar-files call from the fetch changes fiberChristopher Baines2023-09-12
| | | | As this is quite expensive.
* Log the procedure delayed for database operationsChristopher Baines2023-09-12
|
* Name the fibers threadsChristopher Baines2023-09-12
| | | | To help with debugging.
* Change the maintenance thread to not be cooperativeChristopher Baines2023-09-12
| | | | As I think this is causing problems.
* Sleep on exceptions in the recent change removal fiberChristopher Baines2023-09-12
|
* Show backtraces for fetch-file exceptionsChristopher Baines2023-09-12
|
* Make sure to use streaming http requests everywhereChristopher Baines2023-09-12
| | | | As this avoids blocking.
* Add some more loggingChristopher Baines2023-09-12
|
* Enforce an ordering in database-select-recent-changesChristopher Baines2023-09-12
|
* Remove some unused importsChristopher Baines2023-09-12
|
* Use fibers in fast-download-narsChristopher Baines2023-09-12
| | | | As it's within a fibers thread now.
* Use recent changes to trigger nar mirroring and removalChristopher Baines2023-09-12
| | | | | As this should be more efficient than repeatedly looking through all the nars in the database.
* Use fibers for the recent changes removal threadChristopher Baines2023-09-12
|
* Use fibers timeouts for all http requestsChristopher Baines2023-09-12
|
* Add new fibers timeout utilsChristopher Baines2023-09-12
| | | | | This depends on a tweaked version of (fibers io-wakeup), which calls select of the file descriptors, rather than the ports.
* Remove set-socket-timeoutChristopher Baines2023-09-12
| | | | As I don't think it's useful on non blocking sockets.
* Stop using with-port-timeoutsChristopher Baines2023-09-12
| | | | As this is incompatible with fibers.
* Move most maintenance activity to fibersChristopher Baines2023-09-12
| | | | | On a single separate thread. This will allow for spawning fibers for various maintenance actions.
* Switch to cooperative schedulingChristopher Baines2023-09-12
|
* Correct the metric problems from introducing fold-nar-filesChristopher Baines2023-09-12
| | | | The metrics are now updated at the end.
* Name an unnamed threadChristopher Baines2023-09-08
|
* Name some worker threadsChristopher Baines2023-09-08
|
* Avoid fast-download-nars from calling get-nar-filesChristopher Baines2023-09-08
| | | | As this is expensive when there are a large number of nars.
* Add fold-nar-files and use it in a few placesChristopher Baines2023-09-08
| | | | As this should use less memory than get-nar-files.
* Add datastore-fold-all-narinfo-filesChristopher Baines2023-09-07
|