aboutsummaryrefslogtreecommitdiff
path: root/nar-herder
Commit message (Collapse)AuthorAge
* Initialise the recent changes countChristopher Baines2024-03-14
|
* Stop updating the nar_files_total metric twiceChristopher Baines2024-03-14
|
* Instrument the recent changes countChristopher Baines2024-03-14
|
* Instrument the recent changes limitChristopher Baines2024-03-14
| | | | This doesn't change, but it's useful to have the value as a metric.
* Initialise the storage metricsChristopher Baines2024-03-13
| | | | This used to happen, and this commit brings it back.
* Don't allow the mirror and removal channel to be unspecifiedChristopher Baines2023-11-23
| | | | As this is truthy.
* Move most functionality out of the start scriptChristopher Baines2023-09-12
| | | | As this can make debugging easier.
* Make with-fibers-port-timeouts work without fibersChristopher Baines2023-09-12
| | | | | As it's easy to try and use code in both contexts, so try and support that.
* Improve backtraces through call-with-cached-connectionChristopher Baines2023-09-12
|
* Update retry-on-error procedure from the Guix Build CoordinatorChristopher Baines2023-09-12
|
* Use recent changes to trigger the removal of narsChristopher Baines2023-09-12
| | | | | Both when the nar has been removed from the database, and to check if it should no longer be stored.
* Improve the metric handling furtherChristopher Baines2023-09-12
| | | | | This should avoid the metric being adjusted before it's been set initially.
* Remove get-nar-filesChristopher Baines2023-09-12
| | | | As it doesn't scale well.
* Use fold-nar-files for check-storageChristopher Baines2023-09-12
| | | | To avoid calling get-nar-files, as this doesn't scale well.
* Add more logging around requesting recent changesChristopher Baines2023-09-12
|
* Cleanup handling of the nar_files_total metricChristopher Baines2023-09-12
|
* Remove the get-nar-files call from the fetch changes fiberChristopher Baines2023-09-12
| | | | As this is quite expensive.
* Log the procedure delayed for database operationsChristopher Baines2023-09-12
|
* Sleep on exceptions in the recent change removal fiberChristopher Baines2023-09-12
|
* Show backtraces for fetch-file exceptionsChristopher Baines2023-09-12
|
* Make sure to use streaming http requests everywhereChristopher Baines2023-09-12
| | | | As this avoids blocking.
* Add some more loggingChristopher Baines2023-09-12
|
* Enforce an ordering in database-select-recent-changesChristopher Baines2023-09-12
|
* Remove some unused importsChristopher Baines2023-09-12
|
* Use fibers in fast-download-narsChristopher Baines2023-09-12
| | | | As it's within a fibers thread now.
* Use recent changes to trigger nar mirroring and removalChristopher Baines2023-09-12
| | | | | As this should be more efficient than repeatedly looking through all the nars in the database.
* Use fibers for the recent changes removal threadChristopher Baines2023-09-12
|
* Use fibers timeouts for all http requestsChristopher Baines2023-09-12
|
* Add new fibers timeout utilsChristopher Baines2023-09-12
| | | | | This depends on a tweaked version of (fibers io-wakeup), which calls select of the file descriptors, rather than the ports.
* Remove set-socket-timeoutChristopher Baines2023-09-12
| | | | As I don't think it's useful on non blocking sockets.
* Stop using with-port-timeoutsChristopher Baines2023-09-12
| | | | As this is incompatible with fibers.
* Move most maintenance activity to fibersChristopher Baines2023-09-12
| | | | | On a single separate thread. This will allow for spawning fibers for various maintenance actions.
* Correct the metric problems from introducing fold-nar-filesChristopher Baines2023-09-12
| | | | The metrics are now updated at the end.
* Name an unnamed threadChristopher Baines2023-09-08
|
* Name some worker threadsChristopher Baines2023-09-08
|
* Avoid fast-download-nars from calling get-nar-filesChristopher Baines2023-09-08
| | | | As this is expensive when there are a large number of nars.
* Add fold-nar-files and use it in a few placesChristopher Baines2023-09-08
| | | | As this should use less memory than get-nar-files.
* Add datastore-fold-all-narinfo-filesChristopher Baines2023-09-07
|
* Set thread names for worker threadsChristopher Baines2023-09-07
|
* Include metrics for ports and file descriptorsChristopher Baines2023-09-07
|
* Use call-with-duration-metric helperChristopher Baines2023-09-07
|
* Throw some connection caching in for info requestsChristopher Baines2023-07-27
| | | | To avoid opening a new connection for each request.
* Add better exception handling and retrying when mirroring narsChristopher Baines2023-07-21
|
* Try to keep on top of mirroring narsChristopher Baines2023-07-21
| | | | Only sleep when there were no changes or exceptions.
* Drop the number of fibers threadsChristopher Baines2023-07-12
|
* Drop the socket timeout when fetching changesChristopher Baines2023-07-12
| | | | As I'm still seeing this hang.
* Log just before querying for recent changesChristopher Baines2023-07-08
|
* Cleanup temp files on exceptions when generating cached compressionsChristopher Baines2023-07-08
|
* Name some more threadsChristopher Baines2023-07-08
|
* Set low level timeouts for HTTP requestsChristopher Baines2023-06-30
| | | | To try to avoid things getting stuck.
generated by cgit v1.2.3 (git 2.25.4) at 2024-06-25 23:34:44 +0000