Commit message (Collapse) | Author | Age | |
---|---|---|---|
* | Add experimental support for cached compressions | Christopher Baines | 2023-01-16 |
| | | | | | | This adds optional caching for alternative compressions of stored nars. You could store lzip nars for example, but then compute, cache and provide zstd nars for some stored nars. | ||
* | Extract out table-exists? | Christopher Baines | 2022-11-29 |
| | |||
* | Add index on narinfo_files.narinfo_id | Christopher Baines | 2022-06-24 |
| | | | | | This is important for finding narinfo_files by narinfo, which happens in database-select-narinfo-files. | ||
* | Add some instrumentation around the database | Christopher Baines | 2022-06-24 |
| | |||
* | Increase the maximum size of the reader thread pool | Christopher Baines | 2022-06-24 |
| | | | | As I think this might be a bottleneck. | ||
* | Increment request metrics for file requests | Christopher Baines | 2022-06-24 |
| | |||
* | Remove some empty lines | Christopher Baines | 2022-06-24 |
| | |||
* | Add experimental support for serving files by hash | Christopher Baines | 2022-06-10 |
| | | | | | | | | | | This route can be used to provide source files used in packages. The URL pattern is the same as used by guix publish. The main issue with the implementation is that the fibers web server expects the entire response to be in memory, so I'm not sure how well this will scale. Additionally, the code for extracting the file from the nar isn't ideal. | ||
* | Improve handling of nar removal | Christopher Baines | 2022-05-19 |
| | | | | When --storage is set and not set. | ||
* | Fiddle more with the nar removal criteria | Christopher Baines | 2022-05-19 |
| | | | | | This should make the singular stored-on and and'ed stored-on work properly. | ||
* | Encode filenames when passing the request back to nginx | Christopher Baines | 2022-05-17 |
| | | | | This handles filenames which contain characters like ? and =. | ||
* | Just retry fetching files on the next mirror pass | Christopher Baines | 2022-05-15 |
| | |||
* | Add a fast path for downloading nars when there's no storage limit | Christopher Baines | 2022-05-14 |
| | |||
* | Split out the downloading of nars | Christopher Baines | 2022-05-14 |
| | |||
* | Update the storage_size_bytes metric when removing nars | Christopher Baines | 2022-05-06 |
| | |||
* | Further fix the 'and nar removal criteria | Christopher Baines | 2022-05-06 |
| | |||
* | Fix the 'and removal criteria | Christopher Baines | 2022-05-06 |
| | |||
* | Support removing nar files | Christopher Baines | 2022-05-06 |
| | |||
* | Skip mirroring files if downloading them fails | Christopher Baines | 2022-05-05 |
| | | | | Until the next pass. | ||
* | Handle exceptions in threads | Christopher Baines | 2022-05-05 |
| | |||
* | Initialise the nar_files_total metric when fetching changes | Christopher Baines | 2022-05-04 |
| | |||
* | Create the pid file prior to downloading the database | Christopher Baines | 2022-05-04 |
| | | | | | Otherwise, anything starting the service may time out if the database file is large. | ||
* | Update the nar_files_total metric when processing changes | Christopher Baines | 2022-05-04 |
| | |||
* | Fix the default log-level value | Christopher Baines | 2022-05-04 |
| | |||
* | Update the nar_files_total metric when downloading and removing files | Christopher Baines | 2022-05-04 |
| | |||
* | Expose the nar files stats via a new nar_files_total metric | Christopher Baines | 2022-05-04 |
| | |||
* | Expose the storage size as a metric | Christopher Baines | 2022-05-04 |
| | |||
* | Stop hardcoding some filenames in the sample NGinx configuration | Christopher Baines | 2022-04-22 |
| | |||
* | Support handling /nar requests | Christopher Baines | 2022-04-22 |
| | | | | | | | | If the nar is known about, X-Accel-Redirect is used to pass the request back to the webserver which should then respond with the nar. If the nar isn't known about, then a 404 response is returned. In either case, there's a metric incremented to record the request. | ||
* | Add support for exposing some basic metrics | Christopher Baines | 2022-04-17 |
| | | | | In a format understood by Prometheus. | ||
* | Support passing a log-level to the nar-herder server | Christopher Baines | 2022-04-17 |
| | | | | | | | | This means that you can disable the output of requests by specifying a log-level of INFO or greater. Since the nar-herder may respond to so many requests, logging each one is a bit excessive. | ||
* | Add guile-lib to guix-dev.scm | Christopher Baines | 2022-04-17 |
| | | | | As it's needed. | ||
* | Support inserting tags when inserting narinfos | Christopher Baines | 2022-03-13 |
| | | | | | | This is the beginning of implementing support for tagging. The communicating of tags through changes still needs implementing. | ||
* | Keep the change datetimes consistent when mirroring | Christopher Baines | 2022-02-15 |
| | | | | | As this ensures that changes aren't missed when the mirror inserts things later than the origin. | ||
* | Switch to guile-fibers@1.1 | Christopher Baines | 2022-02-09 |
| | | | | | I think the main change required is just to stop accessing the now missing current-fiber parameter. | ||
* | Add a bit to the design in the README | Christopher Baines | 2022-02-04 |
| | |||
* | Add some more logging | Christopher Baines | 2022-02-02 |
| | |||
* | Support specifying TTL's for narinfo responses | Christopher Baines | 2022-02-02 |
| | | | | Using the same approach as guix publish. | ||
* | Decode nar urls when deleting nar files | Christopher Baines | 2022-02-02 |
| | |||
* | Handle URI encoding when mirroring files | Christopher Baines | 2022-02-02 |
| | |||
* | Decode the URLs for narinfo-files | Christopher Baines | 2022-02-02 |
| | | | | As they're not percent encoded on the filesystem. | ||
* | Regularly update the database dump and delete recent changes | Christopher Baines | 2021-12-29 |
| | |||
* | Limit the number of recent changes returned | Christopher Baines | 2021-12-29 |
| | | | | So that requests for recent changes don't time out. | ||
* | Add support for creating a pid file | Christopher Baines | 2021-12-20 |
| | |||
* | Fix a couple of example commands | Christopher Baines | 2021-12-15 |
| | |||
* | Add some information about the design | Christopher Baines | 2021-12-15 |
| | |||
* | Double check the nar removal criteria before removing nars | Christopher Baines | 2021-12-15 |
| | |||
* | Log the storage size when removing nars | Christopher Baines | 2021-12-15 |
| | |||
* | Move retry for fetching files to a better place | Christopher Baines | 2021-12-15 |
| | |||
* | Fix member call in mirror module | Christopher Baines | 2021-12-15 |
| |