| Commit message (Expand) | Author | Age |
* | Make check open the database just for reads | Christopher Baines | 2024-12-19 |
* | Allow specifying the minimum free space | Christopher Baines | 2024-06-23 |
* | Check nar file sizes on import | Christopher Baines | 2024-06-15 |
* | Insert the narinfo record before moving the nar•••So that if inserting the narinfo record fails, the nars won't be
moved.
| Christopher Baines | 2024-06-15 |
* | Update removal criteria comment | Christopher Baines | 2024-06-15 |
* | Fix removing cached narinfo files from the db | Christopher Baines | 2024-05-20 |
* | Move nars to storage when importing narinfos•••If they're not in the storage directory.
| Christopher Baines | 2024-05-19 |
* | Simplify output when importing a single narinfo | Christopher Baines | 2024-05-11 |
* | Set %file-port-name-canonicalization to 'none•••As this reduces syscalls.
| Christopher Baines | 2024-05-11 |
* | Fix for guile-lib v0.2.8•••I'm not sure quite what's changed, but it seems like the way the
formatter is being called has changed in a backwards incompatible way.
To maintain compatability with both older and newer versions of
guile-lib, accept the formatter being called with extra arguments, and
just look at the first three.
| Christopher Baines | 2024-04-19 |
* | Make the number of database reader threads configurable | Christopher Baines | 2024-04-15 |
* | Make the server parallelism configurable•••And drop the default to 1.
| Christopher Baines | 2024-04-15 |
* | Remove + | Christopher Baines | 2024-04-15 |
* | Fix argument name | Christopher Baines | 2024-03-25 |
* | Improve handling of cached narinfos when deleting | Christopher Baines | 2024-03-25 |
* | Rework the cached compressions system•••The initial implementation was flawed since guix assumes that any
compression mentioned in the narinfo will be available for the
lifetime of the narinfo, and the nar-herder was deleting cached
compressions without taking this in to account.
This commit adds support for scheduling the removal of a cached
compression and this schedule is used to inform the TTLs for narinfos.
I'm unsure of the value in caching narinfos so maybe some of this
complexity can be removed in the future.
| Christopher Baines | 2024-03-25 |
* | Add more TTL options•••I'm really not sure about this caching stuff, but these options should
provide the flexibility to change the TTLs the nar-herder advertises
gracefully.
| Christopher Baines | 2024-03-15 |
* | Move most functionality out of the start script•••As this can make debugging easier.
| Christopher Baines | 2023-09-12 |
* | Use recent changes to trigger the removal of nars•••Both when the nar has been removed from the database, and to check if
it should no longer be stored.
| Christopher Baines | 2023-09-12 |
* | Remove get-nar-files•••As it doesn't scale well.
| Christopher Baines | 2023-09-12 |
* | Don't use JIT on aarch64•••As there's bugs which cause parts of the program to execute more than
once https://github.com/wingo/fibers/issues/83
| Christopher Baines | 2023-09-12 |
* | Name the fibers threads•••To help with debugging.
| Christopher Baines | 2023-09-12 |
* | Change the maintenance thread to not be cooperative•••As I think this is causing problems.
| Christopher Baines | 2023-09-12 |
* | Make sure to use streaming http requests everywhere•••As this avoids blocking.
| Christopher Baines | 2023-09-12 |
* | Add some more logging | Christopher Baines | 2023-09-12 |
* | Use recent changes to trigger nar mirroring and removal•••As this should be more efficient than repeatedly looking through all
the nars in the database.
| Christopher Baines | 2023-09-12 |
* | Use fibers for the recent changes removal thread | Christopher Baines | 2023-09-12 |
* | Use fibers timeouts for all http requests | Christopher Baines | 2023-09-12 |
* | Move most maintenance activity to fibers•••On a single separate thread. This will allow for spawning fibers for
various maintenance actions.
| Christopher Baines | 2023-09-12 |
* | Switch to cooperative scheduling | Christopher Baines | 2023-09-12 |
* | Drop the number of fibers threads | Christopher Baines | 2023-07-12 |
* | Show progress for downloading the database dump | Christopher Baines | 2023-06-30 |
* | Support setting a storage limit with no nar removal criteria•••As a way of limiting the storage space used, but without removing any
nars.
While this will mean if you reduce the storage limit, no nars will be
removed, I still think this is a useful way to run the nar-herder.
| Christopher Baines | 2023-05-01 |
* | Make import transactional for all the provided narinfos•••As this will allow the --ensure-references-exist option to work
properly where there are circular references.
| Christopher Baines | 2023-03-13 |
* | Handle self references when doing checks on narinfo imports | Christopher Baines | 2023-02-15 |
* | Fix import time reference checking | Christopher Baines | 2023-02-08 |
* | Allow disabling dumping the database•••As this takes up quite a lot of space if the database is large.
| Christopher Baines | 2023-02-08 |
* | Add a flag to allow ensuring the references for a nar are present | Christopher Baines | 2023-02-06 |
* | Refactor, pulling the narinfo out in to a variable | Christopher Baines | 2023-02-06 |
* | Don't error when removing files that don't exist•••This is useful when removing in bulk and restarting the process.
| Christopher Baines | 2023-02-06 |
* | Add some basic functionality to check the size of the stored files | Christopher Baines | 2023-02-06 |
* | Make the log-level a base option | Christopher Baines | 2023-02-06 |
* | Finish an initial implementation of pruning the cached nars | Christopher Baines | 2023-02-04 |
* | Instrument the cached bytes by compression | Christopher Baines | 2023-02-04 |
* | Properly implement cached compression levels•••It was sort of implemented, but I'd missed some bits.
| Christopher Baines | 2023-02-03 |
* | Be more flexible with cached compressions•••Allow specifying where to fetch the source files from, enabling cached
compressions for mirrors.
| Christopher Baines | 2023-02-01 |
* | Make sure to use suspendable ports•••This will allow setting timeouts for network activity.
| Christopher Baines | 2023-02-01 |
* | Fix --cached-compression-min-uses handling | Christopher Baines | 2023-02-01 |
* | Add experimental support for cached compressions•••This adds optional caching for alternative compressions of stored
nars. You could store lzip nars for example, but then compute, cache
and provide zstd nars for some stored nars.
| Christopher Baines | 2023-01-16 |
* | Add some instrumentation around the database | Christopher Baines | 2022-06-24 |