aboutsummaryrefslogtreecommitdiff
path: root/guix-data-service
Commit message (Collapse)AuthorAge
* Add more logging in when computing channel instance derivationsChristopher Baines2024-01-31
| | | | | As there's an issue with current core-updates that I'm struggling to track down.
* Add some time logging in to inferior-packages-plus-replacementsChristopher Baines2024-01-28
|
* Make sure to keep roots for channel instance derivationsChristopher Baines2024-01-28
|
* Remove even more time loggingChristopher Baines2024-01-28
|
* Improve logging when computing a channel instance derivation failsChristopher Baines2024-01-27
|
* Log the time to call inferior-packages-plus-replacementsChristopher Baines2024-01-27
| | | | As I think this is currently quite slow.
* Remove some time loggingChristopher Baines2024-01-27
| | | | As this is a bit noisy.
* Try to fix issues with derivations being GC'edChristopher Baines2024-01-19
|
* Fixup testsChristopher Baines2024-01-18
|
* Add meaningful parallelism to processing jobsChristopher Baines2024-01-18
| | | | | | | | | | | Make parallel use of inferiors when computing channel instance derivations, and when extracting information about a revision. This should allow for some horizontal scalability, reducing the impact of additional systems for which derivations need computing. This commit also fixes an apparent issue with package replacements, as previously the wrong id was used, and this hid some issues around deduplication.
* Split and instrument parts of inferior-packages->package-metadata-idsChristopher Baines2024-01-18
| | | | As parts of it are slow.
* Rewrite part of insert-missing-data-and-return-all-ids to avoid filterChristopher Baines2024-01-18
| | | | | As filter can use part of the input list, which then prevents modifying the filtered list.
* Fix par-map&Christopher Baines2024-01-18
| | | | To actually work in parallel.
* Show backtraces when using parallel fibers and resource poolsChristopher Baines2024-01-18
|
* Make it possible to destroy a resource poolChristopher Baines2024-01-18
| | | | And implement removing idle resources.
* Have delete-duplicates/sort! take a equality procedureChristopher Baines2024-01-18
| | | | And change the default, as eq? doesn't always work.
* Add back inferior heap size reportingChristopher Baines2024-01-18
| | | | I'm sure this was present before, but maybe lost during some refactoring.
* Use delete-duplicates/sort! in inferior-packages->license-set-idsChristopher Baines2024-01-18
| | | | As it should offer a speedup over delete-duplicates.
* Use delete-duplicates/sort! in insert-missing-data-and-return-all-idsChristopher Baines2024-01-18
| | | | As it's faster than delete-duplicates for large amounts of data.
* Use libc-locales-for-targetChristopher Baines2023-12-04
| | | | To help find the right glibc-locales to use.
* Fix some select-build-servers callsChristopher Baines2023-12-04
|
* Memoize computing tokensChristopher Baines2023-11-24
| | | | | As I'm not sure how expensive this is, but it doesn't need doing for every request.
* Instrument handling build eventsChristopher Baines2023-11-24
|
* Stop replacements cluttering comparisonsChristopher Baines2023-11-18
| | | | This stops the replaced package getting compared with it's replacement.
* Add more exception handling to make-resource-poolChristopher Baines2023-11-17
| | | | As I'm not sure it's working reliably.
* Remove hardcoding of builtin:downloadChristopher Baines2023-11-16
| | | | As this was causing problems with builtin:git-download.
* Set the names of more threadsChristopher Baines2023-11-16
| | | | To help with debugging.
* Try to avoid the metrics timing outChristopher Baines2023-11-09
| | | | As that makes debugging problems harder.
* Add missing empty job log entryChristopher Baines2023-11-05
|
* Handle derivations with no sourcesChristopher Baines2023-11-05
|
* Handle eof when reading logsChristopher Baines2023-11-05
|
* Remove peekChristopher Baines2023-11-05
|
* Restore #:error-port when calling open-inferiorChristopher Baines2023-11-05
| | | | As the default is a void port.
* Remove #:use-module (ice-9 custom-ports)Christopher Baines2023-11-05
| | | | As it's not actually used.
* Include output information in the package page responseChristopher Baines2023-11-05
| | | | | As this will be useful for QA to say whether the package builds reproducibly or not.
* Use fibers when processing new revisionsChristopher Baines2023-11-05
| | | | | | | | Just have one fiber at the moment, but this will enable using fibers for parallelism in the future. Fibers seemed to cause problems with the logging setup, which was a bit odd in the first place. So move logging to the parent process which is better anyway.
* Make some sweeping changes to loading new revisionsChristopher Baines2023-11-02
| | | | | Move in the direction of being able to run multiple inferior REPLs, and use some vectors rather than lists in places (maybe this is more efficient).
* Close the repository when pullingChristopher Baines2023-10-16
| | | | And remove the monitor, as I'm not sure it's necessary.
* Remove redundant joins from the select build queryChristopher Baines2023-10-16
|
* Attempt to fetch this Git polling messChristopher Baines2023-10-11
| | | | | | | | | | | | | | | | Listing remote branches through libgit2 will list branches that don't exist on the remote. I think branch-list is more listing branch references, and you can have references to a remote branch where the remote branch doesn't exist. This isn't very useful here though, as I'm trying to work out what remote branches exist. There's remote-ls which might help, but I can't figure out how to get the commits for branches from that. Therefore, just bodge the two things together in to a big mess. I seem to be able to get commits from branch-list that hopefully match what's on the remote (although I'm not confident about this), and I think remote-ls does allow checking what branches exist.
* Copy some of the initialisation from (guix git)Christopher Baines2023-10-11
| | | | To go along with just-update-cached-checkout.
* Try to work around update-cached-checkoutChristopher Baines2023-10-11
| | | | As it's causing problems with the guix-patches repository.
* Remove logging from enqueue-job-for-emailChristopher Baines2023-10-11
| | | | As getmail treats output to stderr as the operation failing.
* Fix typoChristopher Baines2023-10-11
|
* Support polling git repositories for new branches/revisionsChristopher Baines2023-10-09
| | | | | | | | | | | This is mostly a workaround for the occasional problems with the guix-commits mailing list, as it can break and then the data service doesn't learn about new revisions until the problem is fixed. I think it's still a generally good feature though, and allows deploying the data service without it consuming emails to learn about new revisions, and is a step towards integrating some kind of way of notifying the data service to poll.
* Add metrics for ports and file descriptorsChristopher Baines2023-09-07
|
* URI encode some derivation names in linksChristopher Baines2023-09-07
| | | | To handle characters like +.
* Use the connection pool for build eventsChristopher Baines2023-08-23
| | | | | I'm not sure why this wasn't the way it worked previously. This should avoid unconstrained use of PostgreSQL connections.
* Add code to delete nars entriesChristopher Baines2023-08-01
|
* Delete unreferenced derivations in batchesChristopher Baines2023-08-01
| | | | To avoid a long blocking query.
generated by cgit v1.2.3 (git 2.45.0) at 2024-11-25 11:28:36 +0000