| Commit message (Expand) | Author | Age |
|---|
| * | Add mechanism to fix derivation inputs•••Some derivations are missing inputs, I don't know why, but this should allow
for manually fixing the affected derivations.
HEADmaster | Christopher Baines | 2025-03-10 |
| * | Remove compatability with old guix derivation-inputs | Christopher Baines | 2025-03-10 |
| * | Revert "Optimise inserting derivation inputs"•••I'm concerned that this approach is more error prone and won't error if there
are issues with the data in the database.
This reverts commit 3081887b90d09a6d5cf82e7292087362f30fc311.
| Christopher Baines | 2025-03-10 |
| * | Fix some nulls | Christopher Baines | 2025-02-06 |
| * | Fix matching NULL | Christopher Baines | 2025-01-27 |
| * | Handle NULL values for included_branches | Christopher Baines | 2025-01-17 |
| * | Attempt to reduce memory churn when processing package metadata | Christopher Baines | 2024-12-29 |
| * | Avoid null characters in package descriptions | Christopher Baines | 2024-12-29 |
| * | Add utility functions for configuring the database | Christopher Baines | 2024-12-15 |
| * | Improve some query formatting | Christopher Baines | 2024-12-09 |
| * | Rework loading revision data•••These changes were motivated by switching to a mechanism of loading data that
isn't dependent on the big advisory lock that prevents more than one revision
from being processed at a time.
Since INSERT ... RETURNING id; is used, this can block if another transaction
inserts the same data, and then cause an error when that transaction
commits. The solution is to use ON CONFLICT DO NOTHING, but you have to handle
the case when the INSERT doesn't return an id since the other transaction has
inserted it.
This commit rewrites insert-missing-data-and-return-all-ids to do as described
above, as well as being more efficient in how existing data is detected and to
use more vectors. Other utilities for inserting data are added as well.
| Christopher Baines | 2024-12-09 |
| * | Improve null handling | Christopher Baines | 2024-12-01 |
| * | Handle conflicts in insert-missing-data-and-return-all-ids | Christopher Baines | 2024-12-01 |
| * | Memoize field-can-be-null? | Christopher Baines | 2024-11-29 |
| * | Handle conflicts when inserting lint warning message sets | Christopher Baines | 2024-11-29 |
| * | Use insert-missing-data-and-return-all-ids for locations | Christopher Baines | 2024-11-29 |
| * | Stop queries being able to insert systems | Christopher Baines | 2024-11-13 |
| * | Fix git-commit-exists? | Christopher Baines | 2024-11-08 |
| * | Fix sorting license sets | Christopher Baines | 2024-11-08 |
| * | Add placeholder derivation source file nar procedures | Christopher Baines | 2024-10-27 |
| * | Speed up package-description-and-synopsis-locale-options-guix-revision | Christopher Baines | 2024-09-08 |
| * | Speed up select-builds-with-context-by-derivation-output | Christopher Baines | 2024-09-07 |
| * | Use system-ids for inserting distribution counts | Christopher Baines | 2024-08-12 |
| * | Add more logging to backfilling guix_revision_package_derivation_distribution... | Christopher Baines | 2024-08-12 |
| * | Parallelise inserting package derivation distribution counts | Christopher Baines | 2024-08-10 |
| * | Move inserting derivations in to the load-new-guix-revision module•••And start to more closely integrate it. This makes it possible to start making
it faster by doing more in parallel.
| Christopher Baines | 2024-08-07 |
| * | Add more time logging in to insert-missing-derivations | Christopher Baines | 2024-07-16 |
| * | Stop inserting missing source file nars•••This was more an issue several years ago, so this code is not really needed
now.
| Christopher Baines | 2024-07-16 |
| * | Delete duplicates when inserting license data•••As I think this is necessary.
| Christopher Baines | 2024-06-25 |
| * | Speed up querying for revision package derivations•••By splitting it up by system.
| Christopher Baines | 2024-06-21 |
| * | Speed up select-build-outputs | Christopher Baines | 2024-06-20 |
| * | Support regexes for included and excluded branches | Christopher Baines | 2024-05-22 |
| * | Fix package replacement handling on the revision packages page | Christopher Baines | 2024-04-28 |
| * | Move backfilling in to the server module and use the connection pool•••To avoid using the old PostgreSQL connection per thread code.
| Christopher Baines | 2024-04-01 |
| * | Speed up loading package metadata•••By batching the SQL queries.
| Christopher Baines | 2024-02-01 |
| * | Split up handling of package description data•••To hopefully see which part is slow.
| Christopher Baines | 2024-01-31 |
| * | Remove even more time logging | Christopher Baines | 2024-01-28 |
| * | Remove some time logging•••As this is a bit noisy.
| Christopher Baines | 2024-01-27 |
| * | Fixup tests | Christopher Baines | 2024-01-18 |
| * | Split and instrument parts of inferior-packages->package-metadata-ids•••As parts of it are slow.
| Christopher Baines | 2024-01-18 |
| * | Rewrite part of insert-missing-data-and-return-all-ids to avoid filter•••As filter can use part of the input list, which then prevents modifying the
filtered list.
| Christopher Baines | 2024-01-18 |
| * | Have delete-duplicates/sort! take a equality procedure•••And change the default, as eq? doesn't always work.
| Christopher Baines | 2024-01-18 |
| * | Use delete-duplicates/sort! in inferior-packages->license-set-ids•••As it should offer a speedup over delete-duplicates.
| Christopher Baines | 2024-01-18 |
| * | Use delete-duplicates/sort! in insert-missing-data-and-return-all-ids•••As it's faster than delete-duplicates for large amounts of data.
| Christopher Baines | 2024-01-18 |
| * | Memoize computing tokens•••As I'm not sure how expensive this is, but it doesn't need doing for every
request.
| Christopher Baines | 2023-11-24 |
| * | Handle derivations with no sources | Christopher Baines | 2023-11-05 |
| * | Include output information in the package page response•••As this will be useful for QA to say whether the package builds reproducibly
or not.
| Christopher Baines | 2023-11-05 |
| * | Use fibers when processing new revisions•••Just have one fiber at the moment, but this will enable using fibers for
parallelism in the future.
Fibers seemed to cause problems with the logging setup, which was a bit odd in
the first place. So move logging to the parent process which is better anyway.
| Christopher Baines | 2023-11-05 |
| * | Make some sweeping changes to loading new revisions•••Move in the direction of being able to run multiple inferior REPLs, and use
some vectors rather than lists in places (maybe this is more efficient).
| Christopher Baines | 2023-11-02 |
| * | Remove redundant joins from the select build query | Christopher Baines | 2023-10-16 |