aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAge
* Support querying package derivation outputs without the narsChristopher Baines2022-01-31
| | | | Since this speeds up the response if you don't need the nar information.
* Make the revision derivation counts numbersChristopher Baines2022-01-22
|
* Include the commit hash in the revision JSON responseChristopher Baines2022-01-22
| | | | | For the latest processed revision, this is useful for looking up which is the latest processed revision.
* Process derivations in chunksChristopher Baines2022-01-14
| | | | Which should reduce the peak memory usage.
* Fix chunk-for-each! calling proc when there's nothing to doChristopher Baines2022-01-14
|
* Rename chunk-map! to chunk-for-each!Christopher Baines2022-01-14
| | | | As that better reflects what it does.
* Don't count exiting with a status of 0 as a failureChristopher Baines2022-01-14
|
* Re-write insert-derivation-inputs in a more memory efficient manorChristopher Baines2022-01-12
| | | | | | | | | | Previously it would compute a long list of strings, potentially more than 100,000 elements long, then split this string up and insert it in chunks. Only then could memory be freed. This new approach builds the strings in batches for the insertion query, then moves on to the next batch. This should mean that more memory can be freed and reused along the way.
* Record job failure on non-0 exit statusChristopher Baines2022-01-12
| | | | | This is helpful when the jobs fail through Guile running out of memory for example.
* Improve the process jobs script signal handlingChristopher Baines2022-01-09
| | | | | The return value of sleep is unreliable (see guile bug #53139), so use a signal handler instead.
* Increase the default job processing timeoutChristopher Baines2022-01-09
|
* Improve logging for system test derivation issuesChristopher Baines2022-01-09
|
* Update the guix-dev.scm fileChristopher Baines2022-01-09
|
* Query substitutes for latest processed revisions periodicallyChristopher Baines2021-11-16
| | | | This is a step towards having up to date substitute availability data.
* Use a bigger start size for the hash tableChristopher Baines2021-10-03
| | | | This might help when there's lots of derivations to insert.
* Insert derivations in chunksChristopher Baines2021-10-03
| | | | To avoid making a very large query when inserting lots of derivations.
* Add a chunk procedureChristopher Baines2021-10-03
| | | | Just a variant of chunk! which doesn't modify the provided list.
* Log the time to read missing derivations from the storeChristopher Baines2021-10-03
|
* Select existing derivations in chunksChristopher Baines2021-10-03
| | | | To avoid one massive query.
* Insert derivation inputs in chunksChristopher Baines2021-10-03
| | | | To avoid one massive query.
* Add a chunk! untilityChristopher Baines2021-10-03
| | | | For splitting a list in to multiple chuncks, satisfying some max length.
* Handle the case where there are no missing file namesChristopher Baines2021-09-25
| | | | In update-derivation-ids-hash-table!.
* Optimise inserting derivation inputsChristopher Baines2021-09-24
| | | | | Rather than querying for the output ids one by one and then running an insert query for each derivation, perform the task with a single insert query.
* Neaten up formatting in select-derivation-output-idChristopher Baines2021-09-24
|
* Replace derivation-file-names->vhashChristopher Baines2021-09-24
| | | | | | Rather than creating vhashes, just update the hash table that is used as a cache, and query that. This should speed things up and reduce memory usage when loading derivations.
* Speed up inserting missing derivation sourcesChristopher Baines2021-09-24
| | | | | | Split the recursive part of the query from the non-recursive part, since PostgreSQL doesn't do a great job of estimating the number of rows which will come back from the recursive part, and thus generates a bad plan.
* Fix the select-source-files-missing-nars queryChristopher Baines2021-09-16
| | | | Previously, the VALUES list wasn't being generated properly.
* Make sure to add missing source file nars when inserting derivationsChristopher Baines2021-09-14
| | | | | Source file nars weren't always recorded, so this will help backfill that data (which enables providing substitutes for those derivations).
* Handle #f package descriptionsChristopher Baines2021-08-09
| | | | One was added in e81cf4e79a6e297db0ae2a9c39eab495e7e204f0.
* Add an index on derivation_output_details.idChristopher Baines2021-07-11
| | | | | Where hash is not null, since this helps with the fixed output package derivations query.
* Fix a regression with running sqitchChristopher Baines2021-07-11
| | | | Introduced in 0dc05982cde052c985bb440dc026cbe3334ee50b.
* Track package replacementsChristopher Baines2021-07-11
| | | | | | Start at least looking for package replacements, and storing the details (particularly the derivation). I'm looking at doing this so that build servers using the Guix Data Service can build these derivations.
* Run sqitch in the change modeChristopher Baines2021-07-04
| | | | | Since this rolls back migrations less, which is good when the rollback bit isn't always implemented.
* Try to adapt the PostgreSQL paramstring to use with sqitchChristopher Baines2021-06-16
|
* Remove redundant derivation-sources callChristopher Baines2021-06-09
|
* Pass #:system to channel-instances->manifestChristopher Baines2021-06-09
| | | | | This is better than setting the %current-system, since more of the process will run as native code.
* Use derivations.system_id in select-builds-with-contextChristopher Baines2021-06-09
| | | | As that table is always included in the query.
* Fix a uri encoding issue with linking to outputsChristopher Baines2021-06-09
|
* Add index for package_metadataCanan Talayhan2021-05-27
| | | | | | This index speeds up inserting new entries to the package_metadata table. Signed-off-by: Christopher Baines <mail@cbaines.net>
* Fix a URI decoding issueChristopher Baines2021-05-27
| | | | | This caused a problem viewing this derivation /gnu/store/65r4488732qy6ilrh1ryb8xwmip1qnir-tklib-0.6.tar.gz?uuid=tklib-0-6.drv
* Add some indexesChristopher Baines2021-05-17
| | | | This is from reading the slow query log on data.guix.gnu.org.
* Remove the "derivations using output" dataChristopher Baines2021-05-17
| | | | | | From the HTML and JSON responses, since this data isn't very useful, and the query to collect the small amount which is displayed is very slow. This could return at some point, but in a proper paginated form which isn't slow.
* Use filter-map rather than filter and map when processing lintersChristopher Baines2021-05-16
| | | | | | | I guess this is a good change in general, but this seems to avoid a long stack, which when a linter crashes, and the inferior tries to return the exception details, and apparently hang the inferior/client as the reply isn't written/read.
* Fix incorrect query parameters in a couple of builds queriesChristopher Baines2021-05-12
| | | | The parameters must be strings rather than numbers.
* Fix query typo in branches-by-package-versionChristopher Baines2021-05-12
|
* Fix request->path-components-and-mime-typeChristopher Baines2021-05-12
| | | | | Previously, it wouldn't pull the mime types out of the request properly, I think it does a better job of that now.
* Change data handling when comparing derivationsLuciana Lima Brito2021-04-27
| | | | | | | | | | comparison.scm: return query data for derivation comparison as an alist, instead of list. html.scm: Access derivation differences data using assq-ref. controller.scm: remove mapping for outputs/inputs/sources. utils.scm: add group-to-alist/vector function. Signed-off-by: Christopher Baines <mail@cbaines.net>
* Reformat a couple of package related queriesChristopher Baines2021-04-24
|
* Fix more things for the systems table introductionChristopher Baines2021-04-23
|
* Actually add the system moduleChristopher Baines2021-04-23
|