aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAge
* Spawn specific PostgreSQL connections for the blocked_builds updatesChristopher Baines2022-11-12
| | | | So that the queries don't get cancelled by the statement timeout.
* Add index on derivation_outputs id and derivation_id fieldsChristopher Baines2022-11-12
| | | | This might help with doing recursive queries on the derivations graph.
* Add extended statistics on package_derivationsChristopher Baines2022-11-12
| | | | This helps row count estimates when filtering on system_id and target.
* Have insert-blocked-builds cache when the partitions existChristopher Baines2022-11-11
| | | | To make it more efficient.
* Rework insert-blocked-builds to make it more efficientChristopher Baines2022-11-11
| | | | This also fixes a typo in the partition name.
* Stop using exception handling when inserting blocked_builds entriesChristopher Baines2022-11-11
| | | | As it doesn't work in a transaction.
* Add missing test descriptionChristopher Baines2022-11-11
|
* Add a blocking builds pageChristopher Baines2022-11-11
|
* Add support for incrementally tracking blocked buildsChristopher Baines2022-11-11
| | | | | | | | | This will hopefully provide a less expensive way of finding out if a scheduled build is probably blocked by other builds failing or being canceled. By working this out when the build events are recieved, it should be more feasible to include information about whether builds are likely blocked or not in various places (e.g. revision comparisons).
* Log heap size when computing system testsChristopher Baines2022-11-06
|
* Add more granular logging for computing system test derivationsChristopher Baines2022-11-06
|
* Close postgresql connections when the thread pool thread is idleChristopher Baines2022-10-23
| | | | | | I think the idle connections associated with idle threads are still taking up memory, so especially now that you can configure an arbitrary number of threads (and thus connections), I think it's good to close them regularly.
* Fix JSON response for unknown revisionsChristopher Baines2022-10-17
|
* Expose Guile GC metricsChristopher Baines2022-10-09
| | | | | As the guix-data-service process seems to be using excessive amounts of memory, and this will be useful to track it.
* Make it possible to increase the number of thread pool threadsChristopher Baines2022-10-02
| | | | And double the default to 16.
* Log delays in the thread pool channelChristopher Baines2022-10-02
| | | | As I think with lots of requests, this could become a bottleneck.
* Insert guix revision lint warnings in chunksChristopher Baines2022-09-17
| | | | To avoid long running queries.
* Improve chunking when inserting derivation inputsChristopher Baines2022-09-17
| | | | | Chunk the values inserted in the query, rather than the derivations involved, as this is more consistent.
* Reduce some chunk sizesChristopher Baines2022-09-17
|
* Chunk inserting guix revision package derivation entriesChristopher Baines2022-09-15
|
* Further reduce some chunk sizesChristopher Baines2022-09-15
|
* Chunk the data for some queries in insert-missing-data-and-return-all-idsChristopher Baines2022-09-15
| | | | | This helps to avoid queries getting logged as slow just because of the amount of data.
* Format some queries generated in insert-missing-data-and-return-all-idsChristopher Baines2022-09-14
|
* Reduce some chunk sizesChristopher Baines2022-09-14
| | | | As these queries are still slow enough to be logged.
* Implement the JSON response for package reproducibilityChristopher Baines2022-09-14
|
* Implement the JSON response for package substitute availabilityChristopher Baines2022-09-14
|
* Speed up finding the locales for a revisionChristopher Baines2022-09-14
|
* Reduce chunk size for inserting dervation inputsChristopher Baines2022-09-14
| | | | As this query can take some time.
* Reduce the chunk size for querying related derivation idsChristopher Baines2022-09-13
| | | | And include the chunk size in the log message.
* Support per repository configuration for fetching substitutesChristopher Baines2022-09-09
| | | | | This is so that data.qa.guix.gnu.org can be configured only to query the branches from the main repository.
* Make caching exceptions when querying for substitutes more reliableChristopher Baines2022-09-09
|
* Log more information about heap size when loading derivation infoChristopher Baines2022-09-05
| | | | To better understand the memory usage when this is happening.
* Use much smaller chunks when trying to run the derivation linterChristopher Baines2022-09-05
| | | | Since larger chunks still ran in to inferior memory usage problems.
* Compute lint warnings for packages in chunksChristopher Baines2022-09-05
| | | | | | | | In an attempt to reduce the peak memory usage, and avoid running in to the: Too many heap sections: Increase MAXHINCR or MAX_HEAP_SECTS issue.
* Include lint warnings in the JSON /compare responseChristopher Baines2022-08-22
|
* Return 503 for the /healthcheck if the service is starting upChristopher Baines2022-07-15
| | | | As this is a little clearer.
* Fix missing NULL variableChristopher Baines2022-07-09
|
* Improve deleting derivationsChristopher Baines2022-07-08
| | | | | Drop the batch size to get rid of warnings about memory usage and improve the logging by adding duration information.
* Set builds derivation output details set id if information availableChristopher Baines2022-07-08
| | | | | | The build event information can now contain the derivation outputs, as well as the name of the derivation. This allows the Guix Data Service to join builds up with derivations, even if it doesn't know about the derivation being built.
* Sort derivation output details idsChristopher Baines2022-07-08
| | | | To ensure that direct array comparison can be used in the query.
* Split out inserting derivation output details setsChristopher Baines2022-07-08
| | | | So that this can be used when inserting builds.
* Split out inserting into derivation_output_detailsChristopher Baines2022-07-08
| | | | So that this can be done when inserting builds.
* Handle migrations and server startup betterChristopher Baines2022-06-17
| | | | | | | | | The server part of the guix-data-service doesn't work great as a guix service, since it often fails to start if the migrations take any time at all. To address this, start the server before running the migrations, and serve the pages that work without the database, plus a general 503 response. Once the migrations have completed, switch to the normal behaviour.
* Add an index on git_commitsChristopher Baines2022-06-17
| | | | And also remove the duplicates that have crept in.
* Add an index on package_derivations_by_guix_revision_rangeChristopher Baines2022-06-17
| | | | This helps render the package version range related pages.
* Fix ambiguous id column in delete-guix-revisions queryChristopher Baines2022-06-16
|
* Fix DELETE query in delete-revisions-from-branchChristopher Baines2022-06-16
|
* Fix ambiguous id column in delete-from-git-commitsChristopher Baines2022-06-16
|
* Remove duplicate AND from delete-from-git-commits queryChristopher Baines2022-06-16
|
* Fix the select-guix-revision-for-branch-and-datetime queryChristopher Baines2022-05-30
| | | | I think it was broken with the git_branches/git_commits switch.