aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAge
* Reduce chunk size for inserting dervation inputsChristopher Baines2022-09-14
| | | | As this query can take some time.
* Reduce the chunk size for querying related derivation idsChristopher Baines2022-09-13
| | | | And include the chunk size in the log message.
* Support per repository configuration for fetching substitutesChristopher Baines2022-09-09
| | | | | This is so that data.qa.guix.gnu.org can be configured only to query the branches from the main repository.
* Make caching exceptions when querying for substitutes more reliableChristopher Baines2022-09-09
|
* Log more information about heap size when loading derivation infoChristopher Baines2022-09-05
| | | | To better understand the memory usage when this is happening.
* Use much smaller chunks when trying to run the derivation linterChristopher Baines2022-09-05
| | | | Since larger chunks still ran in to inferior memory usage problems.
* Compute lint warnings for packages in chunksChristopher Baines2022-09-05
| | | | | | | | In an attempt to reduce the peak memory usage, and avoid running in to the: Too many heap sections: Increase MAXHINCR or MAX_HEAP_SECTS issue.
* Include lint warnings in the JSON /compare responseChristopher Baines2022-08-22
|
* Return 503 for the /healthcheck if the service is starting upChristopher Baines2022-07-15
| | | | As this is a little clearer.
* Fix missing NULL variableChristopher Baines2022-07-09
|
* Improve deleting derivationsChristopher Baines2022-07-08
| | | | | Drop the batch size to get rid of warnings about memory usage and improve the logging by adding duration information.
* Set builds derivation output details set id if information availableChristopher Baines2022-07-08
| | | | | | The build event information can now contain the derivation outputs, as well as the name of the derivation. This allows the Guix Data Service to join builds up with derivations, even if it doesn't know about the derivation being built.
* Sort derivation output details idsChristopher Baines2022-07-08
| | | | To ensure that direct array comparison can be used in the query.
* Split out inserting derivation output details setsChristopher Baines2022-07-08
| | | | So that this can be used when inserting builds.
* Split out inserting into derivation_output_detailsChristopher Baines2022-07-08
| | | | So that this can be done when inserting builds.
* Handle migrations and server startup betterChristopher Baines2022-06-17
| | | | | | | | | The server part of the guix-data-service doesn't work great as a guix service, since it often fails to start if the migrations take any time at all. To address this, start the server before running the migrations, and serve the pages that work without the database, plus a general 503 response. Once the migrations have completed, switch to the normal behaviour.
* Add an index on git_commitsChristopher Baines2022-06-17
| | | | And also remove the duplicates that have crept in.
* Add an index on package_derivations_by_guix_revision_rangeChristopher Baines2022-06-17
| | | | This helps render the package version range related pages.
* Fix ambiguous id column in delete-guix-revisions queryChristopher Baines2022-06-16
|
* Fix DELETE query in delete-revisions-from-branchChristopher Baines2022-06-16
|
* Fix ambiguous id column in delete-from-git-commitsChristopher Baines2022-06-16
|
* Remove duplicate AND from delete-from-git-commits queryChristopher Baines2022-06-16
|
* Fix the select-guix-revision-for-branch-and-datetime queryChristopher Baines2022-05-30
| | | | I think it was broken with the git_branches/git_commits switch.
* Remove cross derivation targets that don't make senseChristopher Baines2022-05-27
| | | | This matches the previous behaviour without using the platform data.
* Take advantage of the new (guix platform) moduleChristopher Baines2022-05-26
| | | | | This means there's less reliance on the hardcoded lists of systems and targets and mappings between them.
* Improve the package derivation by guix revision range insert queriesChristopher Baines2022-05-26
|
* Add missing comma in queryChristopher Baines2022-05-24
|
* Fix delete-guix-revision-package-derivation-entriesChristopher Baines2022-05-24
| | | | For the table schema change.
* Fix expected exec-query value when no branch existsChristopher Baines2022-05-24
|
* Fix more issues with the git_commits introductionChristopher Baines2022-05-23
|
* Allow filtering package derivations based on build server buildsChristopher Baines2022-05-23
| | | | | | | | This means you can query for derivations where builds exist or don't exist on a given build server. I think this will come in useful when submitting builds from a Guix Data Service instance.
* Fix more of rebuilding one of the tablesChristopher Baines2022-05-23
|
* Add missing git_branches query part to insert queryChristopher Baines2022-05-23
|
* Raise a clearer exception when a linter crashesChristopher Baines2022-05-23
|
* Partition the package_derivations_by_guix_revision_range tableChristopher Baines2022-05-23
| | | | | | | | | | | | And create a proper git_branches table in the process. I'm hoping this will help with slow deletions from the package_derivations_by_guix_revision_range table in the case where there are lots of branches, since it'll separate the data for one branch from another. These migrations will remove the existing data, so rebuild-package-derivations-table will currently need manually running to regenerate it.
* Fix branch links on the repository pageChristopher Baines2022-05-20
| | | | Thanks to Tobias for reporting.
* Only clear the %store-table when it's definedChristopher Baines2022-05-17
|
* Clear cached store connections when fetching lint warningsChristopher Baines2022-05-13
| | | | | | | | | | | | As I'm seeing the inferior process crash with [1] just after fetching the derivation lint warnings. This change appears to help, although it's probably just a workaround. When there's more packages/derivations, the caches might need clearing while fetching the derivation lint warnings, or this will need to be split across multiple processes. 1: Too many heap sections: Increase MAXHINCR or MAX_HEAP_SECTS
* Clear out cached store connections in the load revision inferiorChristopher Baines2022-05-07
| | | | | These cached store connections have caches associated with them, that take up lots of memory, leading to the inferior crashing. This change seems to help.
* Move the builds.derivation_output_details_set_id updateChristopher Baines2022-04-16
| | | | | | | | | | To the end of the main revision processing transaction. Currently, I think there are issues when this query does update some builds, as those rows in the build table remain locked until the end of the transaction. This then causes build event submission to hang. Moving this part of the revision loading process to the end of the transaction should help to mitigate this.
* Fix a couple of things on the package substitute availability pageChristopher Baines2022-03-12
| | | | | When there's a target, render the heading neatly, and include the target parameter in the URLs.
* Fix an issue with the /builds pageChristopher Baines2022-03-11
|
* Close the load revision inferior prior to inserting dataChristopher Baines2022-03-11
| | | | | This means that the lock can be acquired after closing the inferior, freeing the large amount of memory that the inferior process is probably using.
* Add to the hardcoded list of valid targetsChristopher Baines2022-03-11
| | | | Since the hardcoded list in the load-new-guix-revision code has been updated.
* Extract out the code for starting an inferiorChristopher Baines2022-03-11
|
* Process each system target pair individuallyChristopher Baines2022-03-11
| | | | As the cross targets take quite some time.
* Disable value history in the inferior replChristopher Baines2022-03-11
| | | | This might help reduce memory usage a little.
* Compute more cross derivationsChristopher Baines2022-03-11
|
* Deduplicate inferior packages including replacementsChristopher Baines2022-03-04
| | | | | | | | | Previously, duplicates could creep through if the duplicate wasn't exported, and only found as a replacement. Now they're filtered out. This isn't ideal, as duplicates aren't always mistakes, it would be useful still to capture this package, but having multiple entries for the same name+version causes the comparison functionality to break.
* Simplify deduplicate-inferior-packagesChristopher Baines2022-03-04
| | | | | Use the a-version and b-version variables, rather than calling the functions again.