aboutsummaryrefslogtreecommitdiff
path: root/scripts
Commit message (Collapse)AuthorAge
* Query substitutes for latest processed revisions periodicallyChristopher Baines2021-11-16
| | | | This is a step towards having up to date substitute availability data.
* Fix a regression with running sqitchChristopher Baines2021-07-11
| | | | Introduced in 0dc05982cde052c985bb440dc026cbe3334ee50b.
* Run sqitch in the change modeChristopher Baines2021-07-04
| | | | | Since this rolls back migrations less, which is good when the rollback bit isn't always implemented.
* Try to adapt the PostgreSQL paramstring to use with sqitchChristopher Baines2021-06-16
|
* Allow customising the pg_dump command usedChristopher Baines2021-01-03
| | | | As this
* Support not querying pending buildsChristopher Baines2020-11-01
| | | | As this can take some time.
* Allow only fetching builds for a specific systemChristopher Baines2020-11-01
|
* Fix create small backup issue with latest_build_statusChristopher Baines2020-10-23
|
* Make it easier to get to a replChristopher Baines2020-10-10
|
* Stop opening a PostgreSQL connection per requestChristopher Baines2020-10-03
| | | | | | | This was good in that it avoided having to deal with long running connections, but it probably takes some time to open the connection, and these changes are a step towards offloading the PostgreSQL queries to other threads, so they don't block the threads for fibers.
* Remove development code from the process job scriptChristopher Baines2020-09-28
|
* Add a JSON page for repository branchesChristopher Baines2020-09-27
|
* Replace debug-set! with setenv COLUMNSChristopher Baines2020-09-26
| | | | As that actually seems to work.
* Change the locale codeset representationChristopher Baines2020-09-26
| | | | | | | | | | | From the normalized one, to the one actually contained within glibc. Recent versions of glibc also contain symlinks linking the normalized codeset to the locales with the .UTF-8 ending, but older ones do not. Maybe handling codeset normalisation for queries would be good, but the locale values ending in .UTF-8 are more compatible and allow the code to be simplified. For querying, maybe there should be a locales table which handles different representations.
* Set the locale at the start of the process jobs scriptChristopher Baines2020-09-20
| | | | | | This might help with the odd [1] errors regarding PostgreSQL queries. 1: invalid byte sequence for encoding "UTF8":
* Increase the stack trace width when processing jobsChristopher Baines2020-09-20
| | | | As this might result in more useful error messages.
* Add a lookup_builds field to the build_servers tableChristopher Baines2020-05-24
| | | | | This is to allow for build servers where only the substitutes should be queried, and it shouldn't be assumed that they're running Cuirass.
* Move around --no-tablespacesChristopher Baines2020-05-16
| | | | | | Turns out, at the moment, this is ineffective when combined with the archive formats, like the custom format in use. Therefore, move it to the pg_restore command, where hopefully it'll work.
* Don't include tablespace assignments in the backup dumpChristopher Baines2020-05-14
| | | | | | | | | | | This is a comprimise, as this won't help restoring the backup in situations you want tablespaces, but I'm currently viewing tablespaces as a deployment concern, so maybe the right thing to do is exclude them. This approach will at least keep the same behaviour in terms of restoring the backups locally. This will fix the small dump creation process on data.guix.gnu.org, which is currently broken because of the tablespace assignments when trying to restore the backups.
* Split out querying of build servers and substitute serversChristopher Baines2020-05-03
| | | | | | These are related things, but somewhat separate. This change should make it easier to deal with changes regarding querying build servers, and querying substitute servers.
* Set a statement timeout of 60 seconds for web requestsChristopher Baines2020-04-24
| | | | | This will help stop queries running for an unnecessarily long time, longer than NGinx will wait for example.
* Rebuild the package derivation ranges table for the small backupChristopher Baines2020-03-31
| | | | | | This is better than just deleting the entries that don't match up with the remaining revisions, but also not very useful for local development (due to the lack of data).
* Give the temporary database more working memoryChristopher Baines2020-03-26
| | | | In the hope that this makes the script faster.
* Use EXPLAIN ANALYZE for the creation of tmp_derivationsChristopher Baines2020-03-26
| | | | | In the create-small-backup script, as this is quite a slow part, it's useful to get more information.
* Handle a couple more tables in create-small-backupChristopher Baines2020-03-26
| | | | | derivation_output_details_sets, and derivations_by_output_details_set. This required moving around some of the code.
* Use the --no-comments option to pg_dumpChristopher Baines2020-03-25
| | | | | | | | | | Hopefully this will help with the pg_restore in the create-small-backup script: pg_restore: [archiver (db)] Error while PROCESSING TOC: pg_restore: [archiver (db)] Error from TOC entry 2875; 0 0 COMMENT EXTENSION plpgsql pg_restore: [archiver (db)] could not execute query: ERROR: must be owner of extension plpgsql Command was: COMMENT ON EXTENSION plpgsql IS 'PL/pgSQL procedural language';
* Handle channel instances in create-small-backupChristopher Baines2020-03-25
| | | | Otherwise this table is empty.
* Handle system test derivations in create-small-backupChristopher Baines2020-03-25
| | | | Otherwise this table is empty.
* Stop using package_versions_by_guix_revision_rangeChristopher Baines2020-03-24
| | | | It's been replaced by the package_derivations_by_guix_revision_range table.
* Avoid failures related to renice and ioniceChristopher Baines2020-03-20
| | | | | These parts of the backup scripts are optional, so don't fail if they don't work.
* Move and improve the "starting the server" messageChristopher Baines2020-03-14
| | | | Move it after the output relating to narinfo signing, and include the host.
* Improve handling of errorsChristopher Baines2020-03-14
| | | | | Adjust the previously unused error page code, and start to use it. Only show the error if configured to do so, to avoid leaking secret information.
* Don't use TRUNCATE CASCADE in the create small backup scriptChristopher Baines2020-03-13
| | | | As it makes it clearer what tables will be truncated.
* Trip the derivation output details table in the small data dumpChristopher Baines2020-03-13
|
* Trim derivation source file tables in the small data dumpChristopher Baines2020-03-13
|
* Add scripts for generating database dumpsChristopher Baines2020-03-02
|
* Support customising the latest branch revision max processesChristopher Baines2020-02-28
| | | | | This makes it possible to set a higher or lower value depending on what you want.
* Make it possible to query builds servers for specific outputsChristopher Baines2020-02-16
|
* Add verbose output to the query-build-servers scriptChristopher Baines2020-02-15
|
* Warn if process-branch-updated-mbox won't match any emailsChristopher Baines2020-02-01
|
* Guard against failures when loading the narinfo signing public keyChristopher Baines2019-12-26
|
* Fix the option alist element names for the narinfo signing keyChristopher Baines2019-12-26
|
* Serve narinfo files for derivationsChristopher Baines2019-12-26
|
* Fix the query-build-servers script when no commits are providedChristopher Baines2019-12-23
|
* Fix the default max-processes for the process-jobs scriptChristopher Baines2019-12-22
|
* Allow customising the maximum number of processesChristopher Baines2019-12-16
|
* Add options to the query-build-servers scriptChristopher Baines2019-12-12
| | | | So you can select to query specific build servers.
* Query build servers for narinfo fileswip-narinfoChristopher Baines2019-11-30
| | | | | As well as making it possible to only query build servers for builds relating to a specific revision.
* Rework the builds and build_status tables as well as related codeChristopher Baines2019-11-24
| | | | | | | Allow for build status information to be submitted by POST request. This required some changes to the builds and build_status tables, as for example, the Cuirass build id may not be available, and the derivation may not be know yet, so just record the derivation file name.
* Add a script to help manage build serversChristopher Baines2019-11-23
| | | | | This computes and displays the tokens needed to send build events to the Guix Data Service.