aboutsummaryrefslogtreecommitdiff
path: root/scripts
Commit message (Collapse)AuthorAge
* Fix create small backup issue with latest_build_statusChristopher Baines2020-10-23
|
* Make it easier to get to a replChristopher Baines2020-10-10
|
* Stop opening a PostgreSQL connection per requestChristopher Baines2020-10-03
| | | | | | | This was good in that it avoided having to deal with long running connections, but it probably takes some time to open the connection, and these changes are a step towards offloading the PostgreSQL queries to other threads, so they don't block the threads for fibers.
* Remove development code from the process job scriptChristopher Baines2020-09-28
|
* Add a JSON page for repository branchesChristopher Baines2020-09-27
|
* Replace debug-set! with setenv COLUMNSChristopher Baines2020-09-26
| | | | As that actually seems to work.
* Change the locale codeset representationChristopher Baines2020-09-26
| | | | | | | | | | | From the normalized one, to the one actually contained within glibc. Recent versions of glibc also contain symlinks linking the normalized codeset to the locales with the .UTF-8 ending, but older ones do not. Maybe handling codeset normalisation for queries would be good, but the locale values ending in .UTF-8 are more compatible and allow the code to be simplified. For querying, maybe there should be a locales table which handles different representations.
* Set the locale at the start of the process jobs scriptChristopher Baines2020-09-20
| | | | | | This might help with the odd [1] errors regarding PostgreSQL queries. 1: invalid byte sequence for encoding "UTF8":
* Increase the stack trace width when processing jobsChristopher Baines2020-09-20
| | | | As this might result in more useful error messages.
* Add a lookup_builds field to the build_servers tableChristopher Baines2020-05-24
| | | | | This is to allow for build servers where only the substitutes should be queried, and it shouldn't be assumed that they're running Cuirass.
* Move around --no-tablespacesChristopher Baines2020-05-16
| | | | | | Turns out, at the moment, this is ineffective when combined with the archive formats, like the custom format in use. Therefore, move it to the pg_restore command, where hopefully it'll work.
* Don't include tablespace assignments in the backup dumpChristopher Baines2020-05-14
| | | | | | | | | | | This is a comprimise, as this won't help restoring the backup in situations you want tablespaces, but I'm currently viewing tablespaces as a deployment concern, so maybe the right thing to do is exclude them. This approach will at least keep the same behaviour in terms of restoring the backups locally. This will fix the small dump creation process on data.guix.gnu.org, which is currently broken because of the tablespace assignments when trying to restore the backups.
* Split out querying of build servers and substitute serversChristopher Baines2020-05-03
| | | | | | These are related things, but somewhat separate. This change should make it easier to deal with changes regarding querying build servers, and querying substitute servers.
* Set a statement timeout of 60 seconds for web requestsChristopher Baines2020-04-24
| | | | | This will help stop queries running for an unnecessarily long time, longer than NGinx will wait for example.
* Rebuild the package derivation ranges table for the small backupChristopher Baines2020-03-31
| | | | | | This is better than just deleting the entries that don't match up with the remaining revisions, but also not very useful for local development (due to the lack of data).
* Give the temporary database more working memoryChristopher Baines2020-03-26
| | | | In the hope that this makes the script faster.
* Use EXPLAIN ANALYZE for the creation of tmp_derivationsChristopher Baines2020-03-26
| | | | | In the create-small-backup script, as this is quite a slow part, it's useful to get more information.
* Handle a couple more tables in create-small-backupChristopher Baines2020-03-26
| | | | | derivation_output_details_sets, and derivations_by_output_details_set. This required moving around some of the code.
* Use the --no-comments option to pg_dumpChristopher Baines2020-03-25
| | | | | | | | | | Hopefully this will help with the pg_restore in the create-small-backup script: pg_restore: [archiver (db)] Error while PROCESSING TOC: pg_restore: [archiver (db)] Error from TOC entry 2875; 0 0 COMMENT EXTENSION plpgsql pg_restore: [archiver (db)] could not execute query: ERROR: must be owner of extension plpgsql Command was: COMMENT ON EXTENSION plpgsql IS 'PL/pgSQL procedural language';
* Handle channel instances in create-small-backupChristopher Baines2020-03-25
| | | | Otherwise this table is empty.
* Handle system test derivations in create-small-backupChristopher Baines2020-03-25
| | | | Otherwise this table is empty.
* Stop using package_versions_by_guix_revision_rangeChristopher Baines2020-03-24
| | | | It's been replaced by the package_derivations_by_guix_revision_range table.
* Avoid failures related to renice and ioniceChristopher Baines2020-03-20
| | | | | These parts of the backup scripts are optional, so don't fail if they don't work.
* Move and improve the "starting the server" messageChristopher Baines2020-03-14
| | | | Move it after the output relating to narinfo signing, and include the host.
* Improve handling of errorsChristopher Baines2020-03-14
| | | | | Adjust the previously unused error page code, and start to use it. Only show the error if configured to do so, to avoid leaking secret information.
* Don't use TRUNCATE CASCADE in the create small backup scriptChristopher Baines2020-03-13
| | | | As it makes it clearer what tables will be truncated.
* Trip the derivation output details table in the small data dumpChristopher Baines2020-03-13
|
* Trim derivation source file tables in the small data dumpChristopher Baines2020-03-13
|
* Add scripts for generating database dumpsChristopher Baines2020-03-02
|
* Support customising the latest branch revision max processesChristopher Baines2020-02-28
| | | | | This makes it possible to set a higher or lower value depending on what you want.
* Make it possible to query builds servers for specific outputsChristopher Baines2020-02-16
|
* Add verbose output to the query-build-servers scriptChristopher Baines2020-02-15
|
* Warn if process-branch-updated-mbox won't match any emailsChristopher Baines2020-02-01
|
* Guard against failures when loading the narinfo signing public keyChristopher Baines2019-12-26
|
* Fix the option alist element names for the narinfo signing keyChristopher Baines2019-12-26
|
* Serve narinfo files for derivationsChristopher Baines2019-12-26
|
* Fix the query-build-servers script when no commits are providedChristopher Baines2019-12-23
|
* Fix the default max-processes for the process-jobs scriptChristopher Baines2019-12-22
|
* Allow customising the maximum number of processesChristopher Baines2019-12-16
|
* Add options to the query-build-servers scriptChristopher Baines2019-12-12
| | | | So you can select to query specific build servers.
* Query build servers for narinfo fileswip-narinfoChristopher Baines2019-11-30
| | | | | As well as making it possible to only query build servers for builds relating to a specific revision.
* Rework the builds and build_status tables as well as related codeChristopher Baines2019-11-24
| | | | | | | Allow for build status information to be submitted by POST request. This required some changes to the builds and build_status tables, as for example, the Cuirass build id may not be available, and the derivation may not be know yet, so just record the derivation file name.
* Add a script to help manage build serversChristopher Baines2019-11-23
| | | | | This computes and displays the tokens needed to send build events to the Guix Data Service.
* Rewrite localhost for sqitchChristopher Baines2019-10-01
| | | | As this means that like psql, the unix socket will be used.
* Add a new script to process emails in an mbox fileChristopher Baines2019-09-28
| | | | | This can be used with the mbox files for the guix-commits mailing list to add older emails in to the database.
* Switch to processing emails as bytevectorsChristopher Baines2019-09-26
| | | | | This is better, as different parts of the email might be encoded differently, and guile-email will take care of this if handed a bytevector.
* Improve error handling for processing emailsChristopher Baines2019-08-31
|
* Add a process-job commandChristopher Baines2019-07-12
| | | | | | This allows easily processing an individual job by id. This may be useful to use manually, but also when processing jobs in parallel, as forking doesn't work well with the libpq library used by squee.
* Associate a name with database connectionsChristopher Baines2019-07-12
| | | | This helps when working out which connection to the database is doing what.
* Use line buffering for the input and output portsChristopher Baines2019-06-17
| | | | | As these are used for logging, which is done on a line by line basis. Remove the now redundant calls to (force-output).
generated by cgit v1.2.3 (git 2.45.0) at 2024-11-22 14:28:13 +0000