aboutsummaryrefslogtreecommitdiff
path: root/scripts
Commit message (Collapse)AuthorAge
* Add a lookup_builds field to the build_servers tableChristopher Baines2020-05-24
| | | | | This is to allow for build servers where only the substitutes should be queried, and it shouldn't be assumed that they're running Cuirass.
* Move around --no-tablespacesChristopher Baines2020-05-16
| | | | | | Turns out, at the moment, this is ineffective when combined with the archive formats, like the custom format in use. Therefore, move it to the pg_restore command, where hopefully it'll work.
* Don't include tablespace assignments in the backup dumpChristopher Baines2020-05-14
| | | | | | | | | | | This is a comprimise, as this won't help restoring the backup in situations you want tablespaces, but I'm currently viewing tablespaces as a deployment concern, so maybe the right thing to do is exclude them. This approach will at least keep the same behaviour in terms of restoring the backups locally. This will fix the small dump creation process on data.guix.gnu.org, which is currently broken because of the tablespace assignments when trying to restore the backups.
* Split out querying of build servers and substitute serversChristopher Baines2020-05-03
| | | | | | These are related things, but somewhat separate. This change should make it easier to deal with changes regarding querying build servers, and querying substitute servers.
* Set a statement timeout of 60 seconds for web requestsChristopher Baines2020-04-24
| | | | | This will help stop queries running for an unnecessarily long time, longer than NGinx will wait for example.
* Rebuild the package derivation ranges table for the small backupChristopher Baines2020-03-31
| | | | | | This is better than just deleting the entries that don't match up with the remaining revisions, but also not very useful for local development (due to the lack of data).
* Give the temporary database more working memoryChristopher Baines2020-03-26
| | | | In the hope that this makes the script faster.
* Use EXPLAIN ANALYZE for the creation of tmp_derivationsChristopher Baines2020-03-26
| | | | | In the create-small-backup script, as this is quite a slow part, it's useful to get more information.
* Handle a couple more tables in create-small-backupChristopher Baines2020-03-26
| | | | | derivation_output_details_sets, and derivations_by_output_details_set. This required moving around some of the code.
* Use the --no-comments option to pg_dumpChristopher Baines2020-03-25
| | | | | | | | | | Hopefully this will help with the pg_restore in the create-small-backup script: pg_restore: [archiver (db)] Error while PROCESSING TOC: pg_restore: [archiver (db)] Error from TOC entry 2875; 0 0 COMMENT EXTENSION plpgsql pg_restore: [archiver (db)] could not execute query: ERROR: must be owner of extension plpgsql Command was: COMMENT ON EXTENSION plpgsql IS 'PL/pgSQL procedural language';
* Handle channel instances in create-small-backupChristopher Baines2020-03-25
| | | | Otherwise this table is empty.
* Handle system test derivations in create-small-backupChristopher Baines2020-03-25
| | | | Otherwise this table is empty.
* Stop using package_versions_by_guix_revision_rangeChristopher Baines2020-03-24
| | | | It's been replaced by the package_derivations_by_guix_revision_range table.
* Avoid failures related to renice and ioniceChristopher Baines2020-03-20
| | | | | These parts of the backup scripts are optional, so don't fail if they don't work.
* Move and improve the "starting the server" messageChristopher Baines2020-03-14
| | | | Move it after the output relating to narinfo signing, and include the host.
* Improve handling of errorsChristopher Baines2020-03-14
| | | | | Adjust the previously unused error page code, and start to use it. Only show the error if configured to do so, to avoid leaking secret information.
* Don't use TRUNCATE CASCADE in the create small backup scriptChristopher Baines2020-03-13
| | | | As it makes it clearer what tables will be truncated.
* Trip the derivation output details table in the small data dumpChristopher Baines2020-03-13
|
* Trim derivation source file tables in the small data dumpChristopher Baines2020-03-13
|
* Add scripts for generating database dumpsChristopher Baines2020-03-02
|
* Support customising the latest branch revision max processesChristopher Baines2020-02-28
| | | | | This makes it possible to set a higher or lower value depending on what you want.
* Make it possible to query builds servers for specific outputsChristopher Baines2020-02-16
|
* Add verbose output to the query-build-servers scriptChristopher Baines2020-02-15
|
* Warn if process-branch-updated-mbox won't match any emailsChristopher Baines2020-02-01
|
* Guard against failures when loading the narinfo signing public keyChristopher Baines2019-12-26
|
* Fix the option alist element names for the narinfo signing keyChristopher Baines2019-12-26
|
* Serve narinfo files for derivationsChristopher Baines2019-12-26
|
* Fix the query-build-servers script when no commits are providedChristopher Baines2019-12-23
|
* Fix the default max-processes for the process-jobs scriptChristopher Baines2019-12-22
|
* Allow customising the maximum number of processesChristopher Baines2019-12-16
|
* Add options to the query-build-servers scriptChristopher Baines2019-12-12
| | | | So you can select to query specific build servers.
* Query build servers for narinfo fileswip-narinfoChristopher Baines2019-11-30
| | | | | As well as making it possible to only query build servers for builds relating to a specific revision.
* Rework the builds and build_status tables as well as related codeChristopher Baines2019-11-24
| | | | | | | Allow for build status information to be submitted by POST request. This required some changes to the builds and build_status tables, as for example, the Cuirass build id may not be available, and the derivation may not be know yet, so just record the derivation file name.
* Add a script to help manage build serversChristopher Baines2019-11-23
| | | | | This computes and displays the tokens needed to send build events to the Guix Data Service.
* Rewrite localhost for sqitchChristopher Baines2019-10-01
| | | | As this means that like psql, the unix socket will be used.
* Add a new script to process emails in an mbox fileChristopher Baines2019-09-28
| | | | | This can be used with the mbox files for the guix-commits mailing list to add older emails in to the database.
* Switch to processing emails as bytevectorsChristopher Baines2019-09-26
| | | | | This is better, as different parts of the email might be encoded differently, and guile-email will take care of this if handed a bytevector.
* Improve error handling for processing emailsChristopher Baines2019-08-31
|
* Add a process-job commandChristopher Baines2019-07-12
| | | | | | This allows easily processing an individual job by id. This may be useful to use manually, but also when processing jobs in parallel, as forking doesn't work well with the libpq library used by squee.
* Associate a name with database connectionsChristopher Baines2019-07-12
| | | | This helps when working out which connection to the database is doing what.
* Use line buffering for the input and output portsChristopher Baines2019-06-17
| | | | | As these are used for logging, which is done on a line by line basis. Remove the now redundant calls to (force-output).
* Add --port and --host as options to the guix-data-serviceChristopher Baines2019-06-13
|
* Add an option to create a pid-fileChristopher Baines2019-06-11
| | | | | This'll help the a service manager (like the shepherd) know when the service is ready, which at the moment, means the database migrations have happened.
* Change to the sqitch directory to run deployChristopher Baines2019-06-11
| | | | As this means it can find the relevant files.
* Pass the --db-client option to sqitch deployChristopher Baines2019-06-11
| | | | So that it can always find psql.
* Pass --plan-file to the sqitch deploy commandChristopher Baines2019-06-08
|
* Add a --update-database optionChristopher Baines2019-06-07
| | | | | | This runs Sqitch on startup, which should make managing the database easier, as you just have to restart the service with this option, and the database should be updated if necessary.
* Add missing (guix-data-service database) importChristopher Baines2019-04-17
|
* Extract out some database functionality to another moduleChristopher Baines2019-04-14
|
* Remove built guix-data-service-process-branch-updated-email fileChristopher Baines2019-04-08
| | | | It should never have been committed.
generated by cgit v1.2.3 (git 2.45.0) at 2024-11-22 06:45:28 +0000