]> git.openstreetmap.org Git - chef.git/log
chef.git
13 months agoBackup prometheus data to S3
Tom Hughes [Sat, 21 Oct 2023 11:51:32 +0000 (12:51 +0100)]
Backup prometheus data to S3

13 months agoDisable progress messages for osm2pgsql
Tom Hughes [Sat, 21 Oct 2023 10:52:13 +0000 (11:52 +0100)]
Disable progress messages for osm2pgsql

13 months agoSwitch piasa to use postgres 16
Tom Hughes [Fri, 20 Oct 2023 23:42:38 +0000 (00:42 +0100)]
Switch piasa to use postgres 16

13 months agoplanet: increase AWS upload max_bandwidth
Grant Slater [Fri, 20 Oct 2023 11:19:13 +0000 (12:19 +0100)]
planet: increase AWS upload max_bandwidth

13 months agoEnable prometheus admin API
Tom Hughes [Thu, 19 Oct 2023 20:19:45 +0000 (21:19 +0100)]
Enable prometheus admin API

13 months agoMake prometheus API blocks work
Tom Hughes [Thu, 19 Oct 2023 20:15:27 +0000 (21:15 +0100)]
Make prometheus API blocks work

13 months agoBlock external access to prometheus admin API
Tom Hughes [Thu, 19 Oct 2023 19:47:09 +0000 (20:47 +0100)]
Block external access to prometheus admin API

13 months agoInstall libyaml-dev for rails
Tom Hughes [Wed, 18 Oct 2023 18:06:32 +0000 (19:06 +0100)]
Install libyaml-dev for rails

13 months agocivicrm version bump, corrected extension name
Guillaume RISCHARD [Tue, 17 Oct 2023 12:21:19 +0000 (08:21 -0400)]
civicrm version bump, corrected extension name

13 months agoStop trying to URI encode passwords
Tom Hughes [Sun, 15 Oct 2023 17:58:50 +0000 (18:58 +0100)]
Stop trying to URI encode passwords

13 months agoMake postgres exporter connect as the prometheus user
Tom Hughes [Sun, 15 Oct 2023 17:42:31 +0000 (18:42 +0100)]
Make postgres exporter connect as the prometheus user

13 months agoGrant roles to newly created users
Tom Hughes [Sun, 15 Oct 2023 11:27:40 +0000 (11:27 +0000)]
Grant roles to newly created users

13 months agoRemove some old cleanup code
Tom Hughes [Sun, 15 Oct 2023 11:19:13 +0000 (12:19 +0100)]
Remove some old cleanup code

13 months agoAdd a prometheus user to all postgres clusters
Tom Hughes [Sun, 15 Oct 2023 11:16:21 +0000 (11:16 +0000)]
Add a prometheus user to all postgres clusters

13 months agoAdd support for granting roles to postgres users
Tom Hughes [Sun, 15 Oct 2023 10:16:01 +0000 (11:16 +0100)]
Add support for granting roles to postgres users

13 months agoSwitch nidhogg to use postgres 16
Tom Hughes [Sat, 14 Oct 2023 14:23:25 +0000 (15:23 +0100)]
Switch nidhogg to use postgres 16

13 months agoSwitch culebre to use postgres 16
Tom Hughes [Fri, 13 Oct 2023 17:54:15 +0000 (18:54 +0100)]
Switch culebre to use postgres 16

13 months agoAdd alert for interface redundancy
Tom Hughes [Fri, 13 Oct 2023 16:54:51 +0000 (17:54 +0100)]
Add alert for interface redundancy

13 months agoReport bond mode for bonded interfaces
Tom Hughes [Fri, 13 Oct 2023 16:39:10 +0000 (17:39 +0100)]
Report bond mode for bonded interfaces

13 months agooxidized: add libyaml-dev requirement
Grant Slater [Fri, 13 Oct 2023 15:47:35 +0000 (16:47 +0100)]
oxidized: add libyaml-dev requirement

13 months agoUse the directory name as the certificate name for uploads
Tom Hughes [Fri, 13 Oct 2023 08:05:47 +0000 (09:05 +0100)]
Use the directory name as the certificate name for uploads

13 months agoStatically configure backup replication metrics
Tom Hughes [Thu, 12 Oct 2023 18:05:13 +0000 (19:05 +0100)]
Statically configure backup replication metrics

13 months agoSet roundingPeriod explicitly for all jobs
Tom Hughes [Thu, 12 Oct 2023 16:17:18 +0000 (17:17 +0100)]
Set roundingPeriod explicitly for all jobs

13 months agoSplit daily metrics into separate jobs
Tom Hughes [Thu, 12 Oct 2023 15:54:39 +0000 (16:54 +0100)]
Split daily metrics into separate jobs

13 months agoLook back two days for S2 daily statistics
Tom Hughes [Thu, 12 Oct 2023 14:33:22 +0000 (15:33 +0100)]
Look back two days for S2 daily statistics

13 months agoRevert "cloudwatch: add eu-north-1 for osm-main to collect replication metrics"
Grant Slater [Thu, 12 Oct 2023 04:21:27 +0000 (05:21 +0100)]
Revert "cloudwatch: add eu-north-1 for osm-main to collect replication metrics"

This reverts commit 7e0c2e2982f696e3d1e57c6ec4889fe1e6038446.

13 months agoRevert "cloudwatch: Own job for Replication Metrics"
Grant Slater [Thu, 12 Oct 2023 04:21:23 +0000 (05:21 +0100)]
Revert "cloudwatch: Own job for Replication Metrics"

This reverts commit 6c92319de16d70a02efabb29a4ea2d84e83b8acc.

13 months agocloudwatch: Own job for Replication Metrics
Grant Slater [Thu, 12 Oct 2023 03:09:43 +0000 (04:09 +0100)]
cloudwatch: Own job for Replication Metrics

13 months agocloudwatch: add eu-north-1 for osm-main to collect replication metrics
Grant Slater [Thu, 12 Oct 2023 02:50:22 +0000 (03:50 +0100)]
cloudwatch: add eu-north-1 for osm-main to collect replication metrics

13 months agoFix query interval for billing metrics
Tom Hughes [Wed, 11 Oct 2023 23:24:46 +0000 (00:24 +0100)]
Fix query interval for billing metrics

13 months agocloudwatch: Add other billed accounts
Grant Slater [Wed, 11 Oct 2023 22:09:12 +0000 (23:09 +0100)]
cloudwatch: Add other billed accounts

13 months agoAdd monitoring for AWS billing metrics
Tom Hughes [Wed, 11 Oct 2023 18:52:04 +0000 (19:52 +0100)]
Add monitoring for AWS billing metrics

13 months agoAdd monitoring for some EC2 metrics
Tom Hughes [Wed, 11 Oct 2023 18:18:33 +0000 (19:18 +0100)]
Add monitoring for some EC2 metrics

13 months agoInstall awscli on prometheus server
Tom Hughes [Wed, 11 Oct 2023 18:04:19 +0000 (19:04 +0100)]
Install awscli on prometheus server

13 months agocloudwatch: add account name comment
Grant Slater [Wed, 11 Oct 2023 16:50:18 +0000 (17:50 +0100)]
cloudwatch: add account name comment

13 months agocloudwatch: add sts-region
Grant Slater [Wed, 11 Oct 2023 16:36:54 +0000 (17:36 +0100)]
cloudwatch: add sts-region

13 months agoAdd dummy openid connect key for tests
Tom Hughes [Wed, 11 Oct 2023 14:48:45 +0000 (15:48 +0100)]
Add dummy openid connect key for tests

13 months agoAdd additional roles and regions to S3 monitoring
Tom Hughes [Wed, 11 Oct 2023 13:59:01 +0000 (14:59 +0100)]
Add additional roles and regions to S3 monitoring

13 months agoEnable some optional features for the cloudwatch exporter
Tom Hughes [Wed, 11 Oct 2023 07:59:52 +0000 (08:59 +0100)]
Enable some optional features for the cloudwatch exporter

13 months agoRestart cloudwatch exporter when the configuration changes
Tom Hughes [Tue, 10 Oct 2023 23:58:52 +0000 (00:58 +0100)]
Restart cloudwatch exporter when the configuration changes

13 months agoIncrease period for daily S3 metrics
Tom Hughes [Tue, 10 Oct 2023 23:56:15 +0000 (00:56 +0100)]
Increase period for daily S3 metrics

13 months agoConfigure cloudwatch exporter to collect S3 metrics
Tom Hughes [Tue, 10 Oct 2023 23:32:12 +0000 (00:32 +0100)]
Configure cloudwatch exporter to collect S3 metrics

13 months agoSend osmdbt log files to S3
Tom Hughes [Tue, 10 Oct 2023 16:21:27 +0000 (17:21 +0100)]
Send osmdbt log files to S3

13 months agoAdd AWS credentials for osmdbt uploads
Tom Hughes [Tue, 10 Oct 2023 16:06:58 +0000 (17:06 +0100)]
Add AWS credentials for osmdbt uploads

13 months agowordpress: unpin wp-fail2ban release
Grant Slater [Fri, 6 Oct 2023 22:15:49 +0000 (23:15 +0100)]
wordpress: unpin wp-fail2ban release

13 months agoSwitch odin and ysera to use postgres 16
Tom Hughes [Sun, 8 Oct 2023 09:29:59 +0000 (10:29 +0100)]
Switch odin and ysera to use postgres 16

13 months agoFix user creation for new dev sites
Tom Hughes [Sun, 8 Oct 2023 09:13:04 +0000 (10:13 +0100)]
Fix user creation for new dev sites

13 months agoAdd rails71 dev site
Tom Hughes [Sun, 8 Oct 2023 09:00:31 +0000 (10:00 +0100)]
Add rails71 dev site

13 months agoUse local variables in functions to avoid damaging the global scope
Tom Hughes [Sun, 8 Oct 2023 07:43:08 +0000 (08:43 +0100)]
Use local variables in functions to avoid damaging the global scope

13 months agoIgnore ancestry when switching svn branches
Tom Hughes [Fri, 6 Oct 2023 21:40:16 +0000 (22:40 +0100)]
Ignore ancestry when switching svn branches

13 months agoFreeze mutable objects assigned to constants
Guillaume Rischard [Fri, 6 Oct 2023 21:00:57 +0000 (17:00 -0400)]
Freeze mutable objects assigned to constants

Fixes cookstyle complaint:

Calling `DidYouMean::SPELL_CHECKERS.merge!(error_name => spell_checker)' has been deprecated. Please call `DidYouMean.correct_error(error_name, spell_checker)' instead.
Inspecting 597 files
...............................................................C.....................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................

Offenses:

cookbooks/db/recipes/master.rb:87:22: C: [Correctable] Style/MutableConstant: Freeze mutable objects assigned to constants.
CGIMAP_PERMISSIONS = { ...
                     ^
cookbooks/db/recipes/master.rb:122:26: C: [Correctable] Style/MutableConstant: Freeze mutable objects assigned to constants.
PLANETDUMP_PERMISSIONS = { ...
                         ^
cookbooks/db/recipes/master.rb:128:26: C: [Correctable] Style/MutableConstant: Freeze mutable objects assigned to constants.
PLANETDIFF_PERMISSIONS = { ...
                         ^

597 files inspected, 3 offenses detected, 3 offenses auto-correctable

13 months agocivicrm version bump, new plugins, cleanup
Guillaume RISCHARD [Fri, 6 Oct 2023 20:55:53 +0000 (16:55 -0400)]
civicrm version bump, new plugins, cleanup

13 months agoSimplify configuration of database permissions
Tom Hughes [Fri, 6 Oct 2023 15:40:57 +0000 (15:40 +0000)]
Simplify configuration of database permissions

13 months agoIgnore system tables and sequences
Tom Hughes [Fri, 6 Oct 2023 08:52:40 +0000 (08:52 +0000)]
Ignore system tables and sequences

13 months agoMinimise permissions for planetdump and planetdiff users
Tom Hughes [Fri, 6 Oct 2023 07:13:50 +0000 (08:13 +0100)]
Minimise permissions for planetdump and planetdiff users

13 months agoRun smokeping on prometheus servers
Tom Hughes [Thu, 5 Oct 2023 19:01:28 +0000 (20:01 +0100)]
Run smokeping on prometheus servers

13 months agoAdd additional PostgreSQL ACL permission decoding
Tom Hughes [Thu, 5 Oct 2023 17:24:31 +0000 (17:24 +0000)]
Add additional PostgreSQL ACL permission decoding

https://www.postgresql.org/docs/current/ddl-priv.html#PRIVILEGE-ABBREVS-TABLE

13 months agoManage permissions for database tables and sequences
Tom Hughes [Thu, 5 Oct 2023 17:07:56 +0000 (17:07 +0000)]
Manage permissions for database tables and sequences

13 months agoRemove role for nepomuk
Tom Hughes [Thu, 5 Oct 2023 16:02:17 +0000 (17:02 +0100)]
Remove role for nepomuk

13 months agoDrop role for firnen
Tom Hughes [Thu, 5 Oct 2023 15:45:05 +0000 (16:45 +0100)]
Drop role for firnen

13 months agoAdd postgresql_sequence for managing sequences
Tom Hughes [Thu, 5 Oct 2023 13:29:56 +0000 (13:29 +0000)]
Add postgresql_sequence for managing sequences

13 months agoLimit postgresql_table to acting on tables
Tom Hughes [Thu, 5 Oct 2023 13:29:21 +0000 (13:29 +0000)]
Limit postgresql_table to acting on tables

13 months agoManage cgimap postgres user
Tom Hughes [Thu, 5 Oct 2023 12:58:38 +0000 (13:58 +0100)]
Manage cgimap postgres user

13 months agoDrop gpximport postgres users that is no longer used
Tom Hughes [Thu, 5 Oct 2023 12:58:13 +0000 (13:58 +0100)]
Drop gpximport postgres users that is no longer used

13 months agonominatim: update OpenSearch description
Sarah Hoffmann [Thu, 5 Oct 2023 12:36:21 +0000 (14:36 +0200)]
nominatim: update OpenSearch description

13 months agoirc: Use new image name
Grant Slater [Wed, 4 Oct 2023 16:17:02 +0000 (17:17 +0100)]
irc: Use new image name

The repo was renamed to add the website suffix per style of the other sites.

13 months agoConfigure signing key for OpenID Connect
Tom Hughes [Tue, 3 Oct 2023 18:20:40 +0000 (19:20 +0100)]
Configure signing key for OpenID Connect

13 months agoAdd laser power alerts for switches
Tom Hughes [Mon, 2 Oct 2023 18:14:02 +0000 (19:14 +0100)]
Add laser power alerts for switches

13 months agoDrop role for pyrene
Tom Hughes [Mon, 2 Oct 2023 16:08:26 +0000 (17:08 +0100)]
Drop role for pyrene

13 months agoEnable network access for planetdump service so it can publish to S3
Tom Hughes [Fri, 29 Sep 2023 19:47:59 +0000 (20:47 +0100)]
Enable network access for planetdump service so it can publish to S3

13 months agoAdd OOB for grisu to dhcp
Tom Hughes [Fri, 29 Sep 2023 16:33:26 +0000 (17:33 +0100)]
Add OOB for grisu to dhcp

13 months agoRun a yearly reindex of the larger database tables
Tom Hughes [Thu, 28 Sep 2023 17:56:39 +0000 (18:56 +0100)]
Run a yearly reindex of the larger database tables

The reindex starts at 0200 on the second Friday in January to
avoid the monthly reindex that runs on the first Sunday of the
month and sit between two weekly backups.

13 months agoSimplify fdirsync and avoid race closing the descriptor
Tom Hughes [Thu, 28 Sep 2023 17:28:27 +0000 (18:28 +0100)]
Simplify fdirsync and avoid race closing the descriptor

13 months agoFix extra whitespace in planetdump
Grant Slater [Thu, 28 Sep 2023 15:16:33 +0000 (16:16 +0100)]
Fix extra whitespace in planetdump

13 months agoMerge remote-tracking branch 'github/pull/626'
Tom Hughes [Thu, 28 Sep 2023 14:50:52 +0000 (15:50 +0100)]
Merge remote-tracking branch 'github/pull/626'

13 months agoDo not report progress on scripted s3 uploads
Grant Slater [Thu, 28 Sep 2023 14:43:15 +0000 (15:43 +0100)]
Do not report progress on scripted s3 uploads

13 months agoTune s3 upload speed and concurrency
Grant Slater [Thu, 28 Sep 2023 14:42:36 +0000 (15:42 +0100)]
Tune s3 upload speed and concurrency

13 months agoplanet: add tile_logs S3 redirect
Grant Slater [Thu, 28 Sep 2023 12:42:06 +0000 (13:42 +0100)]
planet: add tile_logs S3 redirect

Fixes: https://github.com/openstreetmap/operations/issues/965
13 months agoCorrect interface name for bowser
Tom Hughes [Thu, 28 Sep 2023 07:28:09 +0000 (08:28 +0100)]
Correct interface name for bowser

13 months agoSwitch balerion to use postgresql 16
Tom Hughes [Thu, 28 Sep 2023 07:27:29 +0000 (08:27 +0100)]
Switch balerion to use postgresql 16

14 months agoSwitch balerion to use postgresql 16
Tom Hughes [Tue, 26 Sep 2023 15:52:45 +0000 (16:52 +0100)]
Switch balerion to use postgresql 16

14 months agoCivi+extension version bump
Guillaume RISCHARD [Tue, 26 Sep 2023 05:43:11 +0000 (01:43 -0400)]
Civi+extension version bump

14 months agoplanet: remove cleanup code
Grant Slater [Tue, 26 Sep 2023 01:03:53 +0000 (02:03 +0100)]
planet: remove cleanup code

14 months agoplanet: fix minor typo
Grant Slater [Tue, 26 Sep 2023 00:58:58 +0000 (01:58 +0100)]
planet: fix minor typo

14 months agoplanet: fix redirect for full-history osm files
Grant Slater [Tue, 26 Sep 2023 00:57:17 +0000 (01:57 +0100)]
planet: fix redirect for full-history osm files

14 months agoplanet: remove old legacy mirror redirect updater
Grant Slater [Tue, 26 Sep 2023 00:48:00 +0000 (01:48 +0100)]
planet: remove old legacy mirror redirect updater

14 months agoplanet: Remove download speed limit
Grant Slater [Tue, 26 Sep 2023 00:27:02 +0000 (01:27 +0100)]
planet: Remove download speed limit

14 months agoAdd redirects to planet S3
Grant Slater [Mon, 25 Sep 2023 17:16:28 +0000 (18:16 +0100)]
Add redirects to planet S3

14 months agoPort apache-latest-planet-filename to python
Grant Slater [Mon, 25 Sep 2023 17:14:50 +0000 (18:14 +0100)]
Port apache-latest-planet-filename to python

14 months agoMerge remote-tracking branch 'github/pull/623'
Tom Hughes [Sun, 24 Sep 2023 22:49:59 +0000 (23:49 +0100)]
Merge remote-tracking branch 'github/pull/623'

14 months agoAdd geoipupdate depends on planet
Grant Slater [Sun, 24 Sep 2023 22:35:51 +0000 (23:35 +0100)]
Add geoipupdate depends on planet

14 months agoAdd a comment indicating where imagery blacklist requests come from
Paul Norman [Sun, 24 Sep 2023 21:27:51 +0000 (14:27 -0700)]
Add a comment indicating where imagery blacklist requests come from

14 months agoCopy planet dumps to S3
Tom Hughes [Sun, 24 Sep 2023 18:27:20 +0000 (19:27 +0100)]
Copy planet dumps to S3

14 months agoCopy tile logs to S3
Tom Hughes [Sun, 24 Sep 2023 17:57:53 +0000 (18:57 +0100)]
Copy tile logs to S3

14 months agoCopy hourly and daily replication diffs to S3
Tom Hughes [Sun, 24 Sep 2023 15:06:23 +0000 (16:06 +0100)]
Copy hourly and daily replication diffs to S3

14 months agoMake paths explicit
Tom Hughes [Sun, 24 Sep 2023 14:45:18 +0000 (15:45 +0100)]
Make paths explicit

14 months agoCopy minutely replication diffs to S3
Tom Hughes [Sun, 24 Sep 2023 14:35:00 +0000 (15:35 +0100)]
Copy minutely replication diffs to S3

14 months agoFix access to AWS credentials for planet services
Tom Hughes [Sun, 24 Sep 2023 09:55:38 +0000 (10:55 +0100)]
Fix access to AWS credentials for planet services

14 months agoAdd support for BindPaths and BindReadOnlyPaths to systemd_service
Tom Hughes [Sun, 24 Sep 2023 09:54:53 +0000 (10:54 +0100)]
Add support for BindPaths and BindReadOnlyPaths to systemd_service

14 months agoCopy changeset replication diffs to S3
Tom Hughes [Sun, 24 Sep 2023 09:41:09 +0000 (10:41 +0100)]
Copy changeset replication diffs to S3