]> git.openstreetmap.org Git - chef.git/log
chef.git
13 months agoplanet: cleanup redirects and add replication diff redirects
Grant Slater [Sun, 22 Oct 2023 19:14:06 +0000 (20:14 +0100)]
planet: cleanup redirects and add replication diff redirects

13 months agoAvoid double call to ip2region; consolidate rewrite conditions
Guillaume Rischard [Sat, 21 Oct 2023 16:51:38 +0000 (12:51 -0400)]
Avoid double call to ip2region; consolidate rewrite conditions

13 months agoUse dual stack (IPv4/IPv6) S3 endpoints for public-facing planet
Guillaume Rischard [Sat, 21 Oct 2023 16:25:09 +0000 (12:25 -0400)]
Use dual stack (IPv4/IPv6) S3 endpoints for public-facing planet

Fixes https://github.com/openstreetmap/operations/issues/983

13 months agoSwitch palulukon to use postgres 16
Tom Hughes [Sat, 21 Oct 2023 23:04:07 +0000 (00:04 +0100)]
Switch palulukon to use postgres 16

13 months agoMake prometheus backup service fail on error
Tom Hughes [Sat, 21 Oct 2023 14:07:49 +0000 (15:07 +0100)]
Make prometheus backup service fail on error

13 months agoAllow prometheus backup server to acess AWS cache
Tom Hughes [Sat, 21 Oct 2023 14:07:22 +0000 (15:07 +0100)]
Allow prometheus backup server to acess AWS cache

13 months agoSilence curl progress messages
Tom Hughes [Sat, 21 Oct 2023 14:06:25 +0000 (15:06 +0100)]
Silence curl progress messages

13 months agoEnable prometheus backup timer
Tom Hughes [Sat, 21 Oct 2023 14:05:34 +0000 (15:05 +0100)]
Enable prometheus backup timer

13 months agoMerge remote-tracking branch 'github/pull/631'
Tom Hughes [Sat, 21 Oct 2023 14:03:25 +0000 (15:03 +0100)]
Merge remote-tracking branch 'github/pull/631'

13 months agoBackup prometheus data to S3
Tom Hughes [Sat, 21 Oct 2023 11:51:32 +0000 (12:51 +0100)]
Backup prometheus data to S3

13 months agoDisable progress messages for osm2pgsql
Tom Hughes [Sat, 21 Oct 2023 10:52:13 +0000 (11:52 +0100)]
Disable progress messages for osm2pgsql

13 months agoSwitch piasa to use postgres 16
Tom Hughes [Fri, 20 Oct 2023 23:42:38 +0000 (00:42 +0100)]
Switch piasa to use postgres 16

13 months agoplanet: increase AWS upload max_bandwidth
Grant Slater [Fri, 20 Oct 2023 11:19:13 +0000 (12:19 +0100)]
planet: increase AWS upload max_bandwidth

13 months agoEnable prometheus admin API
Tom Hughes [Thu, 19 Oct 2023 20:19:45 +0000 (21:19 +0100)]
Enable prometheus admin API

13 months agoMake prometheus API blocks work
Tom Hughes [Thu, 19 Oct 2023 20:15:27 +0000 (21:15 +0100)]
Make prometheus API blocks work

13 months agoBlock external access to prometheus admin API
Tom Hughes [Thu, 19 Oct 2023 19:47:09 +0000 (20:47 +0100)]
Block external access to prometheus admin API

13 months agoInstall libyaml-dev for rails
Tom Hughes [Wed, 18 Oct 2023 18:06:32 +0000 (19:06 +0100)]
Install libyaml-dev for rails

13 months agocivicrm version bump, corrected extension name
Guillaume RISCHARD [Tue, 17 Oct 2023 12:21:19 +0000 (08:21 -0400)]
civicrm version bump, corrected extension name

14 months agoStop trying to URI encode passwords
Tom Hughes [Sun, 15 Oct 2023 17:58:50 +0000 (18:58 +0100)]
Stop trying to URI encode passwords

14 months agoMake postgres exporter connect as the prometheus user
Tom Hughes [Sun, 15 Oct 2023 17:42:31 +0000 (18:42 +0100)]
Make postgres exporter connect as the prometheus user

14 months agoGrant roles to newly created users
Tom Hughes [Sun, 15 Oct 2023 11:27:40 +0000 (11:27 +0000)]
Grant roles to newly created users

14 months agoRemove some old cleanup code
Tom Hughes [Sun, 15 Oct 2023 11:19:13 +0000 (12:19 +0100)]
Remove some old cleanup code

14 months agoAdd a prometheus user to all postgres clusters
Tom Hughes [Sun, 15 Oct 2023 11:16:21 +0000 (11:16 +0000)]
Add a prometheus user to all postgres clusters

14 months agoAdd support for granting roles to postgres users
Tom Hughes [Sun, 15 Oct 2023 10:16:01 +0000 (11:16 +0100)]
Add support for granting roles to postgres users

14 months agoSwitch nidhogg to use postgres 16
Tom Hughes [Sat, 14 Oct 2023 14:23:25 +0000 (15:23 +0100)]
Switch nidhogg to use postgres 16

14 months agoSwitch culebre to use postgres 16
Tom Hughes [Fri, 13 Oct 2023 17:54:15 +0000 (18:54 +0100)]
Switch culebre to use postgres 16

14 months agoAdd alert for interface redundancy
Tom Hughes [Fri, 13 Oct 2023 16:54:51 +0000 (17:54 +0100)]
Add alert for interface redundancy

14 months agoReport bond mode for bonded interfaces
Tom Hughes [Fri, 13 Oct 2023 16:39:10 +0000 (17:39 +0100)]
Report bond mode for bonded interfaces

14 months agooxidized: add libyaml-dev requirement
Grant Slater [Fri, 13 Oct 2023 15:47:35 +0000 (16:47 +0100)]
oxidized: add libyaml-dev requirement

14 months agoUse the directory name as the certificate name for uploads
Tom Hughes [Fri, 13 Oct 2023 08:05:47 +0000 (09:05 +0100)]
Use the directory name as the certificate name for uploads

14 months agoStatically configure backup replication metrics
Tom Hughes [Thu, 12 Oct 2023 18:05:13 +0000 (19:05 +0100)]
Statically configure backup replication metrics

14 months agoSet roundingPeriod explicitly for all jobs
Tom Hughes [Thu, 12 Oct 2023 16:17:18 +0000 (17:17 +0100)]
Set roundingPeriod explicitly for all jobs

14 months agoSplit daily metrics into separate jobs
Tom Hughes [Thu, 12 Oct 2023 15:54:39 +0000 (16:54 +0100)]
Split daily metrics into separate jobs

14 months agoLook back two days for S2 daily statistics
Tom Hughes [Thu, 12 Oct 2023 14:33:22 +0000 (15:33 +0100)]
Look back two days for S2 daily statistics

14 months agoRevert "cloudwatch: add eu-north-1 for osm-main to collect replication metrics"
Grant Slater [Thu, 12 Oct 2023 04:21:27 +0000 (05:21 +0100)]
Revert "cloudwatch: add eu-north-1 for osm-main to collect replication metrics"

This reverts commit 7e0c2e2982f696e3d1e57c6ec4889fe1e6038446.

14 months agoRevert "cloudwatch: Own job for Replication Metrics"
Grant Slater [Thu, 12 Oct 2023 04:21:23 +0000 (05:21 +0100)]
Revert "cloudwatch: Own job for Replication Metrics"

This reverts commit 6c92319de16d70a02efabb29a4ea2d84e83b8acc.

14 months agocloudwatch: Own job for Replication Metrics
Grant Slater [Thu, 12 Oct 2023 03:09:43 +0000 (04:09 +0100)]
cloudwatch: Own job for Replication Metrics

14 months agocloudwatch: add eu-north-1 for osm-main to collect replication metrics
Grant Slater [Thu, 12 Oct 2023 02:50:22 +0000 (03:50 +0100)]
cloudwatch: add eu-north-1 for osm-main to collect replication metrics

14 months agoFix query interval for billing metrics
Tom Hughes [Wed, 11 Oct 2023 23:24:46 +0000 (00:24 +0100)]
Fix query interval for billing metrics

14 months agocloudwatch: Add other billed accounts
Grant Slater [Wed, 11 Oct 2023 22:09:12 +0000 (23:09 +0100)]
cloudwatch: Add other billed accounts

14 months agoAdd monitoring for AWS billing metrics
Tom Hughes [Wed, 11 Oct 2023 18:52:04 +0000 (19:52 +0100)]
Add monitoring for AWS billing metrics

14 months agoAdd monitoring for some EC2 metrics
Tom Hughes [Wed, 11 Oct 2023 18:18:33 +0000 (19:18 +0100)]
Add monitoring for some EC2 metrics

14 months agoInstall awscli on prometheus server
Tom Hughes [Wed, 11 Oct 2023 18:04:19 +0000 (19:04 +0100)]
Install awscli on prometheus server

14 months agocloudwatch: add account name comment
Grant Slater [Wed, 11 Oct 2023 16:50:18 +0000 (17:50 +0100)]
cloudwatch: add account name comment

14 months agocloudwatch: add sts-region
Grant Slater [Wed, 11 Oct 2023 16:36:54 +0000 (17:36 +0100)]
cloudwatch: add sts-region

14 months agoAdd dummy openid connect key for tests
Tom Hughes [Wed, 11 Oct 2023 14:48:45 +0000 (15:48 +0100)]
Add dummy openid connect key for tests

14 months agoAdd additional roles and regions to S3 monitoring
Tom Hughes [Wed, 11 Oct 2023 13:59:01 +0000 (14:59 +0100)]
Add additional roles and regions to S3 monitoring

14 months agoEnable some optional features for the cloudwatch exporter
Tom Hughes [Wed, 11 Oct 2023 07:59:52 +0000 (08:59 +0100)]
Enable some optional features for the cloudwatch exporter

14 months agoRestart cloudwatch exporter when the configuration changes
Tom Hughes [Tue, 10 Oct 2023 23:58:52 +0000 (00:58 +0100)]
Restart cloudwatch exporter when the configuration changes

14 months agoIncrease period for daily S3 metrics
Tom Hughes [Tue, 10 Oct 2023 23:56:15 +0000 (00:56 +0100)]
Increase period for daily S3 metrics

14 months agoConfigure cloudwatch exporter to collect S3 metrics
Tom Hughes [Tue, 10 Oct 2023 23:32:12 +0000 (00:32 +0100)]
Configure cloudwatch exporter to collect S3 metrics

14 months agoSend osmdbt log files to S3
Tom Hughes [Tue, 10 Oct 2023 16:21:27 +0000 (17:21 +0100)]
Send osmdbt log files to S3

14 months agoAdd AWS credentials for osmdbt uploads
Tom Hughes [Tue, 10 Oct 2023 16:06:58 +0000 (17:06 +0100)]
Add AWS credentials for osmdbt uploads

14 months agowordpress: unpin wp-fail2ban release
Grant Slater [Fri, 6 Oct 2023 22:15:49 +0000 (23:15 +0100)]
wordpress: unpin wp-fail2ban release

14 months agoSwitch odin and ysera to use postgres 16
Tom Hughes [Sun, 8 Oct 2023 09:29:59 +0000 (10:29 +0100)]
Switch odin and ysera to use postgres 16

14 months agoFix user creation for new dev sites
Tom Hughes [Sun, 8 Oct 2023 09:13:04 +0000 (10:13 +0100)]
Fix user creation for new dev sites

14 months agoAdd rails71 dev site
Tom Hughes [Sun, 8 Oct 2023 09:00:31 +0000 (10:00 +0100)]
Add rails71 dev site

14 months agoUse local variables in functions to avoid damaging the global scope
Tom Hughes [Sun, 8 Oct 2023 07:43:08 +0000 (08:43 +0100)]
Use local variables in functions to avoid damaging the global scope

14 months agoIgnore ancestry when switching svn branches
Tom Hughes [Fri, 6 Oct 2023 21:40:16 +0000 (22:40 +0100)]
Ignore ancestry when switching svn branches

14 months agoFreeze mutable objects assigned to constants
Guillaume Rischard [Fri, 6 Oct 2023 21:00:57 +0000 (17:00 -0400)]
Freeze mutable objects assigned to constants

Fixes cookstyle complaint:

Calling `DidYouMean::SPELL_CHECKERS.merge!(error_name => spell_checker)' has been deprecated. Please call `DidYouMean.correct_error(error_name, spell_checker)' instead.
Inspecting 597 files
...............................................................C.....................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................

Offenses:

cookbooks/db/recipes/master.rb:87:22: C: [Correctable] Style/MutableConstant: Freeze mutable objects assigned to constants.
CGIMAP_PERMISSIONS = { ...
                     ^
cookbooks/db/recipes/master.rb:122:26: C: [Correctable] Style/MutableConstant: Freeze mutable objects assigned to constants.
PLANETDUMP_PERMISSIONS = { ...
                         ^
cookbooks/db/recipes/master.rb:128:26: C: [Correctable] Style/MutableConstant: Freeze mutable objects assigned to constants.
PLANETDIFF_PERMISSIONS = { ...
                         ^

597 files inspected, 3 offenses detected, 3 offenses auto-correctable

14 months agocivicrm version bump, new plugins, cleanup
Guillaume RISCHARD [Fri, 6 Oct 2023 20:55:53 +0000 (16:55 -0400)]
civicrm version bump, new plugins, cleanup

14 months agoSimplify configuration of database permissions
Tom Hughes [Fri, 6 Oct 2023 15:40:57 +0000 (15:40 +0000)]
Simplify configuration of database permissions

14 months agoIgnore system tables and sequences
Tom Hughes [Fri, 6 Oct 2023 08:52:40 +0000 (08:52 +0000)]
Ignore system tables and sequences

14 months agoMinimise permissions for planetdump and planetdiff users
Tom Hughes [Fri, 6 Oct 2023 07:13:50 +0000 (08:13 +0100)]
Minimise permissions for planetdump and planetdiff users

14 months agoRun smokeping on prometheus servers
Tom Hughes [Thu, 5 Oct 2023 19:01:28 +0000 (20:01 +0100)]
Run smokeping on prometheus servers

14 months agoAdd additional PostgreSQL ACL permission decoding
Tom Hughes [Thu, 5 Oct 2023 17:24:31 +0000 (17:24 +0000)]
Add additional PostgreSQL ACL permission decoding

https://www.postgresql.org/docs/current/ddl-priv.html#PRIVILEGE-ABBREVS-TABLE

14 months agoManage permissions for database tables and sequences
Tom Hughes [Thu, 5 Oct 2023 17:07:56 +0000 (17:07 +0000)]
Manage permissions for database tables and sequences

14 months agoRemove role for nepomuk
Tom Hughes [Thu, 5 Oct 2023 16:02:17 +0000 (17:02 +0100)]
Remove role for nepomuk

14 months agoDrop role for firnen
Tom Hughes [Thu, 5 Oct 2023 15:45:05 +0000 (16:45 +0100)]
Drop role for firnen

14 months agoAdd postgresql_sequence for managing sequences
Tom Hughes [Thu, 5 Oct 2023 13:29:56 +0000 (13:29 +0000)]
Add postgresql_sequence for managing sequences

14 months agoLimit postgresql_table to acting on tables
Tom Hughes [Thu, 5 Oct 2023 13:29:21 +0000 (13:29 +0000)]
Limit postgresql_table to acting on tables

14 months agoManage cgimap postgres user
Tom Hughes [Thu, 5 Oct 2023 12:58:38 +0000 (13:58 +0100)]
Manage cgimap postgres user

14 months agoDrop gpximport postgres users that is no longer used
Tom Hughes [Thu, 5 Oct 2023 12:58:13 +0000 (13:58 +0100)]
Drop gpximport postgres users that is no longer used

14 months agonominatim: update OpenSearch description
Sarah Hoffmann [Thu, 5 Oct 2023 12:36:21 +0000 (14:36 +0200)]
nominatim: update OpenSearch description

14 months agoirc: Use new image name
Grant Slater [Wed, 4 Oct 2023 16:17:02 +0000 (17:17 +0100)]
irc: Use new image name

The repo was renamed to add the website suffix per style of the other sites.

14 months agoConfigure signing key for OpenID Connect
Tom Hughes [Tue, 3 Oct 2023 18:20:40 +0000 (19:20 +0100)]
Configure signing key for OpenID Connect

14 months agoAdd laser power alerts for switches
Tom Hughes [Mon, 2 Oct 2023 18:14:02 +0000 (19:14 +0100)]
Add laser power alerts for switches

14 months agoDrop role for pyrene
Tom Hughes [Mon, 2 Oct 2023 16:08:26 +0000 (17:08 +0100)]
Drop role for pyrene

14 months agoEnable network access for planetdump service so it can publish to S3
Tom Hughes [Fri, 29 Sep 2023 19:47:59 +0000 (20:47 +0100)]
Enable network access for planetdump service so it can publish to S3

14 months agoAdd OOB for grisu to dhcp
Tom Hughes [Fri, 29 Sep 2023 16:33:26 +0000 (17:33 +0100)]
Add OOB for grisu to dhcp

14 months agoRun a yearly reindex of the larger database tables
Tom Hughes [Thu, 28 Sep 2023 17:56:39 +0000 (18:56 +0100)]
Run a yearly reindex of the larger database tables

The reindex starts at 0200 on the second Friday in January to
avoid the monthly reindex that runs on the first Sunday of the
month and sit between two weekly backups.

14 months agoSimplify fdirsync and avoid race closing the descriptor
Tom Hughes [Thu, 28 Sep 2023 17:28:27 +0000 (18:28 +0100)]
Simplify fdirsync and avoid race closing the descriptor

14 months agoFix extra whitespace in planetdump
Grant Slater [Thu, 28 Sep 2023 15:16:33 +0000 (16:16 +0100)]
Fix extra whitespace in planetdump

14 months agoMerge remote-tracking branch 'github/pull/626'
Tom Hughes [Thu, 28 Sep 2023 14:50:52 +0000 (15:50 +0100)]
Merge remote-tracking branch 'github/pull/626'

14 months agoDo not report progress on scripted s3 uploads
Grant Slater [Thu, 28 Sep 2023 14:43:15 +0000 (15:43 +0100)]
Do not report progress on scripted s3 uploads

14 months agoTune s3 upload speed and concurrency
Grant Slater [Thu, 28 Sep 2023 14:42:36 +0000 (15:42 +0100)]
Tune s3 upload speed and concurrency

14 months agoplanet: add tile_logs S3 redirect
Grant Slater [Thu, 28 Sep 2023 12:42:06 +0000 (13:42 +0100)]
planet: add tile_logs S3 redirect

Fixes: https://github.com/openstreetmap/operations/issues/965
14 months agoCorrect interface name for bowser
Tom Hughes [Thu, 28 Sep 2023 07:28:09 +0000 (08:28 +0100)]
Correct interface name for bowser

14 months agoSwitch balerion to use postgresql 16
Tom Hughes [Thu, 28 Sep 2023 07:27:29 +0000 (08:27 +0100)]
Switch balerion to use postgresql 16

14 months agoSwitch balerion to use postgresql 16
Tom Hughes [Tue, 26 Sep 2023 15:52:45 +0000 (16:52 +0100)]
Switch balerion to use postgresql 16

14 months agoCivi+extension version bump
Guillaume RISCHARD [Tue, 26 Sep 2023 05:43:11 +0000 (01:43 -0400)]
Civi+extension version bump

14 months agoplanet: remove cleanup code
Grant Slater [Tue, 26 Sep 2023 01:03:53 +0000 (02:03 +0100)]
planet: remove cleanup code

14 months agoplanet: fix minor typo
Grant Slater [Tue, 26 Sep 2023 00:58:58 +0000 (01:58 +0100)]
planet: fix minor typo

14 months agoplanet: fix redirect for full-history osm files
Grant Slater [Tue, 26 Sep 2023 00:57:17 +0000 (01:57 +0100)]
planet: fix redirect for full-history osm files

14 months agoplanet: remove old legacy mirror redirect updater
Grant Slater [Tue, 26 Sep 2023 00:48:00 +0000 (01:48 +0100)]
planet: remove old legacy mirror redirect updater

14 months agoplanet: Remove download speed limit
Grant Slater [Tue, 26 Sep 2023 00:27:02 +0000 (01:27 +0100)]
planet: Remove download speed limit

14 months agoAdd redirects to planet S3
Grant Slater [Mon, 25 Sep 2023 17:16:28 +0000 (18:16 +0100)]
Add redirects to planet S3

14 months agoPort apache-latest-planet-filename to python
Grant Slater [Mon, 25 Sep 2023 17:14:50 +0000 (18:14 +0100)]
Port apache-latest-planet-filename to python

14 months agoMerge remote-tracking branch 'github/pull/623'
Tom Hughes [Sun, 24 Sep 2023 22:49:59 +0000 (23:49 +0100)]
Merge remote-tracking branch 'github/pull/623'

14 months agoAdd geoipupdate depends on planet
Grant Slater [Sun, 24 Sep 2023 22:35:51 +0000 (23:35 +0100)]
Add geoipupdate depends on planet