]> git.openstreetmap.org Git - chef.git/log
chef.git
13 months agoStatically configure backup replication metrics
Tom Hughes [Thu, 12 Oct 2023 18:05:13 +0000 (19:05 +0100)]
Statically configure backup replication metrics

13 months agoSet roundingPeriod explicitly for all jobs
Tom Hughes [Thu, 12 Oct 2023 16:17:18 +0000 (17:17 +0100)]
Set roundingPeriod explicitly for all jobs

13 months agoSplit daily metrics into separate jobs
Tom Hughes [Thu, 12 Oct 2023 15:54:39 +0000 (16:54 +0100)]
Split daily metrics into separate jobs

13 months agoLook back two days for S2 daily statistics
Tom Hughes [Thu, 12 Oct 2023 14:33:22 +0000 (15:33 +0100)]
Look back two days for S2 daily statistics

13 months agoRevert "cloudwatch: add eu-north-1 for osm-main to collect replication metrics"
Grant Slater [Thu, 12 Oct 2023 04:21:27 +0000 (05:21 +0100)]
Revert "cloudwatch: add eu-north-1 for osm-main to collect replication metrics"

This reverts commit 7e0c2e2982f696e3d1e57c6ec4889fe1e6038446.

13 months agoRevert "cloudwatch: Own job for Replication Metrics"
Grant Slater [Thu, 12 Oct 2023 04:21:23 +0000 (05:21 +0100)]
Revert "cloudwatch: Own job for Replication Metrics"

This reverts commit 6c92319de16d70a02efabb29a4ea2d84e83b8acc.

13 months agocloudwatch: Own job for Replication Metrics
Grant Slater [Thu, 12 Oct 2023 03:09:43 +0000 (04:09 +0100)]
cloudwatch: Own job for Replication Metrics

13 months agocloudwatch: add eu-north-1 for osm-main to collect replication metrics
Grant Slater [Thu, 12 Oct 2023 02:50:22 +0000 (03:50 +0100)]
cloudwatch: add eu-north-1 for osm-main to collect replication metrics

13 months agoFix query interval for billing metrics
Tom Hughes [Wed, 11 Oct 2023 23:24:46 +0000 (00:24 +0100)]
Fix query interval for billing metrics

13 months agocloudwatch: Add other billed accounts
Grant Slater [Wed, 11 Oct 2023 22:09:12 +0000 (23:09 +0100)]
cloudwatch: Add other billed accounts

13 months agoAdd monitoring for AWS billing metrics
Tom Hughes [Wed, 11 Oct 2023 18:52:04 +0000 (19:52 +0100)]
Add monitoring for AWS billing metrics

13 months agoAdd monitoring for some EC2 metrics
Tom Hughes [Wed, 11 Oct 2023 18:18:33 +0000 (19:18 +0100)]
Add monitoring for some EC2 metrics

13 months agoInstall awscli on prometheus server
Tom Hughes [Wed, 11 Oct 2023 18:04:19 +0000 (19:04 +0100)]
Install awscli on prometheus server

13 months agocloudwatch: add account name comment
Grant Slater [Wed, 11 Oct 2023 16:50:18 +0000 (17:50 +0100)]
cloudwatch: add account name comment

13 months agocloudwatch: add sts-region
Grant Slater [Wed, 11 Oct 2023 16:36:54 +0000 (17:36 +0100)]
cloudwatch: add sts-region

13 months agoAdd dummy openid connect key for tests
Tom Hughes [Wed, 11 Oct 2023 14:48:45 +0000 (15:48 +0100)]
Add dummy openid connect key for tests

13 months agoAdd additional roles and regions to S3 monitoring
Tom Hughes [Wed, 11 Oct 2023 13:59:01 +0000 (14:59 +0100)]
Add additional roles and regions to S3 monitoring

13 months agoEnable some optional features for the cloudwatch exporter
Tom Hughes [Wed, 11 Oct 2023 07:59:52 +0000 (08:59 +0100)]
Enable some optional features for the cloudwatch exporter

13 months agoRestart cloudwatch exporter when the configuration changes
Tom Hughes [Tue, 10 Oct 2023 23:58:52 +0000 (00:58 +0100)]
Restart cloudwatch exporter when the configuration changes

13 months agoIncrease period for daily S3 metrics
Tom Hughes [Tue, 10 Oct 2023 23:56:15 +0000 (00:56 +0100)]
Increase period for daily S3 metrics

13 months agoConfigure cloudwatch exporter to collect S3 metrics
Tom Hughes [Tue, 10 Oct 2023 23:32:12 +0000 (00:32 +0100)]
Configure cloudwatch exporter to collect S3 metrics

13 months agoSend osmdbt log files to S3
Tom Hughes [Tue, 10 Oct 2023 16:21:27 +0000 (17:21 +0100)]
Send osmdbt log files to S3

13 months agoAdd AWS credentials for osmdbt uploads
Tom Hughes [Tue, 10 Oct 2023 16:06:58 +0000 (17:06 +0100)]
Add AWS credentials for osmdbt uploads

13 months agowordpress: unpin wp-fail2ban release
Grant Slater [Fri, 6 Oct 2023 22:15:49 +0000 (23:15 +0100)]
wordpress: unpin wp-fail2ban release

13 months agoSwitch odin and ysera to use postgres 16
Tom Hughes [Sun, 8 Oct 2023 09:29:59 +0000 (10:29 +0100)]
Switch odin and ysera to use postgres 16

13 months agoFix user creation for new dev sites
Tom Hughes [Sun, 8 Oct 2023 09:13:04 +0000 (10:13 +0100)]
Fix user creation for new dev sites

13 months agoAdd rails71 dev site
Tom Hughes [Sun, 8 Oct 2023 09:00:31 +0000 (10:00 +0100)]
Add rails71 dev site

13 months agoUse local variables in functions to avoid damaging the global scope
Tom Hughes [Sun, 8 Oct 2023 07:43:08 +0000 (08:43 +0100)]
Use local variables in functions to avoid damaging the global scope

13 months agoIgnore ancestry when switching svn branches
Tom Hughes [Fri, 6 Oct 2023 21:40:16 +0000 (22:40 +0100)]
Ignore ancestry when switching svn branches

13 months agoFreeze mutable objects assigned to constants
Guillaume Rischard [Fri, 6 Oct 2023 21:00:57 +0000 (17:00 -0400)]
Freeze mutable objects assigned to constants

Fixes cookstyle complaint:

Calling `DidYouMean::SPELL_CHECKERS.merge!(error_name => spell_checker)' has been deprecated. Please call `DidYouMean.correct_error(error_name, spell_checker)' instead.
Inspecting 597 files
...............................................................C.....................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................

Offenses:

cookbooks/db/recipes/master.rb:87:22: C: [Correctable] Style/MutableConstant: Freeze mutable objects assigned to constants.
CGIMAP_PERMISSIONS = { ...
                     ^
cookbooks/db/recipes/master.rb:122:26: C: [Correctable] Style/MutableConstant: Freeze mutable objects assigned to constants.
PLANETDUMP_PERMISSIONS = { ...
                         ^
cookbooks/db/recipes/master.rb:128:26: C: [Correctable] Style/MutableConstant: Freeze mutable objects assigned to constants.
PLANETDIFF_PERMISSIONS = { ...
                         ^

597 files inspected, 3 offenses detected, 3 offenses auto-correctable

13 months agocivicrm version bump, new plugins, cleanup
Guillaume RISCHARD [Fri, 6 Oct 2023 20:55:53 +0000 (16:55 -0400)]
civicrm version bump, new plugins, cleanup

13 months agoSimplify configuration of database permissions
Tom Hughes [Fri, 6 Oct 2023 15:40:57 +0000 (15:40 +0000)]
Simplify configuration of database permissions

13 months agoIgnore system tables and sequences
Tom Hughes [Fri, 6 Oct 2023 08:52:40 +0000 (08:52 +0000)]
Ignore system tables and sequences

13 months agoMinimise permissions for planetdump and planetdiff users
Tom Hughes [Fri, 6 Oct 2023 07:13:50 +0000 (08:13 +0100)]
Minimise permissions for planetdump and planetdiff users

13 months agoRun smokeping on prometheus servers
Tom Hughes [Thu, 5 Oct 2023 19:01:28 +0000 (20:01 +0100)]
Run smokeping on prometheus servers

13 months agoAdd additional PostgreSQL ACL permission decoding
Tom Hughes [Thu, 5 Oct 2023 17:24:31 +0000 (17:24 +0000)]
Add additional PostgreSQL ACL permission decoding

https://www.postgresql.org/docs/current/ddl-priv.html#PRIVILEGE-ABBREVS-TABLE

13 months agoManage permissions for database tables and sequences
Tom Hughes [Thu, 5 Oct 2023 17:07:56 +0000 (17:07 +0000)]
Manage permissions for database tables and sequences

13 months agoRemove role for nepomuk
Tom Hughes [Thu, 5 Oct 2023 16:02:17 +0000 (17:02 +0100)]
Remove role for nepomuk

13 months agoDrop role for firnen
Tom Hughes [Thu, 5 Oct 2023 15:45:05 +0000 (16:45 +0100)]
Drop role for firnen

13 months agoAdd postgresql_sequence for managing sequences
Tom Hughes [Thu, 5 Oct 2023 13:29:56 +0000 (13:29 +0000)]
Add postgresql_sequence for managing sequences

13 months agoLimit postgresql_table to acting on tables
Tom Hughes [Thu, 5 Oct 2023 13:29:21 +0000 (13:29 +0000)]
Limit postgresql_table to acting on tables

13 months agoManage cgimap postgres user
Tom Hughes [Thu, 5 Oct 2023 12:58:38 +0000 (13:58 +0100)]
Manage cgimap postgres user

13 months agoDrop gpximport postgres users that is no longer used
Tom Hughes [Thu, 5 Oct 2023 12:58:13 +0000 (13:58 +0100)]
Drop gpximport postgres users that is no longer used

13 months agonominatim: update OpenSearch description
Sarah Hoffmann [Thu, 5 Oct 2023 12:36:21 +0000 (14:36 +0200)]
nominatim: update OpenSearch description

13 months agoirc: Use new image name
Grant Slater [Wed, 4 Oct 2023 16:17:02 +0000 (17:17 +0100)]
irc: Use new image name

The repo was renamed to add the website suffix per style of the other sites.

13 months agoConfigure signing key for OpenID Connect
Tom Hughes [Tue, 3 Oct 2023 18:20:40 +0000 (19:20 +0100)]
Configure signing key for OpenID Connect

13 months agoAdd laser power alerts for switches
Tom Hughes [Mon, 2 Oct 2023 18:14:02 +0000 (19:14 +0100)]
Add laser power alerts for switches

13 months agoDrop role for pyrene
Tom Hughes [Mon, 2 Oct 2023 16:08:26 +0000 (17:08 +0100)]
Drop role for pyrene

13 months agoEnable network access for planetdump service so it can publish to S3
Tom Hughes [Fri, 29 Sep 2023 19:47:59 +0000 (20:47 +0100)]
Enable network access for planetdump service so it can publish to S3

13 months agoAdd OOB for grisu to dhcp
Tom Hughes [Fri, 29 Sep 2023 16:33:26 +0000 (17:33 +0100)]
Add OOB for grisu to dhcp

13 months agoRun a yearly reindex of the larger database tables
Tom Hughes [Thu, 28 Sep 2023 17:56:39 +0000 (18:56 +0100)]
Run a yearly reindex of the larger database tables

The reindex starts at 0200 on the second Friday in January to
avoid the monthly reindex that runs on the first Sunday of the
month and sit between two weekly backups.

13 months agoSimplify fdirsync and avoid race closing the descriptor
Tom Hughes [Thu, 28 Sep 2023 17:28:27 +0000 (18:28 +0100)]
Simplify fdirsync and avoid race closing the descriptor

13 months agoFix extra whitespace in planetdump
Grant Slater [Thu, 28 Sep 2023 15:16:33 +0000 (16:16 +0100)]
Fix extra whitespace in planetdump

13 months agoMerge remote-tracking branch 'github/pull/626'
Tom Hughes [Thu, 28 Sep 2023 14:50:52 +0000 (15:50 +0100)]
Merge remote-tracking branch 'github/pull/626'

13 months agoDo not report progress on scripted s3 uploads
Grant Slater [Thu, 28 Sep 2023 14:43:15 +0000 (15:43 +0100)]
Do not report progress on scripted s3 uploads

13 months agoTune s3 upload speed and concurrency
Grant Slater [Thu, 28 Sep 2023 14:42:36 +0000 (15:42 +0100)]
Tune s3 upload speed and concurrency

13 months agoplanet: add tile_logs S3 redirect
Grant Slater [Thu, 28 Sep 2023 12:42:06 +0000 (13:42 +0100)]
planet: add tile_logs S3 redirect

Fixes: https://github.com/openstreetmap/operations/issues/965
13 months agoCorrect interface name for bowser
Tom Hughes [Thu, 28 Sep 2023 07:28:09 +0000 (08:28 +0100)]
Correct interface name for bowser

13 months agoSwitch balerion to use postgresql 16
Tom Hughes [Thu, 28 Sep 2023 07:27:29 +0000 (08:27 +0100)]
Switch balerion to use postgresql 16

13 months agoSwitch balerion to use postgresql 16
Tom Hughes [Tue, 26 Sep 2023 15:52:45 +0000 (16:52 +0100)]
Switch balerion to use postgresql 16

13 months agoCivi+extension version bump
Guillaume RISCHARD [Tue, 26 Sep 2023 05:43:11 +0000 (01:43 -0400)]
Civi+extension version bump

13 months agoplanet: remove cleanup code
Grant Slater [Tue, 26 Sep 2023 01:03:53 +0000 (02:03 +0100)]
planet: remove cleanup code

13 months agoplanet: fix minor typo
Grant Slater [Tue, 26 Sep 2023 00:58:58 +0000 (01:58 +0100)]
planet: fix minor typo

13 months agoplanet: fix redirect for full-history osm files
Grant Slater [Tue, 26 Sep 2023 00:57:17 +0000 (01:57 +0100)]
planet: fix redirect for full-history osm files

13 months agoplanet: remove old legacy mirror redirect updater
Grant Slater [Tue, 26 Sep 2023 00:48:00 +0000 (01:48 +0100)]
planet: remove old legacy mirror redirect updater

13 months agoplanet: Remove download speed limit
Grant Slater [Tue, 26 Sep 2023 00:27:02 +0000 (01:27 +0100)]
planet: Remove download speed limit

13 months agoAdd redirects to planet S3
Grant Slater [Mon, 25 Sep 2023 17:16:28 +0000 (18:16 +0100)]
Add redirects to planet S3

13 months agoPort apache-latest-planet-filename to python
Grant Slater [Mon, 25 Sep 2023 17:14:50 +0000 (18:14 +0100)]
Port apache-latest-planet-filename to python

14 months agoMerge remote-tracking branch 'github/pull/623'
Tom Hughes [Sun, 24 Sep 2023 22:49:59 +0000 (23:49 +0100)]
Merge remote-tracking branch 'github/pull/623'

14 months agoAdd geoipupdate depends on planet
Grant Slater [Sun, 24 Sep 2023 22:35:51 +0000 (23:35 +0100)]
Add geoipupdate depends on planet

14 months agoAdd a comment indicating where imagery blacklist requests come from
Paul Norman [Sun, 24 Sep 2023 21:27:51 +0000 (14:27 -0700)]
Add a comment indicating where imagery blacklist requests come from

14 months agoCopy planet dumps to S3
Tom Hughes [Sun, 24 Sep 2023 18:27:20 +0000 (19:27 +0100)]
Copy planet dumps to S3

14 months agoCopy tile logs to S3
Tom Hughes [Sun, 24 Sep 2023 17:57:53 +0000 (18:57 +0100)]
Copy tile logs to S3

14 months agoCopy hourly and daily replication diffs to S3
Tom Hughes [Sun, 24 Sep 2023 15:06:23 +0000 (16:06 +0100)]
Copy hourly and daily replication diffs to S3

14 months agoMake paths explicit
Tom Hughes [Sun, 24 Sep 2023 14:45:18 +0000 (15:45 +0100)]
Make paths explicit

14 months agoCopy minutely replication diffs to S3
Tom Hughes [Sun, 24 Sep 2023 14:35:00 +0000 (15:35 +0100)]
Copy minutely replication diffs to S3

14 months agoFix access to AWS credentials for planet services
Tom Hughes [Sun, 24 Sep 2023 09:55:38 +0000 (10:55 +0100)]
Fix access to AWS credentials for planet services

14 months agoAdd support for BindPaths and BindReadOnlyPaths to systemd_service
Tom Hughes [Sun, 24 Sep 2023 09:54:53 +0000 (10:54 +0100)]
Add support for BindPaths and BindReadOnlyPaths to systemd_service

14 months agoCopy changeset replication diffs to S3
Tom Hughes [Sun, 24 Sep 2023 09:41:09 +0000 (10:41 +0100)]
Copy changeset replication diffs to S3

14 months agoEnable some addition postgres collectors
Tom Hughes [Sun, 24 Sep 2023 09:11:11 +0000 (10:11 +0100)]
Enable some addition postgres collectors

14 months agoReplace custom query with process_idle collector
Tom Hughes [Sun, 24 Sep 2023 09:03:06 +0000 (10:03 +0100)]
Replace custom query with process_idle collector

14 months agoGive notes dump access to AWS credentials
Tom Hughes [Sun, 24 Sep 2023 08:59:14 +0000 (09:59 +0100)]
Give notes dump access to AWS credentials

14 months agoAdd DHCP and DNS for new machines
Tom Hughes [Sat, 23 Sep 2023 23:42:29 +0000 (00:42 +0100)]
Add DHCP and DNS for new machines

14 months agoAdd roles for fume and grisu
Tom Hughes [Sat, 23 Sep 2023 23:24:33 +0000 (00:24 +0100)]
Add roles for fume and grisu

14 months agoMerge remote-tracking branch 'github/pull/621'
Tom Hughes [Sat, 23 Sep 2023 23:06:04 +0000 (00:06 +0100)]
Merge remote-tracking branch 'github/pull/621'

14 months agodhcpd: use correct netboot.xyz PXE filename.
Grant Slater [Sat, 23 Sep 2023 22:55:55 +0000 (23:55 +0100)]
dhcpd: use correct netboot.xyz PXE filename.

14 months agoMerge remote-tracking branch 'github/pull/622'
Tom Hughes [Sat, 23 Sep 2023 16:50:38 +0000 (17:50 +0100)]
Merge remote-tracking branch 'github/pull/622'

14 months agoAdd planet::aws recipe to configure awscli for planet uploads
Tom Hughes [Sat, 23 Sep 2023 15:57:09 +0000 (16:57 +0100)]
Add planet::aws recipe to configure awscli for planet uploads

14 months agoMake sure the planet user is created by recipes which use it
Tom Hughes [Sat, 23 Sep 2023 11:52:44 +0000 (12:52 +0100)]
Make sure the planet user is created by recipes which use it

14 months agoFix recipe ordering
Tom Hughes [Sat, 23 Sep 2023 11:50:09 +0000 (12:50 +0100)]
Fix recipe ordering

14 months agoCopy notes dumps to S3
Tom Hughes [Sat, 23 Sep 2023 11:19:18 +0000 (12:19 +0100)]
Copy notes dumps to S3

14 months agoRun tile log analysis as the planet user
Tom Hughes [Sat, 23 Sep 2023 11:10:37 +0000 (12:10 +0100)]
Run tile log analysis as the planet user

14 months agoUse the planet user consistently for generating planet data
Tom Hughes [Sat, 23 Sep 2023 11:05:21 +0000 (12:05 +0100)]
Use the planet user consistently for generating planet data

14 months agoConfigure Tracestrack API key for the web site
Tom Hughes [Fri, 22 Sep 2023 16:52:57 +0000 (17:52 +0100)]
Configure Tracestrack API key for the web site

14 months agoRemove tile role from pyrene
Tom Hughes [Fri, 22 Sep 2023 08:43:41 +0000 (09:43 +0100)]
Remove tile role from pyrene

14 months agonominatim: tweak pool size on vhagar
Sarah Hoffmann [Thu, 21 Sep 2023 09:04:47 +0000 (11:04 +0200)]
nominatim: tweak pool size on vhagar

14 months agoAdd awscli to planet cookbooks
Grant Slater [Wed, 20 Sep 2023 16:57:57 +0000 (17:57 +0100)]
Add awscli to planet cookbooks

14 months agoFix paths
Tom Hughes [Wed, 20 Sep 2023 07:36:55 +0000 (08:36 +0100)]
Fix paths

14 months agoRemove the ability to specify a custom directory for mediawiki
Tom Hughes [Wed, 20 Sep 2023 07:32:55 +0000 (08:32 +0100)]
Remove the ability to specify a custom directory for mediawiki

It doesn't actually work because the timer jobs assums they can
infer the directory from the site name.

14 months agonominatim: switch longma to postgres 16
Sarah Hoffmann [Mon, 18 Sep 2023 18:36:18 +0000 (20:36 +0200)]
nominatim: switch longma to postgres 16