]> git.openstreetmap.org Git - chef.git/log
chef.git
7 months agoMerge remote-tracking branch 'github/pull/655'
Tom Hughes [Thu, 4 Apr 2024 17:03:42 +0000 (18:03 +0100)]
Merge remote-tracking branch 'github/pull/655'

7 months agootrs: upgrade to latest znuny 6.0.x release
Grant Slater [Wed, 3 Apr 2024 21:27:38 +0000 (22:27 +0100)]
otrs: upgrade to latest znuny 6.0.x release

znuny only supports upgrading one minor version at a time.
Future upgrades will be 6.0.x -> 6.1.x -> 6.2.x etc

Signed-off-by: Grant Slater <github@firefishy.com>
7 months agoimagery: retry proxy errors
Grant Slater [Wed, 3 Apr 2024 16:08:49 +0000 (17:08 +0100)]
imagery: retry proxy errors

7 months agoimagery: fix url typo
Grant Slater [Wed, 3 Apr 2024 15:45:07 +0000 (16:45 +0100)]
imagery: fix url typo

7 months agoimagery: switch to file:// based mosaic for ZA
Grant Slater [Wed, 3 Apr 2024 15:44:05 +0000 (16:44 +0100)]
imagery: switch to file:// based mosaic for ZA

7 months agoimagery: increase nginx keepalive again
Grant Slater [Tue, 2 Apr 2024 16:57:35 +0000 (17:57 +0100)]
imagery: increase nginx keepalive again

7 months agoimagery: switch to volume mount for imagery
Grant Slater [Tue, 2 Apr 2024 16:55:41 +0000 (17:55 +0100)]
imagery: switch to volume mount for imagery

7 months agopodman: add volume support
Grant Slater [Tue, 2 Apr 2024 16:54:01 +0000 (17:54 +0100)]
podman: add volume support

7 months agoimagery: use gz mosaic directly
Grant Slater [Tue, 2 Apr 2024 13:36:20 +0000 (14:36 +0100)]
imagery: use gz mosaic directly

7 months agoimager: tune timeout and lower titiler workers
Grant Slater [Tue, 2 Apr 2024 13:31:52 +0000 (14:31 +0100)]
imager: tune timeout and lower titiler workers

7 months agoimagery: attempt to make tile serving more resilient to errors
Grant Slater [Tue, 2 Apr 2024 13:12:20 +0000 (14:12 +0100)]
imagery: attempt to make tile serving more resilient to errors

7 months agoRevert "nominatim: improve IP query block expression"
Sarah Hoffmann [Tue, 2 Apr 2024 09:59:43 +0000 (11:59 +0200)]
Revert "nominatim: improve IP query block expression"

This reverts commit 6beb17e095d006393405d9882fb762837df78588.

7 months agonominatim: improve IP query block expression
Sarah Hoffmann [Tue, 2 Apr 2024 09:52:04 +0000 (11:52 +0200)]
nominatim: improve IP query block expression

7 months agonominatim: update taginfo description
Sarah Hoffmann [Mon, 1 Apr 2024 13:10:52 +0000 (15:10 +0200)]
nominatim: update taginfo description

7 months agoDon't look for md arrays if the driver isn't loaded
Tom Hughes [Fri, 29 Mar 2024 00:05:16 +0000 (00:05 +0000)]
Don't look for md arrays if the driver isn't loaded

7 months agoremove ftp role from angor
Grant Slater [Thu, 28 Mar 2024 22:11:20 +0000 (22:11 +0000)]
remove ftp role from angor

7 months agoremove draco
Grant Slater [Thu, 28 Mar 2024 12:27:24 +0000 (12:27 +0000)]
remove draco

7 months agoimagery: increase http2 max concurrent streams
Grant Slater [Wed, 27 Mar 2024 19:34:25 +0000 (19:34 +0000)]
imagery: increase http2 max concurrent streams

7 months agoimagery: fix regex to only match os_sv png formats
Grant Slater [Wed, 27 Mar 2024 17:58:19 +0000 (17:58 +0000)]
imagery: fix regex to only match os_sv png formats

7 months agoRevert "imagery: workaround OS imagery custom formats"
Grant Slater [Wed, 27 Mar 2024 17:50:10 +0000 (17:50 +0000)]
Revert "imagery: workaround OS imagery custom formats"

This reverts commit b0bf79fd8052f90360efd8e093c83cc03c38696a.

7 months agoimagery: workaround OS imagery custom formats
Grant Slater [Wed, 27 Mar 2024 17:44:39 +0000 (17:44 +0000)]
imagery: workaround OS imagery custom formats

7 months agoDrop role for draco
Tom Hughes [Wed, 27 Mar 2024 17:38:18 +0000 (17:38 +0000)]
Drop role for draco

7 months agoimagery: escape layer name in js
Grant Slater [Wed, 27 Mar 2024 17:25:09 +0000 (17:25 +0000)]
imagery: escape layer name in js

7 months agoimagery: enable nginx cache correctly
Grant Slater [Wed, 27 Mar 2024 17:13:06 +0000 (17:13 +0000)]
imagery: enable nginx cache correctly

7 months agoimager: fix string quote
Grant Slater [Wed, 27 Mar 2024 17:06:21 +0000 (17:06 +0000)]
imager: fix string quote

7 months agoimagery: add za_ngi_aerial using tiler
Grant Slater [Wed, 27 Mar 2024 16:17:30 +0000 (16:17 +0000)]
imagery: add za_ngi_aerial using tiler

7 months agonominatim: remove referer block on details again
Sarah Hoffmann [Wed, 27 Mar 2024 13:13:25 +0000 (14:13 +0100)]
nominatim: remove referer block on details again

7 months agonominatim: refuse to geocode IP addresses
Sarah Hoffmann [Wed, 27 Mar 2024 10:32:23 +0000 (11:32 +0100)]
nominatim: refuse to geocode IP addresses

7 months agoaccount: update ligfietser ssh key
Grant Slater [Wed, 27 Mar 2024 12:47:01 +0000 (12:47 +0000)]
account: update ligfietser ssh key

Close: https://github.com/openstreetmap/operations/issues/1044

Signed-off-by: Grant Slater <github@firefishy.com>
8 months agoimagery: improve tiler caching and keepalive
Grant Slater [Tue, 26 Mar 2024 20:56:17 +0000 (20:56 +0000)]
imagery: improve tiler caching and keepalive

8 months agopodman: revert to using default slirp4netns mtu
Grant Slater [Tue, 26 Mar 2024 20:48:04 +0000 (20:48 +0000)]
podman: revert to using default slirp4netns mtu

8 months agotests: move imagery-tiler to only test on debian
Grant Slater [Tue, 26 Mar 2024 20:40:11 +0000 (20:40 +0000)]
tests: move imagery-tiler to only test on debian

podman on ubuntu 22.04 unresolved race condition start up bugs.
The version in debian 12 is reliable. In production the container starts
up successfully after a few tries, but this behaviour breaks tests.

Signed-off-by: Grant Slater <github@firefishy.com>
8 months agodev: sort users list
Grant Slater [Tue, 26 Mar 2024 20:24:24 +0000 (20:24 +0000)]
dev: sort users list

8 months agodev: activate ligfietser
Grant Slater [Tue, 26 Mar 2024 20:22:17 +0000 (20:22 +0000)]
dev: activate ligfietser

8 months agonominatim: disallow details requests without referer
Sarah Hoffmann [Tue, 26 Mar 2024 19:47:44 +0000 (20:47 +0100)]
nominatim: disallow details requests without referer

8 months agoInstall libbrotli-dev on the dev server
Tom Hughes [Mon, 25 Mar 2024 21:47:40 +0000 (21:47 +0000)]
Install libbrotli-dev on the dev server

8 months agoUpdate bundle
Tom Hughes [Wed, 20 Mar 2024 18:36:20 +0000 (18:36 +0000)]
Update bundle

8 months agoTry and detaint messages.openstreetmap.org deliveries
Tom Hughes [Wed, 20 Mar 2024 17:43:10 +0000 (17:43 +0000)]
Try and detaint messages.openstreetmap.org deliveries

8 months agoValidate local parts for messages.openstreetmap.org to untaint them
Tom Hughes [Wed, 20 Mar 2024 12:45:49 +0000 (12:45 +0000)]
Validate local parts for messages.openstreetmap.org to untaint them

8 months agonetworking: ensure nftables script checks input
Grant Slater [Wed, 20 Mar 2024 10:32:54 +0000 (10:32 +0000)]
networking: ensure nftables script checks input

Ensure the nftables script does not prematurely exit on any invalid input.
eg: If unblocking a set of IPs skip any not currently blocked instead of premature exit.

Signed-off-by: Grant Slater <github@firefishy.com>
8 months agoapache: increase mod_evasive page_count to reduce iD false positives
Grant Slater [Tue, 19 Mar 2024 23:41:02 +0000 (23:41 +0000)]
apache: increase mod_evasive page_count to reduce iD false positives

8 months agoFix fail2ban evasive filter
Tom Hughes [Tue, 19 Mar 2024 21:20:03 +0000 (21:20 +0000)]
Fix fail2ban evasive filter

8 months agonetworking: add flush command to nftables script
Grant Slater [Tue, 19 Mar 2024 11:15:05 +0000 (11:15 +0000)]
networking: add flush command to nftables script

8 months agopodman: fix typo in param
Grant Slater [Mon, 18 Mar 2024 17:50:31 +0000 (17:50 +0000)]
podman: fix typo in param

8 months agopodman: increase default pid limit.
Grant Slater [Mon, 18 Mar 2024 17:33:01 +0000 (17:33 +0000)]
podman: increase default pid limit.

Workaround 2048 pid limit. Extremely low, causing issues with titiler.
Ideally should be set using a paramater.

Signed-off-by: Grant Slater <github@firefishy.com>
8 months agoAdd alert for node exporter text file scrape errors
Tom Hughes [Mon, 18 Mar 2024 17:28:05 +0000 (17:28 +0000)]
Add alert for node exporter text file scrape errors

8 months agoimagery: use https for tiler
Grant Slater [Mon, 18 Mar 2024 14:49:38 +0000 (14:49 +0000)]
imagery: use https for tiler

8 months agoimagery: add ngi-aerial code
Grant Slater [Mon, 18 Mar 2024 14:08:27 +0000 (14:08 +0000)]
imagery: add ngi-aerial code

8 months agoRevet accidental commit
Tom Hughes [Fri, 15 Mar 2024 15:56:57 +0000 (15:56 +0000)]
Revet accidental commit

8 months agocommunity: security bump version
Grant Slater [Fri, 15 Mar 2024 12:18:39 +0000 (12:18 +0000)]
community: security bump version

8 months agoDisable exim paniclog watcher
Tom Hughes [Fri, 15 Mar 2024 10:02:27 +0000 (10:02 +0000)]
Disable exim paniclog watcher

8 months agoFix exim daemon options for Ubuntu
Tom Hughes [Fri, 15 Mar 2024 10:01:26 +0000 (10:01 +0000)]
Fix exim daemon options for Ubuntu

8 months agoDrop attempt at SPF checking
Tom Hughes [Thu, 14 Mar 2024 11:19:04 +0000 (11:19 +0000)]
Drop attempt at SPF checking

8 months agoAccept any mail that passes an osmfoundation.org SPF check
Tom Hughes [Thu, 14 Mar 2024 10:52:05 +0000 (10:52 +0000)]
Accept any mail that passes an osmfoundation.org SPF check

8 months agoReject incoming mail which fails SPF checks
Tom Hughes [Thu, 14 Mar 2024 09:42:26 +0000 (09:42 +0000)]
Reject incoming mail which fails SPF checks

8 months agoAdd munin web redirects to prometheus
Grant Slater [Wed, 13 Mar 2024 14:48:11 +0000 (14:48 +0000)]
Add munin web redirects to prometheus

8 months agoScrub last munin traces
Grant Slater [Wed, 13 Mar 2024 14:39:59 +0000 (14:39 +0000)]
Scrub last munin traces

Signed-off-by: Grant Slater <github@firefishy.com>
8 months agoRemove munin-server GHA test
Grant Slater [Wed, 13 Mar 2024 14:31:29 +0000 (14:31 +0000)]
Remove munin-server GHA test

8 months agoRemove munin server role
Grant Slater [Wed, 13 Mar 2024 14:29:13 +0000 (14:29 +0000)]
Remove munin server role

8 months agoRemove munin
Grant Slater [Tue, 12 Mar 2024 20:45:46 +0000 (20:45 +0000)]
Remove munin

Fixed: https://github.com/openstreetmap/operations/issues/501
Signed-off-by: Grant Slater <github@firefishy.com>
8 months agohardware: do not fail if node[:hardware][:pci] is undefined (tests)
Grant Slater [Tue, 12 Mar 2024 21:15:16 +0000 (21:15 +0000)]
hardware: do not fail if node[:hardware][:pci] is undefined (tests)

8 months agogit: use extended combined_extended
Grant Slater [Tue, 12 Mar 2024 14:05:05 +0000 (14:05 +0000)]
git: use extended combined_extended

8 months agoRestore comment
Tom Hughes [Tue, 12 Mar 2024 13:19:13 +0000 (13:19 +0000)]
Restore comment

8 months agoapache: remove unneeded combined_extended hack for 20.04
Grant Slater [Tue, 12 Mar 2024 13:14:03 +0000 (13:14 +0000)]
apache: remove unneeded combined_extended hack for 20.04

8 months agoTidy up mod_evasive configuration
Tom Hughes [Tue, 12 Mar 2024 12:57:46 +0000 (12:57 +0000)]
Tidy up mod_evasive configuration

8 months agowordpress: use combined_extended logging
Grant Slater [Tue, 12 Mar 2024 12:56:59 +0000 (12:56 +0000)]
wordpress: use combined_extended logging

8 months agomediawiki: add back missing param
Grant Slater [Tue, 12 Mar 2024 12:42:06 +0000 (12:42 +0000)]
mediawiki: add back missing param

8 months agomediawiki: disable Extension:LocalisationUpdate
Grant Slater [Tue, 12 Mar 2024 12:39:55 +0000 (12:39 +0000)]
mediawiki: disable Extension:LocalisationUpdate

8 months agomediawiki: add RewriteCond for server-info
Grant Slater [Tue, 12 Mar 2024 12:36:38 +0000 (12:36 +0000)]
mediawiki: add RewriteCond for server-info

8 months agoapache: set our correct defaults for mod_evasive
Grant Slater [Tue, 12 Mar 2024 12:31:14 +0000 (12:31 +0000)]
apache: set our correct defaults for mod_evasive

8 months agoapache: relax mod_evasive further
Grant Slater [Tue, 12 Mar 2024 12:17:31 +0000 (12:17 +0000)]
apache: relax mod_evasive further

8 months agoapache: parameterise mod_evasive
Grant Slater [Tue, 12 Mar 2024 12:08:59 +0000 (12:08 +0000)]
apache: parameterise mod_evasive

8 months agonominatim: migrate versions before installing the software
Sarah Hoffmann [Tue, 12 Mar 2024 11:02:09 +0000 (12:02 +0100)]
nominatim: migrate versions before installing the software

Avoids disruptions where the migration is needed for the frontend
to function properly (e.g. when creating new indexes).

8 months agooverpass: remove last traces of timer for area processor
Sarah Hoffmann [Tue, 12 Mar 2024 11:01:24 +0000 (12:01 +0100)]
overpass: remove last traces of timer for area processor

8 months agoAdjust trigger for evasive jail
Tom Hughes [Tue, 12 Mar 2024 09:00:20 +0000 (09:00 +0000)]
Adjust trigger for evasive jail

8 months agoRestrict fail2ban to evasive blocks instead of all 403 errors
Tom Hughes [Tue, 12 Mar 2024 08:52:58 +0000 (08:52 +0000)]
Restrict fail2ban to evasive blocks instead of all 403 errors

8 months agoRelax evasive limits some more
Tom Hughes [Mon, 11 Mar 2024 21:27:37 +0000 (21:27 +0000)]
Relax evasive limits some more

8 months agoMake evasive configuration work
Tom Hughes [Mon, 11 Mar 2024 20:13:00 +0000 (20:13 +0000)]
Make evasive configuration work

8 months agoPass bantime and findtime to jail config correctly
Tom Hughes [Mon, 11 Mar 2024 19:18:32 +0000 (19:18 +0000)]
Pass bantime and findtime to jail config correctly

8 months agoReduce look back for forbidden request jail
Tom Hughes [Mon, 11 Mar 2024 19:12:03 +0000 (19:12 +0000)]
Reduce look back for forbidden request jail

8 months agoRelax site count limit for evasive
Tom Hughes [Mon, 11 Mar 2024 18:20:56 +0000 (18:20 +0000)]
Relax site count limit for evasive

8 months agoRelax page count limit for evasive
Tom Hughes [Mon, 11 Mar 2024 17:48:37 +0000 (17:48 +0000)]
Relax page count limit for evasive

8 months agoActively disable mod_evasive when necessary
Tom Hughes [Mon, 11 Mar 2024 17:41:32 +0000 (17:41 +0000)]
Actively disable mod_evasive when necessary

8 months agoDisable mod_evasive for prometheus
Tom Hughes [Mon, 11 Mar 2024 17:39:18 +0000 (17:39 +0000)]
Disable mod_evasive for prometheus

8 months agoUse fail2ban to block IPs getting repeated HTTP forbidden responses
Tom Hughes [Mon, 11 Mar 2024 17:30:03 +0000 (17:30 +0000)]
Use fail2ban to block IPs getting repeated HTTP forbidden responses

8 months agoEnable mod_evasive for all apache instances except render servers
Tom Hughes [Mon, 11 Mar 2024 17:15:10 +0000 (17:15 +0000)]
Enable mod_evasive for all apache instances except render servers

8 months agoDrop unused attribute
Tom Hughes [Mon, 11 Mar 2024 17:18:16 +0000 (17:18 +0000)]
Drop unused attribute

8 months agoAdd an alert for mysql connection errors
Tom Hughes [Mon, 11 Mar 2024 08:40:10 +0000 (08:40 +0000)]
Add an alert for mysql connection errors

8 months agoIncrease mysql connection limit for the wiki
Tom Hughes [Mon, 11 Mar 2024 08:27:44 +0000 (08:27 +0000)]
Increase mysql connection limit for the wiki

8 months agoRemove ifupdown to stop it trying to manage the network
Tom Hughes [Sun, 10 Mar 2024 21:06:38 +0000 (21:06 +0000)]
Remove ifupdown to stop it trying to manage the network

8 months agomailman: automate year match code
Grant Slater [Sun, 10 Mar 2024 20:20:20 +0000 (20:20 +0000)]
mailman: automate year match code

8 months agoapache: fix combined_extended compatibility with Ubuntu 20.04
Grant Slater [Sun, 10 Mar 2024 20:15:25 +0000 (20:15 +0000)]
apache: fix combined_extended compatibility with Ubuntu 20.04

8 months agoapache: use new combined_extended log format instead of combined
Grant Slater [Sun, 10 Mar 2024 19:49:49 +0000 (19:49 +0000)]
apache: use new combined_extended log format instead of combined

8 months agoRemove gorwen DNS and DHCP
Grant Slater [Sun, 10 Mar 2024 19:45:12 +0000 (19:45 +0000)]
Remove gorwen DNS and DHCP

8 months agowiki: Delay abusive scrapers
Grant Slater [Sun, 10 Mar 2024 15:37:16 +0000 (15:37 +0000)]
wiki: Delay abusive scrapers

8 months agoIncrease size of php-fpm pool for the main wiki
Tom Hughes [Sun, 10 Mar 2024 13:46:40 +0000 (13:46 +0000)]
Increase size of php-fpm pool for the main wiki

8 months agoDrop separate secure logs for mediawiki instances
Tom Hughes [Sun, 10 Mar 2024 13:44:45 +0000 (13:44 +0000)]
Drop separate secure logs for mediawiki instances

8 months agoDefine an extended log format for apachae requests
Tom Hughes [Sun, 10 Mar 2024 13:42:46 +0000 (13:42 +0000)]
Define an extended log format for apachae requests

Adds the request time and SSL details to the standard combined format.

8 months agomediawiki: add apache request duration logging
Grant Slater [Sun, 10 Mar 2024 13:07:01 +0000 (13:07 +0000)]
mediawiki: add apache request duration logging

8 months agowiki: remove outdated file
Grant Slater [Sun, 10 Mar 2024 13:06:25 +0000 (13:06 +0000)]
wiki: remove outdated file