]>
git.openstreetmap.org Git - nominatim.git/log
Sarah Hoffmann [Thu, 24 Nov 2022 09:43:29 +0000 (10:43 +0100)]
prepare release 4.2.0
Sarah Hoffmann [Thu, 24 Nov 2022 09:17:30 +0000 (10:17 +0100)]
add checklist for releases
Sarah Hoffmann [Thu, 24 Nov 2022 09:13:38 +0000 (10:13 +0100)]
Merge pull request #2903 from lonvia/migration-for-index-reorganization
Add migration for reorganization of pending indexes
Sarah Hoffmann [Wed, 23 Nov 2022 09:55:39 +0000 (10:55 +0100)]
add migration for reorganization of pending indexes
Fixes #2900.
Sarah Hoffmann [Wed, 23 Nov 2022 16:58:42 +0000 (17:58 +0100)]
Merge pull request #2902 from lonvia/tiger-county-sanitizer
Tiger county sanitizer
Sarah Hoffmann [Tue, 22 Nov 2022 16:17:38 +0000 (17:17 +0100)]
remove BDD test for tiger:county
We no longer rely on the import to strip the tag.
Sarah Hoffmann [Tue, 22 Nov 2022 16:10:21 +0000 (17:10 +0100)]
add sanitizer for TIGER tags
Currently only takes over cleaning the tiger:county data. This was
done by the import until now.
Sarah Hoffmann [Mon, 21 Nov 2022 15:57:45 +0000 (16:57 +0100)]
Merge pull request #2892 from lonvia/optional-forward-dependecies
Add experimental configuration switch for enabling forward dependencies
Sarah Hoffmann [Fri, 4 Nov 2022 16:48:05 +0000 (17:48 +0100)]
add experimental option for enabling forward dependencies
Sarah Hoffmann [Sun, 20 Nov 2022 21:11:35 +0000 (22:11 +0100)]
Merge pull request #2890 from lonvia/use-rank-search-for-reverse-polygon-match
Use rank search for reverse polygon match
Sarah Hoffmann [Sun, 20 Nov 2022 19:22:44 +0000 (20:22 +0100)]
force use of geometry index for reverse polygon lookup
Sarah Hoffmann [Sun, 20 Nov 2022 18:28:56 +0000 (19:28 +0100)]
use rank_search for reverse polygon match
Sarah Hoffmann [Sat, 19 Nov 2022 20:53:14 +0000 (21:53 +0100)]
fix condition under which place_to_be_deleted is created
It is needed for updates, independently if reverse-only is set.
Sarah Hoffmann [Fri, 18 Nov 2022 17:51:11 +0000 (18:51 +0100)]
Merge pull request #2889 from lonvia/fix-interpolation-updates
Drop illegal values for addr:interpolation on update
Sarah Hoffmann [Fri, 18 Nov 2022 16:26:56 +0000 (17:26 +0100)]
drop illegal values for addr:interpolation on update
Sarah Hoffmann [Thu, 17 Nov 2022 12:35:53 +0000 (13:35 +0100)]
Merge pull request #2887 from lonvia/lookup-linked-places
Add support for lookup of linked places
Sarah Hoffmann [Thu, 17 Nov 2022 06:29:25 +0000 (07:29 +0100)]
Merge pull request #2886 from lonvia/closest-street-in-associated
Handle associatedStreet relations with multiple streets correctly
Sarah Hoffmann [Wed, 16 Nov 2022 20:11:56 +0000 (21:11 +0100)]
add support for lookup of linked places
Sarah Hoffmann [Wed, 16 Nov 2022 16:25:51 +0000 (17:25 +0100)]
handle associatedStreet relations with multiple streets
When a associatedStreet relation has multiple street members
always take the closest one. Avoid geometry operations for
the frequent case that there is only one street.
Sarah Hoffmann [Tue, 15 Nov 2022 18:29:55 +0000 (19:29 +0100)]
Merge pull request #2884 from lonvia/tweak-special-term-penalties
Correctly handle special term + name combination
Sarah Hoffmann [Tue, 15 Nov 2022 18:29:39 +0000 (19:29 +0100)]
Merge pull request #2885 from lonvia/remove-unused-countries
Remove dependent territories from country list
Sarah Hoffmann [Tue, 15 Nov 2022 10:55:40 +0000 (11:55 +0100)]
correctly handle special term + name combination
Special terms with operator name usually appear in combination with the
name. The current penalties only took name + special term into account
not special term + name.
Fixes #2876.
Sarah Hoffmann [Tue, 15 Nov 2022 10:37:30 +0000 (11:37 +0100)]
remove dependent territories from country list
Removes territories of US, France, Australia and Netherlands from the
country list. These territories have their own country code (which is
why they are in the list in the first place) but are mapped as part of
the admin_level 2 relations for the respective parent countries.
Therefore they never had any places attached. In practical terms, the
change only affects the number of tables created.
Sarah Hoffmann [Tue, 15 Nov 2022 08:39:46 +0000 (09:39 +0100)]
Merge pull request #2881 from lonvia/more-update-tests-for-osm2pgsql
Experimental support for osm2pgsql flex output
Sarah Hoffmann [Mon, 14 Nov 2022 16:27:04 +0000 (17:27 +0100)]
bdd: add tests for osm2pgsql update of postcode nodes
Sarah Hoffmann [Mon, 14 Nov 2022 15:57:31 +0000 (16:57 +0100)]
bdd: add osm2pgsql tests for updating interpolations
Sarah Hoffmann [Mon, 14 Nov 2022 13:48:44 +0000 (14:48 +0100)]
bdd: test placex content when updating with osm2pgsql
Sarah Hoffmann [Mon, 14 Nov 2022 12:57:26 +0000 (13:57 +0100)]
reorganize handling of place type changes
Always replace existing entries in place, never delete them because
a direct delete will cause conflicts.
Sarah Hoffmann [Thu, 10 Nov 2022 14:52:13 +0000 (15:52 +0100)]
fix country handling in flex style
If the country tag does not match a 2-letter code, it needs to
be dropped.
Sarah Hoffmann [Thu, 10 Nov 2022 14:51:55 +0000 (15:51 +0100)]
remove tests that differ between lua and gazetteer versions
Sarah Hoffmann [Thu, 10 Nov 2022 10:11:45 +0000 (11:11 +0100)]
node locations must be stable for osm2pgsql update tests
Sarah Hoffmann [Tue, 8 Nov 2022 13:06:18 +0000 (14:06 +0100)]
bdd: extend osm2pgsql update tests
Now also checks for correct indexing state of placex table.
Sarah Hoffmann [Tue, 8 Nov 2022 09:21:44 +0000 (10:21 +0100)]
optimise tag match function
Sarah Hoffmann [Fri, 4 Nov 2022 21:43:10 +0000 (22:43 +0100)]
add lua requirements for vagrant scripts
Sarah Hoffmann [Fri, 4 Nov 2022 15:03:04 +0000 (16:03 +0100)]
CI: require lua libraries
Sarah Hoffmann [Fri, 4 Nov 2022 14:20:43 +0000 (15:20 +0100)]
add migration for place_to_be_deleted table
Sarah Hoffmann [Fri, 4 Nov 2022 13:50:07 +0000 (14:50 +0100)]
change updates to handle delete/insert workflow
This makes Nominatim compatible with osm2pgsql's default update
modus operandi of deleting and reinserting data. Deletes are diverted
into a TODO table instead of executing them. When data is reinserted,
the corresponding entry in the TODO table is deleted. After updates are
finished, the remaining entries in the TODO table are executed, doing
the same work as the delete trigger did before.
The new behaviour also works against the gazetteer output with its
insert-only mechanism.
Sarah Hoffmann [Thu, 3 Nov 2022 16:15:01 +0000 (17:15 +0100)]
initial flex import scripts
Only implements the extratags style for the moment. Tests pass
for the same behaviour as the gazetteer output. Updates still need
to be done.
Sarah Hoffmann [Tue, 4 Oct 2022 15:01:25 +0000 (17:01 +0200)]
bdd tests: make import style configurable
The switch is for development. Tests are not guaranteed to still
work when run with anything but the 'extratags' style.
Sarah Hoffmann [Tue, 4 Oct 2022 13:02:19 +0000 (15:02 +0200)]
add osm2pgsql gazetteer tests
This ports the gazetteer tests from osm2pgsql to BDD tests.
Sarah Hoffmann [Wed, 9 Nov 2022 19:48:39 +0000 (20:48 +0100)]
Merge pull request #2869 from mtmail/improve-tiger-install-doc
Tiger install doc: add -refresh website- step
Sarah Hoffmann [Wed, 9 Nov 2022 19:45:56 +0000 (20:45 +0100)]
fix type issues with calls to pyosmium
Marc Tobias [Tue, 8 Nov 2022 13:40:43 +0000 (14:40 +0100)]
Tiger install doc: add -refresh website- step
Sarah Hoffmann [Wed, 9 Nov 2022 13:26:39 +0000 (14:26 +0100)]
Merge pull request #2871 from lonvia/fix-timeout-for-updates
Fix timeout for updates
Sarah Hoffmann [Tue, 8 Nov 2022 22:43:30 +0000 (23:43 +0100)]
add types-requests dependency
Sarah Hoffmann [Tue, 8 Nov 2022 21:24:19 +0000 (22:24 +0100)]
respect socket timeout also in other replication functions
Sarah Hoffmann [Tue, 8 Nov 2022 20:45:36 +0000 (21:45 +0100)]
fix timeout use for replication timeout
The timeout parameter is no longer taken into account since
pyosmium switched to the requests library. This adds the parameter
back.
Sarah Hoffmann [Tue, 8 Nov 2022 16:24:53 +0000 (17:24 +0100)]
Merge pull request #2870 from mtmail/update-github-actions-to-node-16
update those github action packages still using node12
Marc Tobias [Tue, 8 Nov 2022 14:16:55 +0000 (15:16 +0100)]
update those github action packages still using node12
Sarah Hoffmann [Mon, 7 Nov 2022 08:00:59 +0000 (09:00 +0100)]
Merge pull request #2866 from lonvia/reverse-ignore-interpolations-without-parent
Ignore interpolations without parent on reverse search
Sarah Hoffmann [Sat, 5 Nov 2022 13:33:28 +0000 (14:33 +0100)]
ignore interpolations without parent on reverse search
If no parent can be found for an interpolation, there is most
likely a data error involved. So don' t show these interpolations
in reverse search results.
Sarah Hoffmann [Sat, 5 Nov 2022 21:14:44 +0000 (22:14 +0100)]
Merge pull request #2865 from Romeo-PHILLIPS/fix/documentation_status_code
Fix: documentation status code
Romeo [Fri, 4 Nov 2022 17:05:40 +0000 (18:05 +0100)]
fix: format
Romeo [Fri, 4 Nov 2022 17:04:28 +0000 (18:04 +0100)]
fix: markup
Romeo [Fri, 4 Nov 2022 17:03:49 +0000 (18:03 +0100)]
fix: 705 Status Code Documentation
Romeo [Fri, 4 Nov 2022 16:59:36 +0000 (17:59 +0100)]
fix: 705 Status Code Documenation
Sarah Hoffmann [Fri, 4 Nov 2022 16:32:50 +0000 (17:32 +0100)]
Merge pull request #2862 from mtmail/remove-version-from-fpm-sock-file
Install scripts: remove version from /var/run/php-fpm filenames
Sarah Hoffmann [Fri, 4 Nov 2022 16:32:06 +0000 (17:32 +0100)]
Merge pull request #2863 from lonvia/add-support-for-postgresql-15
Update CI tests to postgresql 15
Sarah Hoffmann [Fri, 4 Nov 2022 14:23:06 +0000 (15:23 +0100)]
update CI tests to postgresql 15
marc tobias [Thu, 3 Nov 2022 22:29:58 +0000 (23:29 +0100)]
Install scripts: remove version from /var/run/php-fpm filenames
t-tomek [Wed, 2 Nov 2022 13:11:52 +0000 (14:11 +0100)]
Update DB.php
Use SET instead of UPDATE queries to support read only databases
Sarah Hoffmann [Mon, 24 Oct 2022 12:21:44 +0000 (14:21 +0200)]
actions: pin pyicu to 2.9
Sarah Hoffmann [Mon, 24 Oct 2022 09:21:55 +0000 (11:21 +0200)]
Merge pull request #2836 from mtmail/tiger2022
Documentation: remove year from TIGER filename, new 2022 data
Sarah Hoffmann [Wed, 5 Oct 2022 16:59:13 +0000 (18:59 +0200)]
Merge pull request #2838 from lonvia/update-osm2pgsql
Update osm2pgsql to latest 1.7.1 release
Sarah Hoffmann [Wed, 5 Oct 2022 13:16:14 +0000 (15:16 +0200)]
fix flaky API test
The search 'landstr' produces many duplicates so that with
some bad luck 4 or less results may appear. Disable deduplication
to make it more predictable.
Sarah Hoffmann [Tue, 4 Oct 2022 19:16:57 +0000 (21:16 +0200)]
update osm2pgsql to 1.7.1
Sarah Hoffmann [Tue, 4 Oct 2022 14:25:47 +0000 (16:25 +0200)]
Merge pull request #2835 from lonvia/secondary-importance
Secondary importance
marc tobias [Tue, 4 Oct 2022 12:19:36 +0000 (14:19 +0200)]
Documentation: remove year from TIGER filename
Sarah Hoffmann [Thu, 29 Sep 2022 12:55:46 +0000 (14:55 +0200)]
docs: add customization hints for secondary importance
Removing the download links for now as the tile importance
is still too experimental.
Sarah Hoffmann [Thu, 29 Sep 2022 08:01:49 +0000 (10:01 +0200)]
do not run unit test when postgis_raster is not available
Sarah Hoffmann [Wed, 28 Sep 2022 15:41:16 +0000 (17:41 +0200)]
adapt unit tests to changed function names
Sarah Hoffmann [Tue, 27 Sep 2022 21:13:29 +0000 (23:13 +0200)]
add secondary importance to API BDD tests
Also fixes a path issue during API test DB creation that could
never possibly have worked.
Sarah Hoffmann [Tue, 27 Sep 2022 20:12:48 +0000 (22:12 +0200)]
simplify use of secondary importance
The values in the raster are already normalized between 0 and 2**16,
so a simple conversion to [0, 1] will do.
Check for existance of secondary_importance table statically when
creating the SQL function. For that to work importance tables need
to be created before the functions.
Sarah Hoffmann [Tue, 27 Sep 2022 19:08:15 +0000 (21:08 +0200)]
load views as a SQL file and rename to 'secondary importance'
The only requirement for secondary importance is that a raster table
comes out of it. The generic name leaves open where the data comes
from.
Tareq Al-Ahdal [Thu, 25 Aug 2022 07:45:18 +0000 (09:45 +0200)]
Integrated OSM views into importance computation
Tareq Al-Ahdal [Sun, 24 Jul 2022 11:04:23 +0000 (19:04 +0800)]
Enhanced the implementation of OSM views GeoTIFF import functionality
Tareq Al-Ahdal [Wed, 6 Jul 2022 06:16:41 +0000 (08:16 +0200)]
Initial implementation of GeoTIFF import functionality
Sarah Hoffmann [Wed, 28 Sep 2022 13:17:40 +0000 (15:17 +0200)]
Merge pull request #2832 from lonvia/conditional-analyze-on-indexing
Only run analyze on indexing when work was done
Sarah Hoffmann [Wed, 28 Sep 2022 08:22:54 +0000 (10:22 +0200)]
only run analyze on indexing when work was done
This speeds up processing when continuing indexing after it was
interrupted.
Sarah Hoffmann [Mon, 26 Sep 2022 08:02:51 +0000 (10:02 +0200)]
Merge pull request #2829 from lonvia/optimize-indexes
Further optimize indexes
Sarah Hoffmann [Sun, 25 Sep 2022 12:09:45 +0000 (14:09 +0200)]
make sure indexes are used
Sarah Hoffmann [Wed, 21 Sep 2022 12:25:07 +0000 (14:25 +0200)]
further split up the big geometry index
Adds partial indexes for all geometry queries used during import.
A full index is not necessary anymore at that point. Still create
the index afterwards for use in queries.
Also adds documentation for all indexes on where they are used.
Sarah Hoffmann [Wed, 21 Sep 2022 08:38:58 +0000 (10:38 +0200)]
consolidate indexes over geometry_sectors
The index over geometry_sectors are mainly used for ordering
the places which need indexing. That means they function effectively
as a TODO list. Consolodate them so that they always only contain
the places which are still to do. Also add the appropriate index
for the boundary indexing phase.
Sarah Hoffmann [Tue, 20 Sep 2022 16:44:37 +0000 (18:44 +0200)]
split up large osmid index on placex
This doesn't do anything in terms of lookup speeds but the resulting
indexes are quite a bit smaller.
Sarah Hoffmann [Mon, 19 Sep 2022 13:39:58 +0000 (15:39 +0200)]
fix funding link
Sarah Hoffmann [Mon, 19 Sep 2022 13:38:56 +0000 (15:38 +0200)]
add Github Sponsering to funding page
Sarah Hoffmann [Wed, 14 Sep 2022 13:37:39 +0000 (15:37 +0200)]
run final index creation in parallel
Sarah Hoffmann [Mon, 19 Sep 2022 09:52:17 +0000 (11:52 +0200)]
add function for parallel execution of SQL scripts
Sarah Hoffmann [Mon, 19 Sep 2022 08:30:58 +0000 (10:30 +0200)]
add link to funding page
Sarah Hoffmann [Mon, 19 Sep 2022 08:18:43 +0000 (10:18 +0200)]
Merge pull request #2818 from lonvia/better-geometry-index
Add index for lookup of addressable areas
Sarah Hoffmann [Sun, 18 Sep 2022 14:50:18 +0000 (16:50 +0200)]
add indexes for lookup of addressable areas
The generic geometry index has become to slow for that purpose.
Sarah Hoffmann [Tue, 13 Sep 2022 06:58:31 +0000 (08:58 +0200)]
update security policy for 4.1 version
Sarah Hoffmann [Mon, 5 Sep 2022 15:38:48 +0000 (17:38 +0200)]
mypy: fix new warnings due to external type updates
Sarah Hoffmann [Mon, 5 Sep 2022 15:27:09 +0000 (17:27 +0200)]
Merge pull request #2812 from mausch/patch-1
docs: fix links to rank docs
Mauricio Scheffer [Mon, 5 Sep 2022 10:11:13 +0000 (11:11 +0100)]
docs: fix links to rank docs
Sarah Hoffmann [Sat, 13 Aug 2022 17:02:27 +0000 (19:02 +0200)]
Merge pull request #2799 from lonvia/fix-inclusions-with-extratags
Ignore irrelevant extra tags on address interpolations
Sarah Hoffmann [Sat, 13 Aug 2022 17:02:14 +0000 (19:02 +0200)]
Merge pull request #2739 from tareqpi/collect_os_info.sh
integration of host system information script into Nominatim CLI tool
Sarah Hoffmann [Sat, 13 Aug 2022 08:42:46 +0000 (10:42 +0200)]
ignore irrelevant extra tags on address interpolations
When deciding if an address interpolation has address information, only
look for addr:street and addr:place. If they are not there go looking
for the address on the address nodes. Ignores irrelevant tags like
addr:inclusion.
Fixes #2797.
Tareq Al-Ahdal [Fri, 12 Aug 2022 22:22:13 +0000 (06:22 +0800)]
Added the feature of collecting host system information to the CI tests
Tareq Al-Ahdal [Fri, 12 Aug 2022 22:18:10 +0000 (06:18 +0800)]
Integrated 'collect_os_info.py' into Nominatim's CLI tool