]> git.openstreetmap.org Git - nominatim.git/log
nominatim.git
2 years agofix timeout use for replication timeout
Sarah Hoffmann [Tue, 8 Nov 2022 20:45:36 +0000 (21:45 +0100)]
fix timeout use for replication timeout

The timeout parameter is no longer taken into account since
pyosmium switched to the requests library. This adds the parameter
back.

2 years agoMerge pull request #2870 from mtmail/update-github-actions-to-node-16
Sarah Hoffmann [Tue, 8 Nov 2022 16:24:53 +0000 (17:24 +0100)]
Merge pull request #2870 from mtmail/update-github-actions-to-node-16

update those github action packages still using node12

2 years agoupdate those github action packages still using node12
Marc Tobias [Tue, 8 Nov 2022 14:16:55 +0000 (15:16 +0100)]
update those github action packages still using node12

2 years agoMerge pull request #2866 from lonvia/reverse-ignore-interpolations-without-parent
Sarah Hoffmann [Mon, 7 Nov 2022 08:00:59 +0000 (09:00 +0100)]
Merge pull request #2866 from lonvia/reverse-ignore-interpolations-without-parent

Ignore interpolations without parent on reverse search

2 years agoignore interpolations without parent on reverse search
Sarah Hoffmann [Sat, 5 Nov 2022 13:33:28 +0000 (14:33 +0100)]
ignore interpolations without parent on reverse search

If no parent can be found for an interpolation, there is most
likely a data error involved. So don' t show these interpolations
in reverse search results.

2 years agoMerge pull request #2865 from Romeo-PHILLIPS/fix/documentation_status_code
Sarah Hoffmann [Sat, 5 Nov 2022 21:14:44 +0000 (22:14 +0100)]
Merge pull request #2865 from Romeo-PHILLIPS/fix/documentation_status_code

Fix: documentation status code

2 years agofix: format
Romeo [Fri, 4 Nov 2022 17:05:40 +0000 (18:05 +0100)]
fix: format

2 years agofix: markup
Romeo [Fri, 4 Nov 2022 17:04:28 +0000 (18:04 +0100)]
fix: markup

2 years agofix: 705 Status Code Documentation
Romeo [Fri, 4 Nov 2022 17:03:49 +0000 (18:03 +0100)]
fix: 705 Status Code Documentation

2 years agofix: 705 Status Code Documenation
Romeo [Fri, 4 Nov 2022 16:59:36 +0000 (17:59 +0100)]
fix: 705 Status Code Documenation

2 years agoMerge pull request #2862 from mtmail/remove-version-from-fpm-sock-file
Sarah Hoffmann [Fri, 4 Nov 2022 16:32:50 +0000 (17:32 +0100)]
Merge pull request #2862 from mtmail/remove-version-from-fpm-sock-file

Install scripts: remove version from /var/run/php-fpm filenames

2 years agoMerge pull request #2863 from lonvia/add-support-for-postgresql-15
Sarah Hoffmann [Fri, 4 Nov 2022 16:32:06 +0000 (17:32 +0100)]
Merge pull request #2863 from lonvia/add-support-for-postgresql-15

Update CI tests to postgresql 15

2 years agoupdate CI tests to postgresql 15
Sarah Hoffmann [Fri, 4 Nov 2022 14:23:06 +0000 (15:23 +0100)]
update CI tests to postgresql 15

2 years agoInstall scripts: remove version from /var/run/php-fpm filenames
marc tobias [Thu, 3 Nov 2022 22:29:58 +0000 (23:29 +0100)]
Install scripts: remove version from /var/run/php-fpm filenames

2 years agoactions: pin pyicu to 2.9
Sarah Hoffmann [Mon, 24 Oct 2022 12:21:44 +0000 (14:21 +0200)]
actions: pin pyicu to 2.9

2 years agoMerge pull request #2836 from mtmail/tiger2022
Sarah Hoffmann [Mon, 24 Oct 2022 09:21:55 +0000 (11:21 +0200)]
Merge pull request #2836 from mtmail/tiger2022

Documentation: remove year from TIGER filename, new 2022 data

2 years agoMerge pull request #2838 from lonvia/update-osm2pgsql
Sarah Hoffmann [Wed, 5 Oct 2022 16:59:13 +0000 (18:59 +0200)]
Merge pull request #2838 from lonvia/update-osm2pgsql

Update osm2pgsql to latest 1.7.1 release

2 years agofix flaky API test
Sarah Hoffmann [Wed, 5 Oct 2022 13:16:14 +0000 (15:16 +0200)]
fix flaky API test

The search 'landstr' produces many duplicates so that with
some bad luck 4 or less results may appear. Disable deduplication
to make it more predictable.

2 years agoupdate osm2pgsql to 1.7.1
Sarah Hoffmann [Tue, 4 Oct 2022 19:16:57 +0000 (21:16 +0200)]
update osm2pgsql to 1.7.1

2 years agoMerge pull request #2835 from lonvia/secondary-importance
Sarah Hoffmann [Tue, 4 Oct 2022 14:25:47 +0000 (16:25 +0200)]
Merge pull request #2835 from lonvia/secondary-importance

Secondary importance

2 years agoDocumentation: remove year from TIGER filename
marc tobias [Tue, 4 Oct 2022 12:19:36 +0000 (14:19 +0200)]
Documentation: remove year from TIGER filename

2 years agodocs: add customization hints for secondary importance
Sarah Hoffmann [Thu, 29 Sep 2022 12:55:46 +0000 (14:55 +0200)]
docs: add customization hints for secondary importance

Removing the download links for now as the tile importance
is still too experimental.

2 years agodo not run unit test when postgis_raster is not available
Sarah Hoffmann [Thu, 29 Sep 2022 08:01:49 +0000 (10:01 +0200)]
do not run unit test when postgis_raster is not available

2 years agoadapt unit tests to changed function names
Sarah Hoffmann [Wed, 28 Sep 2022 15:41:16 +0000 (17:41 +0200)]
adapt unit tests to changed function names

2 years agoadd secondary importance to API BDD tests
Sarah Hoffmann [Tue, 27 Sep 2022 21:13:29 +0000 (23:13 +0200)]
add secondary importance to API BDD tests

Also fixes a path issue during API test DB creation that could
never possibly have worked.

2 years agosimplify use of secondary importance
Sarah Hoffmann [Tue, 27 Sep 2022 20:12:48 +0000 (22:12 +0200)]
simplify use of secondary importance

The values in the raster are already normalized between 0 and 2**16,
so a simple conversion to [0, 1] will do.

Check for existance of secondary_importance table statically when
creating the SQL function. For that to work importance tables need
to be created before the functions.

2 years agoload views as a SQL file and rename to 'secondary importance'
Sarah Hoffmann [Tue, 27 Sep 2022 19:08:15 +0000 (21:08 +0200)]
load views as a SQL file and rename to 'secondary importance'

The only requirement for secondary importance is that a raster table
comes out of it. The generic name leaves open where the data comes
from.

2 years agoIntegrated OSM views into importance computation
Tareq Al-Ahdal [Thu, 25 Aug 2022 07:45:18 +0000 (09:45 +0200)]
Integrated OSM views into importance computation

2 years agoEnhanced the implementation of OSM views GeoTIFF import functionality
Tareq Al-Ahdal [Sun, 24 Jul 2022 11:04:23 +0000 (19:04 +0800)]
Enhanced the implementation of OSM views GeoTIFF import functionality

2 years agoInitial implementation of GeoTIFF import functionality
Tareq Al-Ahdal [Wed, 6 Jul 2022 06:16:41 +0000 (08:16 +0200)]
Initial implementation of GeoTIFF import functionality

2 years agoMerge pull request #2832 from lonvia/conditional-analyze-on-indexing
Sarah Hoffmann [Wed, 28 Sep 2022 13:17:40 +0000 (15:17 +0200)]
Merge pull request #2832 from lonvia/conditional-analyze-on-indexing

Only run analyze on indexing when work was done

2 years agoonly run analyze on indexing when work was done
Sarah Hoffmann [Wed, 28 Sep 2022 08:22:54 +0000 (10:22 +0200)]
only run analyze on indexing when work was done

This speeds up processing when continuing indexing after it was
interrupted.

2 years agoMerge pull request #2829 from lonvia/optimize-indexes
Sarah Hoffmann [Mon, 26 Sep 2022 08:02:51 +0000 (10:02 +0200)]
Merge pull request #2829 from lonvia/optimize-indexes

Further optimize indexes

2 years agomake sure indexes are used
Sarah Hoffmann [Sun, 25 Sep 2022 12:09:45 +0000 (14:09 +0200)]
make sure indexes are used

2 years agofurther split up the big geometry index
Sarah Hoffmann [Wed, 21 Sep 2022 12:25:07 +0000 (14:25 +0200)]
further split up the big geometry index

Adds partial indexes for all geometry queries used during import.
A full index is not necessary anymore at that point. Still create
the index afterwards for use in queries.

Also adds documentation for all indexes on where they are used.

2 years agoconsolidate indexes over geometry_sectors
Sarah Hoffmann [Wed, 21 Sep 2022 08:38:58 +0000 (10:38 +0200)]
consolidate indexes over geometry_sectors

The index over geometry_sectors are mainly used for ordering
the places which need indexing. That means they function effectively
as a TODO list. Consolodate them so that they always only contain
the places which are still to do. Also add the appropriate index
for the boundary indexing phase.

2 years agosplit up large osmid index on placex
Sarah Hoffmann [Tue, 20 Sep 2022 16:44:37 +0000 (18:44 +0200)]
split up large osmid index on placex

This doesn't do anything in terms of lookup speeds but the resulting
indexes are quite a bit smaller.

2 years agofix funding link
Sarah Hoffmann [Mon, 19 Sep 2022 13:39:58 +0000 (15:39 +0200)]
fix funding link

2 years agoadd Github Sponsering to funding page
Sarah Hoffmann [Mon, 19 Sep 2022 13:38:56 +0000 (15:38 +0200)]
add Github Sponsering to funding page

2 years agorun final index creation in parallel
Sarah Hoffmann [Wed, 14 Sep 2022 13:37:39 +0000 (15:37 +0200)]
run final index creation in parallel

2 years agoadd function for parallel execution of SQL scripts
Sarah Hoffmann [Mon, 19 Sep 2022 09:52:17 +0000 (11:52 +0200)]
add function for parallel execution of SQL scripts

2 years agoadd link to funding page
Sarah Hoffmann [Mon, 19 Sep 2022 08:30:58 +0000 (10:30 +0200)]
add link to funding page

2 years agoMerge pull request #2818 from lonvia/better-geometry-index
Sarah Hoffmann [Mon, 19 Sep 2022 08:18:43 +0000 (10:18 +0200)]
Merge pull request #2818 from lonvia/better-geometry-index

Add index for lookup of addressable areas

2 years agoadd indexes for lookup of addressable areas
Sarah Hoffmann [Sun, 18 Sep 2022 14:50:18 +0000 (16:50 +0200)]
add indexes for lookup of addressable areas

The generic geometry index has become to slow for that purpose.

2 years agoupdate security policy for 4.1 version
Sarah Hoffmann [Tue, 13 Sep 2022 06:58:31 +0000 (08:58 +0200)]
update security policy for 4.1 version

2 years agomypy: fix new warnings due to external type updates
Sarah Hoffmann [Mon, 5 Sep 2022 15:38:48 +0000 (17:38 +0200)]
mypy: fix new warnings due to external type updates

2 years agoMerge pull request #2812 from mausch/patch-1
Sarah Hoffmann [Mon, 5 Sep 2022 15:27:09 +0000 (17:27 +0200)]
Merge pull request #2812 from mausch/patch-1

docs: fix links to rank docs

2 years agodocs: fix links to rank docs
Mauricio Scheffer [Mon, 5 Sep 2022 10:11:13 +0000 (11:11 +0100)]
docs: fix links to rank docs

2 years agoMerge pull request #2799 from lonvia/fix-inclusions-with-extratags
Sarah Hoffmann [Sat, 13 Aug 2022 17:02:27 +0000 (19:02 +0200)]
Merge pull request #2799 from lonvia/fix-inclusions-with-extratags

Ignore irrelevant extra tags on address interpolations

2 years agoMerge pull request #2739 from tareqpi/collect_os_info.sh
Sarah Hoffmann [Sat, 13 Aug 2022 17:02:14 +0000 (19:02 +0200)]
Merge pull request #2739 from tareqpi/collect_os_info.sh

integration of host system information script into Nominatim CLI tool

2 years agoignore irrelevant extra tags on address interpolations
Sarah Hoffmann [Sat, 13 Aug 2022 08:42:46 +0000 (10:42 +0200)]
ignore irrelevant extra tags on address interpolations

When deciding if an address interpolation has address information, only
look for addr:street and addr:place. If they are not there go looking
for the address on the address nodes. Ignores irrelevant tags like
addr:inclusion.

Fixes #2797.

2 years agoAdded the feature of collecting host system information to the CI tests
Tareq Al-Ahdal [Fri, 12 Aug 2022 22:22:13 +0000 (06:22 +0800)]
Added the feature of collecting host system information to the CI tests

2 years agoIntegrated 'collect_os_info.py' into Nominatim's CLI tool
Tareq Al-Ahdal [Fri, 12 Aug 2022 22:18:10 +0000 (06:18 +0800)]
Integrated 'collect_os_info.py' into Nominatim's CLI tool

2 years agoEnhanced and refactored 'collect_os_info.py'
Tareq Al-Ahdal [Fri, 12 Aug 2022 22:13:05 +0000 (06:13 +0800)]
Enhanced and refactored 'collect_os_info.py'

Changed the script to functional programming paradigm to remove the big number of local attributes to decrease memory usage when running it. Additional OS info are now included.

2 years agoMerge remote-tracking branch 'upstream/master' into collect_os_info.sh
Tareq Al-Ahdal [Fri, 12 Aug 2022 21:53:39 +0000 (05:53 +0800)]
Merge remote-tracking branch 'upstream/master' into collect_os_info.sh

2 years agoMerge pull request #2798 from lonvia/more-rank-change-fixes
Sarah Hoffmann [Fri, 12 Aug 2022 09:42:03 +0000 (11:42 +0200)]
Merge pull request #2798 from lonvia/more-rank-change-fixes

Invalidations when boundaries and places change their rank

2 years agomore invalidations when boundary changes rank
Sarah Hoffmann [Thu, 11 Aug 2022 21:44:09 +0000 (23:44 +0200)]
more invalidations when boundary changes rank

When a boundary or place changes its address rank, all places where
it participates as address need to be potentially reindexed.
Also use the computed rank when testing place nodes against
boundaries. Boundaries are computed earlier.

Fixes #2794.

2 years agoMerge pull request #2793 from lonvia/increase-minimum-results
Sarah Hoffmann [Tue, 9 Aug 2022 18:08:45 +0000 (20:08 +0200)]
Merge pull request #2793 from lonvia/increase-minimum-results

Fix minimum number of results that are searched for

2 years agofix base number of returned results
Sarah Hoffmann [Tue, 9 Aug 2022 07:40:37 +0000 (09:40 +0200)]
fix base number of returned results

The intent was to always search for at least 10 results.

Improves on #882.

2 years agoMerge pull request #2792 from lonvia/new-type-annotations
Sarah Hoffmann [Tue, 9 Aug 2022 11:52:20 +0000 (13:52 +0200)]
Merge pull request #2792 from lonvia/new-type-annotations

Adapt to new type annotations from typeshed

2 years agoadapt to new type annotations from typeshed
Sarah Hoffmann [Tue, 9 Aug 2022 09:06:54 +0000 (11:06 +0200)]
adapt to new type annotations from typeshed

Some more functions frrom psycopg are now properly annotated.
No ignoring necessary anymore.

2 years agodocs: add types-psutil requirement
Sarah Hoffmann [Mon, 8 Aug 2022 07:46:25 +0000 (09:46 +0200)]
docs: add types-psutil requirement

2 years agoremove mypy ignore for psutil.virtual_memory()
Sarah Hoffmann [Mon, 8 Aug 2022 07:44:45 +0000 (09:44 +0200)]
remove mypy ignore for psutil.virtual_memory()

Now available in typeshed.

2 years agoMerge pull request #2789 from lonvia/update-osm2pgsql
Sarah Hoffmann [Mon, 8 Aug 2022 07:15:58 +0000 (09:15 +0200)]
Merge pull request #2789 from lonvia/update-osm2pgsql

Update osm2pgsql (fixes admin_level parsing)

2 years agoupdate osm2pgsql (fix admin_level parsing)
Sarah Hoffmann [Sun, 7 Aug 2022 16:34:47 +0000 (18:34 +0200)]
update osm2pgsql (fix admin_level parsing)

2 years agodocs: fix dangling links v4.1.0
Sarah Hoffmann [Fri, 5 Aug 2022 13:29:43 +0000 (15:29 +0200)]
docs: fix dangling links

2 years agodocs: update links to vagrant instructions
Sarah Hoffmann [Fri, 5 Aug 2022 13:27:11 +0000 (15:27 +0200)]
docs: update links to vagrant instructions

2 years agoprepare release 4.1.0
Sarah Hoffmann [Fri, 5 Aug 2022 12:33:11 +0000 (14:33 +0200)]
prepare release 4.1.0

2 years agoMerge pull request #2786 from lonvia/export-centroid-for-tokenizer
Sarah Hoffmann [Mon, 1 Aug 2022 09:38:24 +0000 (11:38 +0200)]
Merge pull request #2786 from lonvia/export-centroid-for-tokenizer

Export centroid to tokenizer

2 years agoexport centroid to tokenizer
Sarah Hoffmann [Sun, 31 Jul 2022 20:10:58 +0000 (22:10 +0200)]
export centroid to tokenizer

May come in handy when developping sanitizers for an area smaller
than country size.

2 years agoMerge pull request #2784 from lonvia/doscs-customizing-icu-tokenizer
Sarah Hoffmann [Sun, 31 Jul 2022 17:15:50 +0000 (19:15 +0200)]
Merge pull request #2784 from lonvia/doscs-customizing-icu-tokenizer

Document the public API of sanitizers and token analysis modules

2 years agofix various typos
Sarah Hoffmann [Sun, 31 Jul 2022 15:10:35 +0000 (17:10 +0200)]
fix various typos

2 years agoadd simple examples of sanitizers and token analysis
Sarah Hoffmann [Fri, 29 Jul 2022 15:15:25 +0000 (17:15 +0200)]
add simple examples of sanitizers and token analysis

2 years agooverhaul the token analysis interface
Sarah Hoffmann [Fri, 29 Jul 2022 13:14:11 +0000 (15:14 +0200)]
overhaul the token analysis interface

The functional split betweenthe two functions is now that the
first one creates the ID that is used in the word table and
the second one creates the variants. There no longer is a
requirement that the ID is the normalized version. We might
later reintroduce the requirement that a normalized version be available
but it doesn't necessarily need to be through the ID.

The function that creates the ID now gets the full PlaceName. That way
it might take into account attributes that were set by the sanitizers.

Finally rename both functions to something more sane.

2 years agomove PlaceName into the generic data module
Sarah Hoffmann [Fri, 29 Jul 2022 09:39:55 +0000 (11:39 +0200)]
move PlaceName into the generic data module

2 years agoharmonize spelling
Sarah Hoffmann [Fri, 29 Jul 2022 08:52:01 +0000 (10:52 +0200)]
harmonize spelling

Stick with the American spelling of Analyze.

2 years agoharmonize interface of token analysis module
Sarah Hoffmann [Fri, 29 Jul 2022 08:43:07 +0000 (10:43 +0200)]
harmonize interface of token analysis module

The configure() function now receives a Transliterator object instead
of the ICU rules. This harmonizes the parameters with the create
function.

2 years agoadd documentation for custom token analysis
Sarah Hoffmann [Fri, 29 Jul 2022 07:41:28 +0000 (09:41 +0200)]
add documentation for custom token analysis

2 years agoadd documentation for sanitizer interface
Sarah Hoffmann [Thu, 28 Jul 2022 20:00:29 +0000 (22:00 +0200)]
add documentation for sanitizer interface

Also switches mkdocstrings to 0.18 with the rather unfortunate
consequence that now mkdocstrings-python-legacy is needed as well.

2 years agoMerge pull request #2780 from lonvia/python-modules-in-project-directory
Sarah Hoffmann [Thu, 28 Jul 2022 19:58:04 +0000 (21:58 +0200)]
Merge pull request #2780 from lonvia/python-modules-in-project-directory

Support for external sanitizer and token analysis modules

2 years agoadd support for external token analysis modules
Sarah Hoffmann [Mon, 25 Jul 2022 14:27:22 +0000 (16:27 +0200)]
add support for external token analysis modules

2 years agoadd support for external sanitizer modules
Sarah Hoffmann [Mon, 25 Jul 2022 14:10:19 +0000 (16:10 +0200)]
add support for external sanitizer modules

2 years agoadd function for loading plugin modules
Sarah Hoffmann [Mon, 25 Jul 2022 13:17:20 +0000 (15:17 +0200)]
add function for loading plugin modules

Loads modules for configurable code like tokenizers, sanitizers, etc.
Supports internal modules, external libraries and code from the
project directory.

2 years agoMerge pull request #2775 from lonvia/remove-centos-instructions
Sarah Hoffmann [Mon, 25 Jul 2022 08:29:32 +0000 (10:29 +0200)]
Merge pull request #2775 from lonvia/remove-centos-instructions

Remove vagrant scripts for CentOS

2 years agovagrant: remove proj dependency and only require php-cli
Sarah Hoffmann [Sun, 24 Jul 2022 08:24:18 +0000 (10:24 +0200)]
vagrant: remove proj dependency and only require php-cli

2 years agoremove CentOS installation instructions
Sarah Hoffmann [Sun, 24 Jul 2022 08:22:22 +0000 (10:22 +0200)]
remove CentOS installation instructions

Fixes #2601.

2 years agoMerge pull request #2774 from lonvia/parameter-arrays
Sarah Hoffmann [Sat, 23 Jul 2022 21:56:32 +0000 (23:56 +0200)]
Merge pull request #2774 from lonvia/parameter-arrays

Ignore URL parameters in array notation

2 years agoignore API parameters in array notation
Sarah Hoffmann [Sat, 23 Jul 2022 08:51:44 +0000 (10:51 +0200)]
ignore API parameters in array notation

PHP automatically parses parameters in an array notation(foo[]) into
array types. Ignore these parameters as 'unknown'.

Fixes #2763.

2 years agoMerge pull request #2772 from kianmeng/fix-typos
Sarah Hoffmann [Wed, 20 Jul 2022 15:13:30 +0000 (17:13 +0200)]
Merge pull request #2772 from kianmeng/fix-typos

docs: fix typos

2 years agodocs: fix typos
Kian-Meng Ang [Wed, 20 Jul 2022 14:05:25 +0000 (22:05 +0800)]
docs: fix typos

2 years agodocs: slightly increase recommended hardware requirements
Sarah Hoffmann [Wed, 20 Jul 2022 08:16:23 +0000 (10:16 +0200)]
docs: slightly increase recommended hardware requirements

2 years agoMerge pull request #2770 from lonvia/typed-python
Sarah Hoffmann [Tue, 19 Jul 2022 07:03:30 +0000 (09:03 +0200)]
Merge pull request #2770 from lonvia/typed-python

Type annotations for Python code

2 years agoCI: remove installation of pip on Ubuntu 20
Sarah Hoffmann [Mon, 18 Jul 2022 10:19:04 +0000 (12:19 +0200)]
CI: remove installation of pip on Ubuntu 20

2 years agoadd explicit cast for fetchone
Sarah Hoffmann [Mon, 18 Jul 2022 08:18:51 +0000 (10:18 +0200)]
add explicit cast for fetchone

2 years agoCIL use psutil type stubs
Sarah Hoffmann [Sun, 17 Jul 2022 22:16:33 +0000 (00:16 +0200)]
CIL use psutil type stubs

2 years agoremove typing_extensions requirement
Sarah Hoffmann [Sun, 17 Jul 2022 21:18:55 +0000 (23:18 +0200)]
remove typing_extensions requirement

The typing_extensions package is only necessary now when running mypy.
It won't be used at runtime anymore.

2 years agoCI: make type checking strict
Sarah Hoffmann [Sun, 17 Jul 2022 21:20:21 +0000 (23:20 +0200)]
CI: make type checking strict

2 years agoadd type annotations for command line functions
Sarah Hoffmann [Sun, 17 Jul 2022 16:31:51 +0000 (18:31 +0200)]
add type annotations for command line functions

2 years agoadd type annotations for Tiger import function
Sarah Hoffmann [Sun, 17 Jul 2022 09:01:44 +0000 (11:01 +0200)]
add type annotations for Tiger import function

2 years agoadd type annotations to special phrase importer
Sarah Hoffmann [Sun, 17 Jul 2022 08:46:59 +0000 (10:46 +0200)]
add type annotations to special phrase importer