]> git.openstreetmap.org Git - nominatim.git/log
nominatim.git
2 years agoIntegrated OSM views into importance computation
Tareq Al-Ahdal [Thu, 25 Aug 2022 07:45:18 +0000 (09:45 +0200)]
Integrated OSM views into importance computation

2 years agoEnhanced the implementation of OSM views GeoTIFF import functionality
Tareq Al-Ahdal [Sun, 24 Jul 2022 11:04:23 +0000 (19:04 +0800)]
Enhanced the implementation of OSM views GeoTIFF import functionality

2 years agoInitial implementation of GeoTIFF import functionality
Tareq Al-Ahdal [Wed, 6 Jul 2022 06:16:41 +0000 (08:16 +0200)]
Initial implementation of GeoTIFF import functionality

2 years agoMerge pull request #2832 from lonvia/conditional-analyze-on-indexing
Sarah Hoffmann [Wed, 28 Sep 2022 13:17:40 +0000 (15:17 +0200)]
Merge pull request #2832 from lonvia/conditional-analyze-on-indexing

Only run analyze on indexing when work was done

2 years agoonly run analyze on indexing when work was done
Sarah Hoffmann [Wed, 28 Sep 2022 08:22:54 +0000 (10:22 +0200)]
only run analyze on indexing when work was done

This speeds up processing when continuing indexing after it was
interrupted.

2 years agoMerge pull request #2829 from lonvia/optimize-indexes
Sarah Hoffmann [Mon, 26 Sep 2022 08:02:51 +0000 (10:02 +0200)]
Merge pull request #2829 from lonvia/optimize-indexes

Further optimize indexes

2 years agomake sure indexes are used
Sarah Hoffmann [Sun, 25 Sep 2022 12:09:45 +0000 (14:09 +0200)]
make sure indexes are used

2 years agofurther split up the big geometry index
Sarah Hoffmann [Wed, 21 Sep 2022 12:25:07 +0000 (14:25 +0200)]
further split up the big geometry index

Adds partial indexes for all geometry queries used during import.
A full index is not necessary anymore at that point. Still create
the index afterwards for use in queries.

Also adds documentation for all indexes on where they are used.

2 years agoconsolidate indexes over geometry_sectors
Sarah Hoffmann [Wed, 21 Sep 2022 08:38:58 +0000 (10:38 +0200)]
consolidate indexes over geometry_sectors

The index over geometry_sectors are mainly used for ordering
the places which need indexing. That means they function effectively
as a TODO list. Consolodate them so that they always only contain
the places which are still to do. Also add the appropriate index
for the boundary indexing phase.

2 years agosplit up large osmid index on placex
Sarah Hoffmann [Tue, 20 Sep 2022 16:44:37 +0000 (18:44 +0200)]
split up large osmid index on placex

This doesn't do anything in terms of lookup speeds but the resulting
indexes are quite a bit smaller.

2 years agofix funding link
Sarah Hoffmann [Mon, 19 Sep 2022 13:39:58 +0000 (15:39 +0200)]
fix funding link

2 years agoadd Github Sponsering to funding page
Sarah Hoffmann [Mon, 19 Sep 2022 13:38:56 +0000 (15:38 +0200)]
add Github Sponsering to funding page

2 years agorun final index creation in parallel
Sarah Hoffmann [Wed, 14 Sep 2022 13:37:39 +0000 (15:37 +0200)]
run final index creation in parallel

2 years agoadd function for parallel execution of SQL scripts
Sarah Hoffmann [Mon, 19 Sep 2022 09:52:17 +0000 (11:52 +0200)]
add function for parallel execution of SQL scripts

2 years agoadd link to funding page
Sarah Hoffmann [Mon, 19 Sep 2022 08:30:58 +0000 (10:30 +0200)]
add link to funding page

2 years agoMerge pull request #2818 from lonvia/better-geometry-index
Sarah Hoffmann [Mon, 19 Sep 2022 08:18:43 +0000 (10:18 +0200)]
Merge pull request #2818 from lonvia/better-geometry-index

Add index for lookup of addressable areas

2 years agoadd indexes for lookup of addressable areas
Sarah Hoffmann [Sun, 18 Sep 2022 14:50:18 +0000 (16:50 +0200)]
add indexes for lookup of addressable areas

The generic geometry index has become to slow for that purpose.

2 years agoupdate security policy for 4.1 version
Sarah Hoffmann [Tue, 13 Sep 2022 06:58:31 +0000 (08:58 +0200)]
update security policy for 4.1 version

2 years agomypy: fix new warnings due to external type updates
Sarah Hoffmann [Mon, 5 Sep 2022 15:38:48 +0000 (17:38 +0200)]
mypy: fix new warnings due to external type updates

2 years agoMerge pull request #2812 from mausch/patch-1
Sarah Hoffmann [Mon, 5 Sep 2022 15:27:09 +0000 (17:27 +0200)]
Merge pull request #2812 from mausch/patch-1

docs: fix links to rank docs

2 years agodocs: fix links to rank docs
Mauricio Scheffer [Mon, 5 Sep 2022 10:11:13 +0000 (11:11 +0100)]
docs: fix links to rank docs

2 years agoMerge pull request #2799 from lonvia/fix-inclusions-with-extratags
Sarah Hoffmann [Sat, 13 Aug 2022 17:02:27 +0000 (19:02 +0200)]
Merge pull request #2799 from lonvia/fix-inclusions-with-extratags

Ignore irrelevant extra tags on address interpolations

2 years agoMerge pull request #2739 from tareqpi/collect_os_info.sh
Sarah Hoffmann [Sat, 13 Aug 2022 17:02:14 +0000 (19:02 +0200)]
Merge pull request #2739 from tareqpi/collect_os_info.sh

integration of host system information script into Nominatim CLI tool

2 years agoignore irrelevant extra tags on address interpolations
Sarah Hoffmann [Sat, 13 Aug 2022 08:42:46 +0000 (10:42 +0200)]
ignore irrelevant extra tags on address interpolations

When deciding if an address interpolation has address information, only
look for addr:street and addr:place. If they are not there go looking
for the address on the address nodes. Ignores irrelevant tags like
addr:inclusion.

Fixes #2797.

2 years agoAdded the feature of collecting host system information to the CI tests
Tareq Al-Ahdal [Fri, 12 Aug 2022 22:22:13 +0000 (06:22 +0800)]
Added the feature of collecting host system information to the CI tests

2 years agoIntegrated 'collect_os_info.py' into Nominatim's CLI tool
Tareq Al-Ahdal [Fri, 12 Aug 2022 22:18:10 +0000 (06:18 +0800)]
Integrated 'collect_os_info.py' into Nominatim's CLI tool

2 years agoEnhanced and refactored 'collect_os_info.py'
Tareq Al-Ahdal [Fri, 12 Aug 2022 22:13:05 +0000 (06:13 +0800)]
Enhanced and refactored 'collect_os_info.py'

Changed the script to functional programming paradigm to remove the big number of local attributes to decrease memory usage when running it. Additional OS info are now included.

2 years agoMerge remote-tracking branch 'upstream/master' into collect_os_info.sh
Tareq Al-Ahdal [Fri, 12 Aug 2022 21:53:39 +0000 (05:53 +0800)]
Merge remote-tracking branch 'upstream/master' into collect_os_info.sh

2 years agoMerge pull request #2798 from lonvia/more-rank-change-fixes
Sarah Hoffmann [Fri, 12 Aug 2022 09:42:03 +0000 (11:42 +0200)]
Merge pull request #2798 from lonvia/more-rank-change-fixes

Invalidations when boundaries and places change their rank

2 years agomore invalidations when boundary changes rank
Sarah Hoffmann [Thu, 11 Aug 2022 21:44:09 +0000 (23:44 +0200)]
more invalidations when boundary changes rank

When a boundary or place changes its address rank, all places where
it participates as address need to be potentially reindexed.
Also use the computed rank when testing place nodes against
boundaries. Boundaries are computed earlier.

Fixes #2794.

2 years agoMerge pull request #2793 from lonvia/increase-minimum-results
Sarah Hoffmann [Tue, 9 Aug 2022 18:08:45 +0000 (20:08 +0200)]
Merge pull request #2793 from lonvia/increase-minimum-results

Fix minimum number of results that are searched for

2 years agofix base number of returned results
Sarah Hoffmann [Tue, 9 Aug 2022 07:40:37 +0000 (09:40 +0200)]
fix base number of returned results

The intent was to always search for at least 10 results.

Improves on #882.

2 years agoMerge pull request #2792 from lonvia/new-type-annotations
Sarah Hoffmann [Tue, 9 Aug 2022 11:52:20 +0000 (13:52 +0200)]
Merge pull request #2792 from lonvia/new-type-annotations

Adapt to new type annotations from typeshed

2 years agoadapt to new type annotations from typeshed
Sarah Hoffmann [Tue, 9 Aug 2022 09:06:54 +0000 (11:06 +0200)]
adapt to new type annotations from typeshed

Some more functions frrom psycopg are now properly annotated.
No ignoring necessary anymore.

2 years agodocs: add types-psutil requirement
Sarah Hoffmann [Mon, 8 Aug 2022 07:46:25 +0000 (09:46 +0200)]
docs: add types-psutil requirement

2 years agoremove mypy ignore for psutil.virtual_memory()
Sarah Hoffmann [Mon, 8 Aug 2022 07:44:45 +0000 (09:44 +0200)]
remove mypy ignore for psutil.virtual_memory()

Now available in typeshed.

2 years agoMerge pull request #2789 from lonvia/update-osm2pgsql
Sarah Hoffmann [Mon, 8 Aug 2022 07:15:58 +0000 (09:15 +0200)]
Merge pull request #2789 from lonvia/update-osm2pgsql

Update osm2pgsql (fixes admin_level parsing)

2 years agoupdate osm2pgsql (fix admin_level parsing)
Sarah Hoffmann [Sun, 7 Aug 2022 16:34:47 +0000 (18:34 +0200)]
update osm2pgsql (fix admin_level parsing)

2 years agodocs: fix dangling links v4.1.0
Sarah Hoffmann [Fri, 5 Aug 2022 13:29:43 +0000 (15:29 +0200)]
docs: fix dangling links

2 years agodocs: update links to vagrant instructions
Sarah Hoffmann [Fri, 5 Aug 2022 13:27:11 +0000 (15:27 +0200)]
docs: update links to vagrant instructions

2 years agoprepare release 4.1.0
Sarah Hoffmann [Fri, 5 Aug 2022 12:33:11 +0000 (14:33 +0200)]
prepare release 4.1.0

2 years agoMerge pull request #2786 from lonvia/export-centroid-for-tokenizer
Sarah Hoffmann [Mon, 1 Aug 2022 09:38:24 +0000 (11:38 +0200)]
Merge pull request #2786 from lonvia/export-centroid-for-tokenizer

Export centroid to tokenizer

2 years agoexport centroid to tokenizer
Sarah Hoffmann [Sun, 31 Jul 2022 20:10:58 +0000 (22:10 +0200)]
export centroid to tokenizer

May come in handy when developping sanitizers for an area smaller
than country size.

2 years agoMerge pull request #2784 from lonvia/doscs-customizing-icu-tokenizer
Sarah Hoffmann [Sun, 31 Jul 2022 17:15:50 +0000 (19:15 +0200)]
Merge pull request #2784 from lonvia/doscs-customizing-icu-tokenizer

Document the public API of sanitizers and token analysis modules

2 years agofix various typos
Sarah Hoffmann [Sun, 31 Jul 2022 15:10:35 +0000 (17:10 +0200)]
fix various typos

2 years agoadd simple examples of sanitizers and token analysis
Sarah Hoffmann [Fri, 29 Jul 2022 15:15:25 +0000 (17:15 +0200)]
add simple examples of sanitizers and token analysis

2 years agooverhaul the token analysis interface
Sarah Hoffmann [Fri, 29 Jul 2022 13:14:11 +0000 (15:14 +0200)]
overhaul the token analysis interface

The functional split betweenthe two functions is now that the
first one creates the ID that is used in the word table and
the second one creates the variants. There no longer is a
requirement that the ID is the normalized version. We might
later reintroduce the requirement that a normalized version be available
but it doesn't necessarily need to be through the ID.

The function that creates the ID now gets the full PlaceName. That way
it might take into account attributes that were set by the sanitizers.

Finally rename both functions to something more sane.

2 years agomove PlaceName into the generic data module
Sarah Hoffmann [Fri, 29 Jul 2022 09:39:55 +0000 (11:39 +0200)]
move PlaceName into the generic data module

2 years agoharmonize spelling
Sarah Hoffmann [Fri, 29 Jul 2022 08:52:01 +0000 (10:52 +0200)]
harmonize spelling

Stick with the American spelling of Analyze.

2 years agoharmonize interface of token analysis module
Sarah Hoffmann [Fri, 29 Jul 2022 08:43:07 +0000 (10:43 +0200)]
harmonize interface of token analysis module

The configure() function now receives a Transliterator object instead
of the ICU rules. This harmonizes the parameters with the create
function.

2 years agoadd documentation for custom token analysis
Sarah Hoffmann [Fri, 29 Jul 2022 07:41:28 +0000 (09:41 +0200)]
add documentation for custom token analysis

2 years agoadd documentation for sanitizer interface
Sarah Hoffmann [Thu, 28 Jul 2022 20:00:29 +0000 (22:00 +0200)]
add documentation for sanitizer interface

Also switches mkdocstrings to 0.18 with the rather unfortunate
consequence that now mkdocstrings-python-legacy is needed as well.

2 years agoMerge pull request #2780 from lonvia/python-modules-in-project-directory
Sarah Hoffmann [Thu, 28 Jul 2022 19:58:04 +0000 (21:58 +0200)]
Merge pull request #2780 from lonvia/python-modules-in-project-directory

Support for external sanitizer and token analysis modules

2 years agoadd support for external token analysis modules
Sarah Hoffmann [Mon, 25 Jul 2022 14:27:22 +0000 (16:27 +0200)]
add support for external token analysis modules

2 years agoadd support for external sanitizer modules
Sarah Hoffmann [Mon, 25 Jul 2022 14:10:19 +0000 (16:10 +0200)]
add support for external sanitizer modules

2 years agoadd function for loading plugin modules
Sarah Hoffmann [Mon, 25 Jul 2022 13:17:20 +0000 (15:17 +0200)]
add function for loading plugin modules

Loads modules for configurable code like tokenizers, sanitizers, etc.
Supports internal modules, external libraries and code from the
project directory.

2 years agoMerge pull request #2775 from lonvia/remove-centos-instructions
Sarah Hoffmann [Mon, 25 Jul 2022 08:29:32 +0000 (10:29 +0200)]
Merge pull request #2775 from lonvia/remove-centos-instructions

Remove vagrant scripts for CentOS

2 years agovagrant: remove proj dependency and only require php-cli
Sarah Hoffmann [Sun, 24 Jul 2022 08:24:18 +0000 (10:24 +0200)]
vagrant: remove proj dependency and only require php-cli

2 years agoremove CentOS installation instructions
Sarah Hoffmann [Sun, 24 Jul 2022 08:22:22 +0000 (10:22 +0200)]
remove CentOS installation instructions

Fixes #2601.

2 years agoMerge pull request #2774 from lonvia/parameter-arrays
Sarah Hoffmann [Sat, 23 Jul 2022 21:56:32 +0000 (23:56 +0200)]
Merge pull request #2774 from lonvia/parameter-arrays

Ignore URL parameters in array notation

2 years agoignore API parameters in array notation
Sarah Hoffmann [Sat, 23 Jul 2022 08:51:44 +0000 (10:51 +0200)]
ignore API parameters in array notation

PHP automatically parses parameters in an array notation(foo[]) into
array types. Ignore these parameters as 'unknown'.

Fixes #2763.

2 years agoMerge pull request #2772 from kianmeng/fix-typos
Sarah Hoffmann [Wed, 20 Jul 2022 15:13:30 +0000 (17:13 +0200)]
Merge pull request #2772 from kianmeng/fix-typos

docs: fix typos

2 years agodocs: fix typos
Kian-Meng Ang [Wed, 20 Jul 2022 14:05:25 +0000 (22:05 +0800)]
docs: fix typos

2 years agodocs: slightly increase recommended hardware requirements
Sarah Hoffmann [Wed, 20 Jul 2022 08:16:23 +0000 (10:16 +0200)]
docs: slightly increase recommended hardware requirements

2 years agoMerge pull request #2770 from lonvia/typed-python
Sarah Hoffmann [Tue, 19 Jul 2022 07:03:30 +0000 (09:03 +0200)]
Merge pull request #2770 from lonvia/typed-python

Type annotations for Python code

2 years agoCI: remove installation of pip on Ubuntu 20
Sarah Hoffmann [Mon, 18 Jul 2022 10:19:04 +0000 (12:19 +0200)]
CI: remove installation of pip on Ubuntu 20

2 years agoadd explicit cast for fetchone
Sarah Hoffmann [Mon, 18 Jul 2022 08:18:51 +0000 (10:18 +0200)]
add explicit cast for fetchone

2 years agoCIL use psutil type stubs
Sarah Hoffmann [Sun, 17 Jul 2022 22:16:33 +0000 (00:16 +0200)]
CIL use psutil type stubs

2 years agoremove typing_extensions requirement
Sarah Hoffmann [Sun, 17 Jul 2022 21:18:55 +0000 (23:18 +0200)]
remove typing_extensions requirement

The typing_extensions package is only necessary now when running mypy.
It won't be used at runtime anymore.

2 years agoCI: make type checking strict
Sarah Hoffmann [Sun, 17 Jul 2022 21:20:21 +0000 (23:20 +0200)]
CI: make type checking strict

2 years agoadd type annotations for command line functions
Sarah Hoffmann [Sun, 17 Jul 2022 16:31:51 +0000 (18:31 +0200)]
add type annotations for command line functions

2 years agoadd type annotations for Tiger import function
Sarah Hoffmann [Sun, 17 Jul 2022 09:01:44 +0000 (11:01 +0200)]
add type annotations for Tiger import function

2 years agoadd type annotations to special phrase importer
Sarah Hoffmann [Sun, 17 Jul 2022 08:46:59 +0000 (10:46 +0200)]
add type annotations to special phrase importer

2 years agoadd type annotations to database check functions
Sarah Hoffmann [Sun, 17 Jul 2022 07:59:51 +0000 (09:59 +0200)]
add type annotations to database check functions

2 years agoadd type annotations for database import functions
Sarah Hoffmann [Sat, 16 Jul 2022 22:29:34 +0000 (00:29 +0200)]
add type annotations for database import functions

2 years agoadd type annotations for migrations
Sarah Hoffmann [Sat, 16 Jul 2022 21:44:36 +0000 (23:44 +0200)]
add type annotations for migrations

2 years agoadd type annotations to tool functions
Sarah Hoffmann [Sat, 16 Jul 2022 21:28:02 +0000 (23:28 +0200)]
add type annotations to tool functions

2 years agoadd type annotations for ICU tokenizer
Sarah Hoffmann [Sat, 16 Jul 2022 15:33:19 +0000 (17:33 +0200)]
add type annotations for ICU tokenizer

2 years agoadd type annotations for legacy tokenizer
Sarah Hoffmann [Fri, 15 Jul 2022 20:52:26 +0000 (22:52 +0200)]
add type annotations for legacy tokenizer

2 years agoadd type annotations to ICU tokenizer helper modules
Sarah Hoffmann [Wed, 13 Jul 2022 20:55:40 +0000 (22:55 +0200)]
add type annotations to ICU tokenizer helper modules

2 years agoadd typing extensions for Ubuntu22.04
Sarah Hoffmann [Wed, 13 Jul 2022 18:49:54 +0000 (20:49 +0200)]
add typing extensions for Ubuntu22.04

2 years agoadd type annotations for token analysis
Sarah Hoffmann [Wed, 13 Jul 2022 15:18:53 +0000 (17:18 +0200)]
add type annotations for token analysis

No annotations for ICU types yet.

2 years agoadd type hints for sanitizers
Sarah Hoffmann [Tue, 12 Jul 2022 21:15:19 +0000 (23:15 +0200)]
add type hints for sanitizers

2 years agoadd type annotations for indexer
Sarah Hoffmann [Tue, 12 Jul 2022 16:40:51 +0000 (18:40 +0200)]
add type annotations for indexer

2 years agoadd typing information for postcode formatter
Sarah Hoffmann [Fri, 8 Jul 2022 09:52:45 +0000 (11:52 +0200)]
add typing information for postcode formatter

2 years agoadd typing information for place_info and country_info
Sarah Hoffmann [Thu, 7 Jul 2022 15:31:20 +0000 (17:31 +0200)]
add typing information for place_info and country_info

2 years agoadd typing information for utils submodule
Sarah Hoffmann [Tue, 5 Jul 2022 15:28:02 +0000 (17:28 +0200)]
add typing information for utils submodule

2 years agotype annotations for non-blocking DB connection
Sarah Hoffmann [Tue, 5 Jul 2022 13:00:33 +0000 (15:00 +0200)]
type annotations for non-blocking DB connection

2 years agoadd type annotations for SQL preprocessor
Sarah Hoffmann [Tue, 5 Jul 2022 09:24:53 +0000 (11:24 +0200)]
add type annotations for SQL preprocessor

2 years agoadd type annotation to DB utils
Sarah Hoffmann [Tue, 5 Jul 2022 08:46:55 +0000 (10:46 +0200)]
add type annotation to DB utils

As a cursor is needed as type, make this a public type.

2 years agoadd typing information to DB properties
Sarah Hoffmann [Tue, 5 Jul 2022 08:34:55 +0000 (10:34 +0200)]
add typing information to DB properties

2 years agoadd typing annotations for DB status module
Sarah Hoffmann [Mon, 4 Jul 2022 09:29:12 +0000 (11:29 +0200)]
add typing annotations for DB status module

Requires TypedDict which is only available from Python 3.8. Require
therefore typing_extensions to make the functions available for
earlier Python versions.

2 years agoadapt use of Connection in bdd tests to name change
Sarah Hoffmann [Mon, 4 Jul 2022 06:46:07 +0000 (08:46 +0200)]
adapt use of Connection in bdd tests to name change

2 years agoadd type annotations to freeze functions
Sarah Hoffmann [Sun, 3 Jul 2022 17:04:05 +0000 (19:04 +0200)]
add type annotations to freeze functions

2 years agofix uses of config.get_path() to expect None
Sarah Hoffmann [Sun, 3 Jul 2022 16:36:33 +0000 (18:36 +0200)]
fix uses of config.get_path() to expect None

2 years agodefine type for enivronment dictionaries
Sarah Hoffmann [Sun, 3 Jul 2022 15:38:11 +0000 (17:38 +0200)]
define type for enivronment dictionaries

2 years agorestrict return type more
Sarah Hoffmann [Sun, 3 Jul 2022 15:21:46 +0000 (17:21 +0200)]
restrict return type more

2 years agoadd type annotations to exec_utils
Sarah Hoffmann [Sun, 3 Jul 2022 12:48:15 +0000 (14:48 +0200)]
add type annotations to exec_utils

2 years agoCI: install type info for psycopg2
Sarah Hoffmann [Sun, 3 Jul 2022 09:49:50 +0000 (11:49 +0200)]
CI: install type info for psycopg2

2 years agoavoid issues with Python < 3.9 and linting
Sarah Hoffmann [Sun, 3 Jul 2022 09:33:19 +0000 (11:33 +0200)]
avoid issues with Python < 3.9 and linting