]> git.openstreetmap.org Git - nominatim.git/log
nominatim.git
15 months agofinish configuration section
Sarah Hoffmann [Tue, 22 Aug 2023 20:16:34 +0000 (22:16 +0200)]
finish configuration section

15 months agorestructure library documentation
Sarah Hoffmann [Tue, 22 Aug 2023 19:46:10 +0000 (21:46 +0200)]
restructure library documentation

15 months agoinitial configuration documentation
Sarah Hoffmann [Sun, 20 Aug 2023 08:42:33 +0000 (10:42 +0200)]
initial configuration documentation

15 months agodocs: documentation of API classes
Sarah Hoffmann [Sat, 19 Aug 2023 13:36:57 +0000 (15:36 +0200)]
docs: documentation of API classes

15 months agomore adaptions for mkdocstrings griffin plugin
Sarah Hoffmann [Sat, 19 Aug 2023 07:34:31 +0000 (09:34 +0200)]
more adaptions for mkdocstrings griffin plugin

15 months agoadd base framework for library reference
Sarah Hoffmann [Fri, 18 Aug 2023 16:05:57 +0000 (18:05 +0200)]
add base framework for library reference

15 months agoupdate to modern mkdocstrings python handler
Sarah Hoffmann [Fri, 18 Aug 2023 15:28:45 +0000 (17:28 +0200)]
update to modern mkdocstrings python handler

15 months agoMerge pull request #3172 from lonvia/query-timeout
Sarah Hoffmann [Fri, 25 Aug 2023 08:00:22 +0000 (10:00 +0200)]
Merge pull request #3172 from lonvia/query-timeout

Introduce timeouts for queries

15 months agoadd additional timeout for entire request
Sarah Hoffmann [Fri, 25 Aug 2023 07:16:53 +0000 (09:16 +0200)]
add additional timeout for entire request

15 months agouse backwards-compatible asyncio timeout implementation
Sarah Hoffmann [Thu, 24 Aug 2023 14:29:21 +0000 (16:29 +0200)]
use backwards-compatible asyncio timeout implementation

15 months agotranslate query timeouts into proper HTTP responses
Sarah Hoffmann [Thu, 24 Aug 2023 13:55:05 +0000 (15:55 +0200)]
translate query timeouts into proper HTTP responses

Need to use a 503 here because a 408 (Request timeout) will motivate
browsers to immediately resent the request.

15 months agoadd a timeout for DB queries
Sarah Hoffmann [Thu, 24 Aug 2023 12:57:33 +0000 (14:57 +0200)]
add a timeout for DB queries

15 months agoapply adjusted counts only to final result
Sarah Hoffmann [Thu, 24 Aug 2023 19:37:02 +0000 (21:37 +0200)]
apply adjusted counts only to final result

15 months agoMerge pull request #3169 from lonvia/tweak-search-with-frequent-names
Sarah Hoffmann [Thu, 24 Aug 2023 12:22:35 +0000 (14:22 +0200)]
Merge pull request #3169 from lonvia/tweak-search-with-frequent-names

Further tweak detection of queries that would return a massive amount of results

15 months agoallow terms with frequent searches together with viewbox
Sarah Hoffmann [Thu, 24 Aug 2023 07:21:09 +0000 (09:21 +0200)]
allow terms with frequent searches together with viewbox

15 months agoMerge pull request #3167 from lonvia/explicit-encoding
Sarah Hoffmann [Thu, 24 Aug 2023 06:53:11 +0000 (08:53 +0200)]
Merge pull request #3167 from lonvia/explicit-encoding

Send explicit charset in content-type when returning json

15 months agoMerge pull request #3139 from mtmail/update-search-examples
Sarah Hoffmann [Wed, 23 Aug 2023 21:41:30 +0000 (23:41 +0200)]
Merge pull request #3139 from mtmail/update-search-examples

Search.md - update XML and JSON example output

15 months agofurther tweak search containing very frequent tokens
Sarah Hoffmann [Wed, 23 Aug 2023 21:04:12 +0000 (23:04 +0200)]
further tweak search containing very frequent tokens

Excluding non-rare full names is not really possible because it makes
addresses with street names like 'main st' unsearchable. This tries to
leav all names in but refrain from ordering results by accuracy
when too many results are expected. This means that the DB will simply
get the first n results without any particular order.

15 months agosend charset again in content-type when returning json
Sarah Hoffmann [Wed, 23 Aug 2023 18:55:57 +0000 (20:55 +0200)]
send charset again in content-type when returning json

There are quite a few applications out there that will use some local
encoding when the charset is not explicitly given.

16 months agoMerge pull request #3165 from lonvia/update-osm2pgsql
Sarah Hoffmann [Wed, 23 Aug 2023 13:57:55 +0000 (15:57 +0200)]
Merge pull request #3165 from lonvia/update-osm2pgsql

Update osm2pgsql to 1.9.1

16 months agovagrant scripts: add missing yaml library
Sarah Hoffmann [Wed, 23 Aug 2023 06:34:12 +0000 (08:34 +0200)]
vagrant scripts: add missing yaml library

16 months agoadd new required json library for osm2pgsql
Sarah Hoffmann [Tue, 22 Aug 2023 18:05:25 +0000 (20:05 +0200)]
add new required json library for osm2pgsql

16 months agoupdate osm2pgsql to 1.9.1
Sarah Hoffmann [Tue, 22 Aug 2023 13:04:50 +0000 (15:04 +0200)]
update osm2pgsql to 1.9.1

16 months agoMerge pull request #3159 from lonvia/fix-name-lookup-for-housenames
Sarah Hoffmann [Sun, 20 Aug 2023 13:52:20 +0000 (15:52 +0200)]
Merge pull request #3159 from lonvia/fix-name-lookup-for-housenames

Fix name lookup for housenames

16 months agofix parameter use for ST_Project
Sarah Hoffmann [Sun, 20 Aug 2023 11:52:03 +0000 (13:52 +0200)]
fix parameter use for ST_Project

Before postgis 3.4 ST_Project required a geography as input and seemed
to have implicitly converted to geography. Since 3.4 geometry input
is supported but leads to a completely different result.

16 months agofix tag name for housename addresses in layer selection
Sarah Hoffmann [Sat, 19 Aug 2023 13:57:33 +0000 (15:57 +0200)]
fix tag name for housename addresses in layer selection

Fixes #3156.

16 months agoMerge pull request #3155 from lonvia/caching-of-transliterators
Sarah Hoffmann [Wed, 16 Aug 2023 20:55:54 +0000 (22:55 +0200)]
Merge pull request #3155 from lonvia/caching-of-transliterators

Cache ICU transliterators between calls

16 months agocache ICU transliterators and reuse them
Sarah Hoffmann [Tue, 15 Aug 2023 21:08:44 +0000 (23:08 +0200)]
cache ICU transliterators and reuse them

16 months agoMerge pull request #3150 from alfmarcua/allow_neg_id_details
Sarah Hoffmann [Mon, 14 Aug 2023 09:41:42 +0000 (11:41 +0200)]
Merge pull request #3150 from alfmarcua/allow_neg_id_details

Allow negative osm_id in details page by setting default parameter to 0

16 months agofix regression in default setting for details linkedplaces
Sarah Hoffmann [Sun, 13 Aug 2023 13:30:04 +0000 (15:30 +0200)]
fix regression in default setting for details linkedplaces

16 months agoprefer name-only searches more
Sarah Hoffmann [Sun, 13 Aug 2023 13:24:16 +0000 (15:24 +0200)]
prefer name-only searches more

16 months agoreturn bbox of full country for country searches
Sarah Hoffmann [Sun, 13 Aug 2023 12:37:28 +0000 (14:37 +0200)]
return bbox of full country for country searches

Fixes #3149.

16 months agofix application of label to wrong expression
Sarah Hoffmann [Sun, 13 Aug 2023 09:59:01 +0000 (11:59 +0200)]
fix application of label to wrong expression

16 months agoavoid lambda SQL in connection with alias tables
Sarah Hoffmann [Sun, 13 Aug 2023 09:40:49 +0000 (11:40 +0200)]
avoid lambda SQL in connection with alias tables

16 months agouse coalsce() instead of indexless postgis functions
Sarah Hoffmann [Sat, 12 Aug 2023 17:14:13 +0000 (19:14 +0200)]
use coalsce() instead of indexless postgis functions

ST_Intersects is deemed too expensive by the query planer which
leads to odd plans when index use is avoided.

16 months agodo not use index when searching in large areas
Sarah Hoffmann [Sat, 12 Aug 2023 14:12:44 +0000 (16:12 +0200)]
do not use index when searching in large areas

This concerns viewboxes as well as radius search.

16 months agoadapt tests to changes in search
Sarah Hoffmann [Sat, 12 Aug 2023 14:12:31 +0000 (16:12 +0200)]
adapt tests to changes in search

16 months agotake token_assignment penalty into account
Sarah Hoffmann [Sat, 12 Aug 2023 13:33:50 +0000 (15:33 +0200)]
take token_assignment penalty into account

Also computes the expected count differently when addresses are
involved. Address token counts do not bare a direct relation to
real counts.

16 months agofix debug output for NearSearch
Sarah Hoffmann [Sat, 12 Aug 2023 09:27:55 +0000 (11:27 +0200)]
fix debug output for NearSearch

The search info is in a subsearch and was therefore not taken into
account.

16 months agoimprove penalty for token-split words
Sarah Hoffmann [Sat, 12 Aug 2023 09:26:02 +0000 (11:26 +0200)]
improve penalty for token-split words

The rematch penalty for partial words created by the transliteration
need to take into account that they are rematched against the full word.
That means that missing beginning and end should not get a significant
penalty.

16 months agoAllow negative osm_id in details page by setting default parameter to 0
alfmarcua [Fri, 11 Aug 2023 08:46:28 +0000 (10:46 +0200)]
Allow negative osm_id in details page by setting default parameter to 0

16 months agofix lookup polygon output
Sarah Hoffmann [Tue, 8 Aug 2023 17:42:55 +0000 (19:42 +0200)]
fix lookup polygon output

Fixes #3147.

16 months agoSearch.md - update XML and JSON example output
marc tobias [Fri, 4 Aug 2023 11:15:50 +0000 (13:15 +0200)]
Search.md - update XML and JSON example output

16 months agoMerge pull request #3146 from lonvia/forbid-mixed-queries
Sarah Hoffmann [Tue, 8 Aug 2023 15:34:32 +0000 (17:34 +0200)]
Merge pull request #3146 from lonvia/forbid-mixed-queries

Do not allow to mix structured and unstructured search

16 months agoreturn an error when q is used together with structured parameters
Sarah Hoffmann [Tue, 8 Aug 2023 13:54:55 +0000 (15:54 +0200)]
return an error when q is used together with structured parameters

16 months agoremove lookup by address only
Sarah Hoffmann [Sun, 6 Aug 2023 17:20:10 +0000 (19:20 +0200)]
remove lookup by address only

There are too many lookups where the address is very frequent,
even when many address parts are present.

16 months agoallow oversized viewboxes again
Sarah Hoffmann [Sun, 6 Aug 2023 15:47:47 +0000 (17:47 +0200)]
allow oversized viewboxes again

This seems to be a rather regular thing when unconditionally sending
the current view and being zoomed out.

Fixes #3137.

16 months agoprovide full URL in more field
Sarah Hoffmann [Sun, 6 Aug 2023 15:20:16 +0000 (17:20 +0200)]
provide full URL in more field

This is a regression against the PHP version.

Fixes #3138.

16 months agoremove SQL lambdas with IN expressions
Sarah Hoffmann [Wed, 2 Aug 2023 10:34:07 +0000 (12:34 +0200)]
remove SQL lambdas with IN expressions

The values of IN expressions are incorrectly cached.

16 months agoonly print non-empty search tables
Sarah Hoffmann [Tue, 1 Aug 2023 13:29:00 +0000 (15:29 +0200)]
only print non-empty search tables

16 months agodo not lookup by address vector when only few tokens are available
Sarah Hoffmann [Mon, 31 Jul 2023 12:27:39 +0000 (14:27 +0200)]
do not lookup by address vector when only few tokens are available

Names of countries and states are exceedingly rare in the word count
but are very frequent in the address. A short name has the danger
of producing too many results.

16 months agofix regression with lat/lon in json output
Sarah Hoffmann [Tue, 1 Aug 2023 10:21:11 +0000 (12:21 +0200)]
fix regression with lat/lon in json output

lat, lon is returned as strings in the PHP output. Reproduce that in the
Python frontend.

See #3115.

16 months agoallow OPTIONS method in starlette CORS middleware
Sarah Hoffmann [Tue, 1 Aug 2023 09:12:36 +0000 (11:12 +0200)]
allow OPTIONS method in starlette CORS middleware

If not allowed, then the middleware will return a 400 on pre-flight
CORS requests.

Fixes #3129.

16 months agoMerge pull request #3122 from miku0/sanitizer-final
Sarah Hoffmann [Tue, 1 Aug 2023 08:38:58 +0000 (10:38 +0200)]
Merge pull request #3122 from miku0/sanitizer-final

Adds sanitizer for Japanese addresses to correspond to block address

16 months agoMoved KANJI_MAP to icu-rules
miku0 [Mon, 31 Jul 2023 11:57:49 +0000 (11:57 +0000)]
Moved KANJI_MAP to icu-rules

16 months agoMerge pull request #3128 from lonvia/fix-classtype-lookup
Sarah Hoffmann [Mon, 31 Jul 2023 08:20:58 +0000 (10:20 +0200)]
Merge pull request #3128 from lonvia/fix-classtype-lookup

Fix query over classtype tables

16 months agoAdd the test of reconbine_place
miku0 [Mon, 31 Jul 2023 02:39:56 +0000 (02:39 +0000)]
Add the test of reconbine_place

16 months agoFixed cosmetic issues
miku0 [Mon, 31 Jul 2023 02:39:04 +0000 (02:39 +0000)]
Fixed cosmetic issues

16 months agofix query over classtype tables
Sarah Hoffmann [Sun, 30 Jul 2023 21:51:36 +0000 (23:51 +0200)]
fix query over classtype tables

The case statement prevented the index on the classtype tables
from being used. Move the case statement inside the geometry
function instead.

16 months agoMerge pull request #3127 from lonvia/file-logging
Sarah Hoffmann [Sun, 30 Jul 2023 19:22:48 +0000 (21:22 +0200)]
Merge pull request #3127 from lonvia/file-logging

Add file logging for Python frontend

16 months agoreintroduce file logging for Python frontend
Sarah Hoffmann [Sun, 30 Jul 2023 17:58:00 +0000 (19:58 +0200)]
reintroduce file logging for Python frontend

16 months agoadd @fail-legacy
miku0 [Thu, 27 Jul 2023 07:33:53 +0000 (07:33 +0000)]
add @fail-legacy

16 months agoMoved KANJI_MAP to global variable
miku0 [Wed, 26 Jul 2023 21:43:22 +0000 (21:43 +0000)]
Moved KANJI_MAP to global variable

16 months agoMerge pull request #3125 from lonvia/warm-to-python
Sarah Hoffmann [Wed, 26 Jul 2023 20:37:37 +0000 (22:37 +0200)]
Merge pull request #3125 from lonvia/warm-to-python

Port warm and export functions to Python

16 months agoolder version of Postgres cannot convert jsonb to int
Sarah Hoffmann [Wed, 26 Jul 2023 15:45:21 +0000 (17:45 +0200)]
older version of Postgres cannot convert jsonb to int

16 months agoolder Python versions need a reference to the loop for a lock
Sarah Hoffmann [Wed, 26 Jul 2023 13:17:18 +0000 (15:17 +0200)]
older Python versions need a reference to the loop for a lock

16 months agoCorrection to PR's comment
miku0 [Wed, 26 Jul 2023 09:50:25 +0000 (09:50 +0000)]
Correction to PR's comment

16 months agoadd tests for new arm and export Python functions
Sarah Hoffmann [Wed, 26 Jul 2023 09:09:52 +0000 (11:09 +0200)]
add tests for new arm and export Python functions

16 months agoadd japanese sanitizer
miku0 [Wed, 26 Jul 2023 07:54:58 +0000 (07:54 +0000)]
add japanese sanitizer

16 months agomostly remove php-cgi requirement
Sarah Hoffmann [Tue, 25 Jul 2023 22:10:11 +0000 (00:10 +0200)]
mostly remove php-cgi requirement

This is now only needed for BDD tests against the php API.

16 months agoremove now unused run_api_script function
Sarah Hoffmann [Tue, 25 Jul 2023 20:45:29 +0000 (22:45 +0200)]
remove now unused run_api_script function

16 months agoremove now unused run_legacy_script()
Sarah Hoffmann [Thu, 20 Jul 2023 10:14:19 +0000 (12:14 +0200)]
remove now unused run_legacy_script()

16 months agoport export function to Python
Sarah Hoffmann [Mon, 17 Jul 2023 20:37:07 +0000 (22:37 +0200)]
port export function to Python

Some of the parameters have been renoved as they don't make sense
anymore.

16 months agomove warm script to python code
Sarah Hoffmann [Sun, 16 Jul 2023 18:12:53 +0000 (20:12 +0200)]
move warm script to python code

16 months agoMerge pull request #3121 from lonvia/port-remaining-api-calls
Sarah Hoffmann [Tue, 25 Jul 2023 18:56:38 +0000 (20:56 +0200)]
Merge pull request #3121 from lonvia/port-remaining-api-calls

Port remaining API endpoints to Python

16 months agoadd tests for new endpoints
Sarah Hoffmann [Tue, 25 Jul 2023 08:57:19 +0000 (10:57 +0200)]
add tests for new endpoints

17 months agoadd /polygons endpoint to Python v1 API
Sarah Hoffmann [Sat, 22 Jul 2023 18:59:13 +0000 (20:59 +0200)]
add /polygons endpoint to Python v1 API

17 months agoadd deletable endpoint
Sarah Hoffmann [Sat, 22 Jul 2023 15:21:24 +0000 (17:21 +0200)]
add deletable endpoint

17 months agoremove debug print
Sarah Hoffmann [Sat, 22 Jul 2023 11:54:23 +0000 (13:54 +0200)]
remove debug print

17 months agoMerge pull request #3117 from lonvia/fix-assorted-search-errors
Sarah Hoffmann [Sat, 22 Jul 2023 09:45:36 +0000 (11:45 +0200)]
Merge pull request #3117 from lonvia/fix-assorted-search-errors

More improvements to the Python search algorithm

17 months agodisallow special housenumber search with a single frequent partial
Sarah Hoffmann [Thu, 20 Jul 2023 16:05:54 +0000 (18:05 +0200)]
disallow special housenumber search with a single frequent partial

17 months agodo not split names from typed phrases
Sarah Hoffmann [Mon, 17 Jul 2023 14:25:39 +0000 (16:25 +0200)]
do not split names from typed phrases

When phrases are typed, they should only contain exactly one term.

17 months agosplit up get_assignment functon in more readable parts
Sarah Hoffmann [Mon, 17 Jul 2023 13:17:54 +0000 (15:17 +0200)]
split up get_assignment functon in more readable parts

17 months agodisallow address searches that start with a postcode
Sarah Hoffmann [Mon, 17 Jul 2023 09:45:35 +0000 (11:45 +0200)]
disallow address searches that start with a postcode

These are postcode searches and nothing else.

17 months agoblock search queries with too many tokens
Sarah Hoffmann [Sat, 15 Jul 2023 14:31:39 +0000 (16:31 +0200)]
block search queries with too many tokens

17 months agosimplify yield_lookups() function
Sarah Hoffmann [Sat, 15 Jul 2023 09:41:31 +0000 (11:41 +0200)]
simplify yield_lookups() function

Move creation of field lookups in separate functions to make the code
more readable.

17 months agopenalize name token splitting when phrases are used
Sarah Hoffmann [Sat, 15 Jul 2023 08:55:34 +0000 (10:55 +0200)]
penalize name token splitting when phrases are used

17 months agopenalize search with frequent partials
Sarah Hoffmann [Fri, 14 Jul 2023 19:55:07 +0000 (21:55 +0200)]
penalize search with frequent partials

Avoid search against frequent partials if we have already looked for
the full name equivalents.

17 months agoavoid splitting of first token when a housenumber is present
Sarah Hoffmann [Fri, 14 Jul 2023 19:05:13 +0000 (21:05 +0200)]
avoid splitting of first token when a housenumber is present

This only covers the case of <poi name> <street name> <housenumber>
which is exceedingly rare.

17 months agoincrease threshold for full name searches
Sarah Hoffmann [Fri, 14 Jul 2023 19:03:42 +0000 (21:03 +0200)]
increase threshold for full name searches

They still should be preferrred over expensive partial name searches.

17 months agofix search for housenumber names
Sarah Hoffmann [Thu, 13 Jul 2023 14:43:56 +0000 (16:43 +0200)]
fix search for housenumber names

The search still included a lookup of housenumbers in children which is
wrong.

17 months agoMerge pull request #3112 from jenkin/fix-polgyon-polygon-typo
Sarah Hoffmann [Mon, 17 Jul 2023 12:20:14 +0000 (14:20 +0200)]
Merge pull request #3112 from jenkin/fix-polgyon-polygon-typo

fix polgyon polygon typo

17 months agofix polgyon polygon typo
Alessio Cimarelli [Mon, 17 Jul 2023 08:11:57 +0000 (10:11 +0200)]
fix polgyon polygon typo

17 months agoMerge pull request #3110 from lonvia/sql-lambda-queries
Sarah Hoffmann [Fri, 14 Jul 2023 16:57:31 +0000 (18:57 +0200)]
Merge pull request #3110 from lonvia/sql-lambda-queries

Use SQLAlchemy's lambda statements

17 months agoselected lambdas for search
Sarah Hoffmann [Wed, 12 Jul 2023 19:16:46 +0000 (21:16 +0200)]
selected lambdas for search

17 months agoadd lambdas for layer filters
Sarah Hoffmann [Wed, 12 Jul 2023 12:33:29 +0000 (14:33 +0200)]
add lambdas for layer filters

17 months agoavoid forwarding variables via SQL
Sarah Hoffmann [Wed, 12 Jul 2023 12:04:30 +0000 (14:04 +0200)]
avoid forwarding variables via SQL

17 months agomake SQL statements in reverse lambda functions
Sarah Hoffmann [Wed, 12 Jul 2023 09:46:07 +0000 (11:46 +0200)]
make SQL statements in reverse lambda functions

Further improves internal caching of statements by SQLAlchemy.

17 months agoMerge pull request #3096 from alfmarcua/search-within-countries-parameter
Sarah Hoffmann [Wed, 12 Jul 2023 15:45:55 +0000 (17:45 +0200)]
Merge pull request #3096 from alfmarcua/search-within-countries-parameter

Parameterise the search only within countries

17 months agoSplit lookupInCountry in two functions and document NOMINATIM_SEARCH_WITHIN_COUNTRIES...
alfmarcua [Thu, 6 Jul 2023 06:52:12 +0000 (08:52 +0200)]
Split lookupInCountry in two functions and document NOMINATIM_SEARCH_WITHIN_COUNTRIES parameter