]> git.openstreetmap.org Git - nominatim.git/commit
generalize normalization step for search query
authorSarah Hoffmann <lonvia@denofr.de>
Fri, 13 Dec 2024 10:53:10 +0000 (11:53 +0100)
committerSarah Hoffmann <lonvia@denofr.de>
Fri, 13 Dec 2024 13:31:08 +0000 (14:31 +0100)
commit2b87c016db1dd7a03b5cafe385209529a7457fc6
tree07cbaf92f4a3da99d796ebfa97982f517116d4cd
parent046665f8d9b0cd11d59c8470e34833bc02b569ce
generalize normalization step for search query

It is now possible to configure functions for changing the query
input before it is analysed by the tokenizer.

Code is a cleaned-up version of the implementation by @miku.
settings/icu_tokenizer.yaml
src/nominatim_api/connection.py
src/nominatim_api/core.py
src/nominatim_api/query_preprocessing/__init__.py [new file with mode: 0644]
src/nominatim_api/query_preprocessing/base.py [new file with mode: 0644]
src/nominatim_api/query_preprocessing/config.py [new file with mode: 0644]
src/nominatim_api/query_preprocessing/normalize.py [new file with mode: 0644]
src/nominatim_api/search/icu_tokenizer.py
src/nominatim_api/typing.py
test/python/api/query_processing/test_normalize.py [new file with mode: 0644]