]> git.openstreetmap.org Git - nominatim.git/commit
projects / nominatim.git / commit
? search:
summary | shortlog | log | commit | commitdiff | tree
(parent: 6ba00e6) | patch
move abbreviation computation into import phase
authorSarah Hoffmann <lonvia@denofr.de>
Fri, 28 May 2021 20:06:13 +0000 (22:06 +0200)
committerSarah Hoffmann <lonvia@denofr.de>
Sun, 4 Jul 2021 08:28:20 +0000 (10:28 +0200)
commit8413075249e1bb2832df4edd0f66d61f77fb9f99
tree58e9eff6709ef97120c46b925986b49440a0bc56tree | snapshot
parent6ba00e6aee2645ad958857a0df170915c8e59cdbcommit | diff
move abbreviation computation into import phase

This adds precomputation of abbreviated terms for names and removes
abbreviation of terms in the query. Basic import works but still
needs some thorough testing as well as speed improvements during
import.

New dependency for python library datrie.
lib-php/tokenizer/legacy_icu_tokenizer.php diff | blob | history
lib-sql/tokenizer/legacy_icu_tokenizer.sql diff | blob | history
nominatim/tokenizer/icu_name_processor.py [new file with mode: 0644] blob
nominatim/tokenizer/icu_rule_loader.py [new file with mode: 0644] blob
nominatim/tokenizer/legacy_icu_tokenizer.py diff | blob | history
nominatim/tokenizer/legacy_tokenizer.py diff | blob | history
nominatim/tools/database_import.py diff | blob | history
settings/legacy_icu_tokenizer.yaml [new file with mode: 0644] blob
test/python/test_tokenizer_icu_name_processor.py [new file with mode: 0644] blob
test/python/test_tokenizer_icu_rule_loader.py [new file with mode: 0644] blob
Open Source search based on OpenStreetMap data