]> git.openstreetmap.org Git - nominatim.git/commit
add japanese phrase preprocessing
authorSarah Hoffmann <lonvia@denofr.de>
Wed, 8 Jan 2025 18:43:25 +0000 (19:43 +0100)
committerSarah Hoffmann <lonvia@denofr.de>
Thu, 9 Jan 2025 08:24:10 +0000 (09:24 +0100)
commitefc09a5cfcfa85663db7d2a4deb86808a0a72de6
tree979f2da5af89140a8dfe9a06ac9de604b1778100
parent86ad9efa8abb1fb478b3be5b6c469877aad05a51
add japanese phrase preprocessing

Code adapted from GSOC code by @miku.
settings/icu_tokenizer.yaml
src/nominatim_api/query_preprocessing/split_japanese_phrases.py [new file with mode: 0644]
test/python/api/query_processing/test_split_japanese_phrases.py [new file with mode: 0644]