X-Git-Url: https://git.openstreetmap.org./nominatim.git/blobdiff_plain/4a41bff3ab52d64bd76275e6a337a3fab3922065..9a1f891998d9b56481b96b5201317494987302e1:/docs/customize/Tokenizers.md diff --git a/docs/customize/Tokenizers.md b/docs/customize/Tokenizers.md index 5c766f50..d849eb48 100644 --- a/docs/customize/Tokenizers.md +++ b/docs/customize/Tokenizers.md @@ -181,6 +181,13 @@ The following is a list of sanitizers that are shipped with Nominatim. rendering: heading_level: 6 +##### clean-housenumbers + +::: nominatim.tokenizer.sanitizers.clean_housenumbers + selection: + members: False + rendering: + heading_level: 6 #### Token Analysis @@ -199,15 +206,16 @@ by a sanitizer (see for example the The token-analysis section contains the list of configured analyzers. Each analyzer must have an `id` parameter that uniquely identifies the analyzer. The only exception is the default analyzer that is used when no special -analyzer was selected. +analyzer was selected. There is one special id '@housenumber'. If an analyzer +with that name is present, it is used for normalization of house numbers. Different analyzer implementations may exist. To select the implementation, -the `analyzer` parameter must be set. Currently there is only one implementation -`generic` which is described in the following. +the `analyzer` parameter must be set. The different implementations are +described in the following. ##### Generic token analyzer -The generic analyzer is able to create variants from a list of given +The generic analyzer `generic` is able to create variants from a list of given abbreviation and decomposition replacements and introduce spelling variations. ###### Variants @@ -324,6 +332,14 @@ the mode by adding: to the analyser configuration. +##### Housenumber token analyzer + +The analyzer `housenumbers` is purpose-made to analyze house numbers. It +creates variants with optional spaces between numbers and letters. Thus, +house numbers of the form '3 a', '3A', '3-A' etc. are all considered equivalent. + +The analyzer cannot be customized. + ### Reconfiguration Changing the configuration after the import is currently not possible, although