X-Git-Url: https://git.openstreetmap.org./nominatim.git/blobdiff_plain/d3372e69eca75aad7a7decc17b5fd7a5ffc1b1f8..b726460a8f660242b9aa8df79845006275e22d19:/docs/customize/Tokenizers.md diff --git a/docs/customize/Tokenizers.md b/docs/customize/Tokenizers.md index 4a9d77bd..ee51fec0 100644 --- a/docs/customize/Tokenizers.md +++ b/docs/customize/Tokenizers.md @@ -52,7 +52,7 @@ NOMINATIM_DATABASE_MODULE_PATH= ``` This is in particular useful when the database runs on a different server. -See [Advanced installations](../admin/Advanced-Installations.md#importing-nominatim-to-an-external-postgresql-database) for details. +See [Advanced installations](../admin/Advanced-Installations.md#using-an-external-postgresql-database) for details. There are no other configuration options for the legacy tokenizer. All normalization functions are hard-coded. @@ -175,73 +175,65 @@ The following is a list of sanitizers that are shipped with Nominatim. ##### split-name-list -::: nominatim.tokenizer.sanitizers.split_name_list - selection: - members: False +::: nominatim_db.tokenizer.sanitizers.split_name_list options: + members: False heading_level: 6 docstring_section_style: spacy ##### strip-brace-terms -::: nominatim.tokenizer.sanitizers.strip_brace_terms - selection: - members: False +::: nominatim_db.tokenizer.sanitizers.strip_brace_terms options: + members: False heading_level: 6 docstring_section_style: spacy ##### tag-analyzer-by-language -::: nominatim.tokenizer.sanitizers.tag_analyzer_by_language - selection: - members: False +::: nominatim_db.tokenizer.sanitizers.tag_analyzer_by_language options: + members: False heading_level: 6 docstring_section_style: spacy ##### clean-housenumbers -::: nominatim.tokenizer.sanitizers.clean_housenumbers - selection: - members: False +::: nominatim_db.tokenizer.sanitizers.clean_housenumbers options: + members: False heading_level: 6 docstring_section_style: spacy ##### clean-postcodes -::: nominatim.tokenizer.sanitizers.clean_postcodes - selection: - members: False +::: nominatim_db.tokenizer.sanitizers.clean_postcodes options: + members: False heading_level: 6 docstring_section_style: spacy ##### clean-tiger-tags -::: nominatim.tokenizer.sanitizers.clean_tiger_tags - selection: - members: False +::: nominatim_db.tokenizer.sanitizers.clean_tiger_tags options: + members: False heading_level: 6 docstring_section_style: spacy #### delete-tags -::: nominatim.tokenizer.sanitizers.delete_tags - selection: - members: False +::: nominatim_db.tokenizer.sanitizers.delete_tags options: + members: False heading_level: 6 docstring_section_style: spacy #### tag-japanese -::: nominatim.tokenizer.sanitizers.tag_japanese - selection: - members: False +::: nominatim_db.tokenizer.sanitizers.tag_japanese options: + members: False heading_level: 6 docstring_section_style: spacy @@ -402,7 +394,7 @@ The analyzer cannot be customized. ##### Postcode token analyzer The analyzer `postcodes` is pupose-made to analyze postcodes. It supports -a 'lookup' varaint of the token, which produces variants with optional +a 'lookup' variant of the token, which produces variants with optional spaces. Use together with the clean-postcodes sanitizer. The analyzer cannot be customized.