X-Git-Url: https://git.openstreetmap.org./nominatim.git/blobdiff_plain/8dd218a1d0142379357cb48a8011830c935b6952..f76dbb0a167fa49839c30da1a4e1d15439070e2a:/docs/customize/Tokenizers.md diff --git a/docs/customize/Tokenizers.md b/docs/customize/Tokenizers.md index 3c29972d..d290c148 100644 --- a/docs/customize/Tokenizers.md +++ b/docs/customize/Tokenizers.md @@ -50,7 +50,7 @@ queries. This happens in two stages: as during the import process but may involve other processing like, for example, word break detection. 2. The **token analysis** step breaks down the query parts into tokens, - looks them up in the database and assignes them possible functions and + looks them up in the database and assigns them possible functions and probabilities. Query processing can be further customized while the rest of the analysis