From: Sarah Hoffmann <lonvia@denofr.de>
Date: Fri, 1 Oct 2021 19:53:34 +0000 (+0200)
Subject: Merge pull request #2458 from lonvia/add-tokenizer-preprocessing
X-Git-Tag: v4.0.0~23
X-Git-Url: https://git.openstreetmap.org./nominatim.git/commitdiff_plain/19d4e047f6d3c525f64978e0965d75556bfc5b1e?hp=6b348d43c61bc825c8d9cd208b1ef34c8d7951fa

Merge pull request #2458 from lonvia/add-tokenizer-preprocessing

Add a "sanitation" step for name and address tags before token processing
---