]> git.openstreetmap.org Git - nominatim.git/log
nominatim.git
4 years agonominatim.py: use async in connect() function
Sarah Hoffmann [Tue, 11 Feb 2020 21:08:04 +0000 (22:08 +0100)]
nominatim.py: use async in connect() function

The _async parameter name is only supported since psycopg 2.7.
However, async is a keyword in Python >= 3.7, so using this
gives us a syntax error. Working around this by defining the
parameters in a dict and handing that into the connect function.

4 years agonominatim.py: also catch deadlocks on final wait
Sarah Hoffmann [Tue, 11 Feb 2020 21:00:24 +0000 (22:00 +0100)]
nominatim.py: also catch deadlocks on final wait

4 years agoregularly close connection while indexing
Sarah Hoffmann [Sun, 9 Feb 2020 12:57:36 +0000 (13:57 +0100)]
regularly close connection while indexing

Postgres sooner or later runs out of memory when the connection
is used for too long.

4 years agoMerge pull request #1667 from mtmail/setup-delete-invalid-indices
Sarah Hoffmann [Sun, 9 Feb 2020 13:21:17 +0000 (14:21 +0100)]
Merge pull request #1667 from mtmail/setup-delete-invalid-indices

setup: delete invalid indices in create-search-indices step

4 years agoRemove hack that changes the class/type of cities
Sarah Hoffmann [Sun, 9 Feb 2020 11:14:32 +0000 (12:14 +0100)]
Remove hack that changes the class/type of cities

This interferes badly with the details view.

Fixes #1668.

4 years agosetup: delete invalid indices in create-search-indices step
marc tobias [Sat, 8 Feb 2020 14:16:20 +0000 (15:16 +0100)]
setup: delete invalid indices in create-search-indices step

4 years agoMerge pull request #1665 from mtmail/centos7-php7
Sarah Hoffmann [Fri, 7 Feb 2020 19:43:49 +0000 (20:43 +0100)]
Merge pull request #1665 from mtmail/centos7-php7

CentOS7: update from PHP 5.4 to 7.2, add psycopg2

4 years agoMerge pull request #1666 from mtmail/ubuntu-installs-add-psycopg2
Sarah Hoffmann [Fri, 7 Feb 2020 19:42:38 +0000 (20:42 +0100)]
Merge pull request #1666 from mtmail/ubuntu-installs-add-psycopg2

Vagrant Ubuntu: psycopg2 is required

4 years agoVagrant Ubuntu: psycopg2 is required
marc tobias [Fri, 7 Feb 2020 14:26:09 +0000 (15:26 +0100)]
Vagrant Ubuntu: psycopg2 is required

4 years agoCentOS7: update from PHP 5.4 to 7.2
marc tobias [Fri, 7 Feb 2020 14:18:46 +0000 (15:18 +0100)]
CentOS7: update from PHP 5.4 to 7.2

4 years agoMerge pull request #1663 from mtmail/vagrant-centos-8
Sarah Hoffmann [Thu, 6 Feb 2020 20:12:28 +0000 (21:12 +0100)]
Merge pull request #1663 from mtmail/vagrant-centos-8

Vagrant setup for CentOS 8

4 years agoMerge pull request #1664 from mtmail/check-import-finished-for-reverse-only
Sarah Hoffmann [Thu, 6 Feb 2020 20:07:04 +0000 (21:07 +0100)]
Merge pull request #1664 from mtmail/check-import-finished-for-reverse-only

check_import_finished.php - reverse_only mode has less indices

4 years agocheck_import_finished.php - reverse_only mode has less indices
marc tobias [Thu, 6 Feb 2020 15:46:54 +0000 (16:46 +0100)]
check_import_finished.php - reverse_only mode has less indices

4 years agoVagrant setup for CentOS 8
marc tobias [Mon, 3 Feb 2020 12:13:46 +0000 (13:13 +0100)]
Vagrant setup for CentOS 8

4 years agodetails html page: no longer use place_id in URLs
marc tobias [Sun, 2 Feb 2020 00:16:31 +0000 (01:16 +0100)]
details html page: no longer use place_id in URLs

4 years agofix verboseness of nominiatim script during updates
Sarah Hoffmann [Fri, 31 Jan 2020 17:17:42 +0000 (18:17 +0100)]
fix verboseness of nominiatim script during updates

4 years agoMerge pull request #1648 from lonvia/nominatim-as-python-script
Sarah Hoffmann [Fri, 31 Jan 2020 16:53:49 +0000 (17:53 +0100)]
Merge pull request #1648 from lonvia/nominatim-as-python-script

Replace C Nominatim indexer with Python script

4 years agoremove libxml dependency for travis as well
Sarah Hoffmann [Wed, 29 Jan 2020 10:54:20 +0000 (11:54 +0100)]
remove libxml dependency for travis as well

4 years agofix typo
Sarah Hoffmann [Wed, 29 Jan 2020 10:50:30 +0000 (11:50 +0100)]
fix typo

4 years agoalso adapt indexing command in update script
Sarah Hoffmann [Wed, 29 Jan 2020 10:36:12 +0000 (11:36 +0100)]
also adapt indexing command in update script

4 years agoupdate cMake build documentation
Sarah Hoffmann [Fri, 24 Jan 2020 21:53:26 +0000 (22:53 +0100)]
update cMake build documentation

Remove the dependency on libxml, no longer needed.

4 years agoforgot to index last rank
Sarah Hoffmann [Wed, 22 Jan 2020 10:18:21 +0000 (11:18 +0100)]
forgot to index last rank

4 years agoreplace nominatim C program
Sarah Hoffmann [Tue, 21 Jan 2020 20:57:07 +0000 (21:57 +0100)]
replace nominatim C program

4 years agofix log levels
Sarah Hoffmann [Mon, 20 Jan 2020 22:34:56 +0000 (23:34 +0100)]
fix log levels

4 years agoadd time display for nominatim.py
Sarah Hoffmann [Mon, 20 Jan 2020 22:17:52 +0000 (23:17 +0100)]
add time display for nominatim.py

4 years agoclean up and document script
Sarah Hoffmann [Mon, 20 Jan 2020 21:19:33 +0000 (22:19 +0100)]
clean up and document script

4 years agofix SQL and some other stuff
Sarah Hoffmann [Sun, 19 Jan 2020 23:05:28 +0000 (00:05 +0100)]
fix SQL and some other stuff

4 years agoRevert "switch to threading"
Sarah Hoffmann [Sun, 19 Jan 2020 20:56:37 +0000 (21:56 +0100)]
Revert "switch to threading"

This reverts commit 8b1c2181be5aa5335c68d36a49cab9c4e2cd8bef.

4 years agoswitch to threading
Sarah Hoffmann [Sun, 19 Jan 2020 20:56:20 +0000 (21:56 +0100)]
switch to threading

4 years agouse generator for thread choice
Sarah Hoffmann [Sun, 19 Jan 2020 13:51:15 +0000 (14:51 +0100)]
use generator for thread choice

4 years agoadd prepared statement
Sarah Hoffmann [Sun, 19 Jan 2020 13:06:48 +0000 (14:06 +0100)]
add prepared statement

4 years agosimple implementation
Sarah Hoffmann [Sun, 19 Jan 2020 12:37:45 +0000 (13:37 +0100)]
simple implementation

4 years agoMerge pull request #1647 from lonvia/split-out-linking
Sarah Hoffmann [Fri, 24 Jan 2020 20:55:19 +0000 (21:55 +0100)]
Merge pull request #1647 from lonvia/split-out-linking

Split up placex update trigger code

4 years agofix indent
Sarah Hoffmann [Fri, 24 Jan 2020 20:16:26 +0000 (21:16 +0100)]
fix indent

4 years agorename functions where return parameter changed
Sarah Hoffmann [Thu, 23 Jan 2020 21:24:41 +0000 (22:24 +0100)]
rename functions where return parameter changed

Postgresql cannot cleanly reimport these functions when
upgrading, so simply rename to avoid errors.

4 years agoforgot new trigger sql
Sarah Hoffmann [Sat, 18 Jan 2020 22:49:38 +0000 (23:49 +0100)]
forgot new trigger sql

4 years agoadapt index for changes name lookup
Sarah Hoffmann [Fri, 17 Jan 2020 16:47:10 +0000 (17:47 +0100)]
adapt index for changes name lookup

4 years agomove trigger creation later in setup
Sarah Hoffmann [Thu, 16 Jan 2020 21:53:52 +0000 (22:53 +0100)]
move trigger creation later in setup

4 years agoclean up get_word_id function
Sarah Hoffmann [Thu, 16 Jan 2020 21:08:37 +0000 (22:08 +0100)]
clean up get_word_id function

Replaced by addr_ids_from_name() which also normalises the
string.

4 years agogetNearestNamed*Feature functions better return values
Sarah Hoffmann [Thu, 16 Jan 2020 20:43:26 +0000 (21:43 +0100)]
getNearestNamed*Feature functions better return values

4 years agofactor out parent search from addr:street/addr:place
Sarah Hoffmann [Thu, 16 Jan 2020 20:17:19 +0000 (21:17 +0100)]
factor out parent search from addr:street/addr:place

4 years agofactor out searching for parent road for pois
Sarah Hoffmann [Thu, 16 Jan 2020 19:26:17 +0000 (20:26 +0100)]
factor out searching for parent road for pois

4 years agoremove unused function
Sarah Hoffmann [Thu, 16 Jan 2020 16:31:31 +0000 (17:31 +0100)]
remove unused function

4 years agofactor out computation of default names
Sarah Hoffmann [Wed, 15 Jan 2020 23:11:32 +0000 (00:11 +0100)]
factor out computation of default names

Also moves the computation down the line so that we never
have to do it twice.

4 years agofactor out place linking sql
Sarah Hoffmann [Wed, 15 Jan 2020 21:01:33 +0000 (22:01 +0100)]
factor out place linking sql

4 years agoadapt test to change in hamlet classification
Sarah Hoffmann [Thu, 23 Jan 2020 21:26:47 +0000 (22:26 +0100)]
adapt test to change in hamlet classification

4 years agodoc: clarify the influence of autovacuum on memory
Sarah Hoffmann [Wed, 22 Jan 2020 11:02:38 +0000 (12:02 +0100)]
doc: clarify the influence of autovacuum on memory

4 years agodocs: add a note that the faltnode file is needed for updates
Sarah Hoffmann [Wed, 22 Jan 2020 10:44:05 +0000 (11:44 +0100)]
docs: add a note that the faltnode file is needed for updates

Fixes #1644.

4 years agoMerge pull request #1638 from mtmail/check-for-invalid-indices
Sarah Hoffmann [Tue, 14 Jan 2020 20:34:35 +0000 (21:34 +0100)]
Merge pull request #1638 from mtmail/check-for-invalid-indices

check_import_finished: check for invalid indices

4 years agohint that invalid indices must be manually deleted
Sarah Hoffmann [Tue, 14 Jan 2020 20:33:09 +0000 (21:33 +0100)]
hint that invalid indices must be manually deleted

4 years agoMerge pull request #1637 from mtmail/fix-warnings-in-verbose-warm
Sarah Hoffmann [Tue, 14 Jan 2020 20:30:46 +0000 (21:30 +0100)]
Merge pull request #1637 from mtmail/fix-warnings-in-verbose-warm

warm.php verbose mode was printing errors

4 years agoMerge pull request #1636 from lonvia/update-introduction
Sarah Hoffmann [Tue, 14 Jan 2020 20:29:25 +0000 (21:29 +0100)]
Merge pull request #1636 from lonvia/update-introduction

Update help text on website

4 years agocheck_import_finished: check for invalid indices
marc tobias [Tue, 14 Jan 2020 18:36:40 +0000 (19:36 +0100)]
check_import_finished: check for invalid indices

4 years agowarm.php verbose mode was printing errors
marc tobias [Tue, 14 Jan 2020 17:24:49 +0000 (18:24 +0100)]
warm.php verbose mode was printing errors

4 years agoupdate report a problem page
Sarah Hoffmann [Mon, 13 Jan 2020 21:42:49 +0000 (22:42 +0100)]
update report a problem page

4 years agoupdate help links
Sarah Hoffmann [Mon, 13 Jan 2020 21:20:53 +0000 (22:20 +0100)]
update help links

All links should go to nominatim.org now. Also add links
to Help OSM and the Github repository.

4 years agoremove special handling of rail
Sarah Hoffmann [Wed, 8 Jan 2020 22:53:23 +0000 (23:53 +0100)]
remove special handling of rail

Skip railway=rail in the style, so that installations can remove
it if they wish.

4 years agoupdate place address levels
Sarah Hoffmann [Wed, 8 Jan 2020 21:44:56 +0000 (22:44 +0100)]
update place address levels

Adds province and allotments and downgrades hamlet.

4 years agoMerge pull request #1628 from lonvia/split-sql-functions
Sarah Hoffmann [Wed, 8 Jan 2020 20:36:40 +0000 (21:36 +0100)]
Merge pull request #1628 from lonvia/split-sql-functions

Split monstrous functions.sql

4 years agoremove remaining sql functions into function/ directory
Sarah Hoffmann [Wed, 8 Jan 2020 10:45:51 +0000 (11:45 +0100)]
remove remaining sql functions into function/ directory

4 years agomove postcode table triggers to own file
Sarah Hoffmann [Wed, 8 Jan 2020 10:22:23 +0000 (11:22 +0100)]
move postcode table triggers to own file

4 years agomove placex triggers into own file
Sarah Hoffmann [Wed, 8 Jan 2020 10:18:42 +0000 (11:18 +0100)]
move placex triggers into own file

4 years agomove place triggers into own file
Sarah Hoffmann [Tue, 7 Jan 2020 22:54:42 +0000 (23:54 +0100)]
move place triggers into own file

4 years agomove functions for interpolation table in own file
Sarah Hoffmann [Sun, 5 Jan 2020 15:32:12 +0000 (16:32 +0100)]
move functions for interpolation table in own file

4 years agomove functions for address lookup into own file
Sarah Hoffmann [Sun, 5 Jan 2020 15:16:21 +0000 (16:16 +0100)]
move functions for address lookup into own file

4 years agomove creation function for aux data into own file
Sarah Hoffmann [Sun, 5 Jan 2020 15:04:04 +0000 (16:04 +0100)]
move creation function for aux data into own file

This function is currently unused, so don't even load it.

4 years agomove importance/wikipedia functions into separate file
Sarah Hoffmann [Sun, 5 Jan 2020 14:55:39 +0000 (15:55 +0100)]
move importance/wikipedia functions into separate file

4 years agomove SQL functions for normalisation in separate file
Sarah Hoffmann [Sun, 5 Jan 2020 14:38:20 +0000 (15:38 +0100)]
move SQL functions for normalisation in separate file

4 years agoMerge pull request #1627 from lonvia/cleanup-setup-scripts
Sarah Hoffmann [Sun, 5 Jan 2020 13:17:39 +0000 (14:17 +0100)]
Merge pull request #1627 from lonvia/cleanup-setup-scripts

Minor cleanup of setup scripts

4 years agosetup: factor out parameter replacement in SQL scripts
Sarah Hoffmann [Sat, 4 Jan 2020 22:41:55 +0000 (23:41 +0100)]
setup: factor out parameter replacement in SQL scripts

Put all into a single function and use for all SQL
templates.

4 years agofix osm link in polygon error view
Sarah Hoffmann [Sat, 4 Jan 2020 20:50:22 +0000 (21:50 +0100)]
fix osm link in polygon error view

4 years agoMerge pull request #1626 from lonvia/move-tests-to-osm2pgsql
Sarah Hoffmann [Sat, 4 Jan 2020 19:08:35 +0000 (20:08 +0100)]
Merge pull request #1626 from lonvia/move-tests-to-osm2pgsql

Move tests to osm2pgsql

4 years agoremove osm2pgsql tag tests
Sarah Hoffmann [Sat, 4 Jan 2020 15:23:29 +0000 (16:23 +0100)]
remove osm2pgsql tag tests

These tests are now part of the osm2pgsql test suite.

4 years agoupdate osm2pgsql (gazetteer output tests)
Sarah Hoffmann [Sat, 4 Jan 2020 15:20:52 +0000 (16:20 +0100)]
update osm2pgsql (gazetteer output tests)

4 years agoMerge pull request #1624 from lonvia/add-extratags-style
Sarah Hoffmann [Fri, 3 Jan 2020 09:06:47 +0000 (10:06 +0100)]
Merge pull request #1624 from lonvia/add-extratags-style

Add new extratags style

4 years agoadd new extratags style
Sarah Hoffmann [Sun, 29 Dec 2019 10:47:10 +0000 (11:47 +0100)]
add new extratags style

This is the same as the full style but also adds all unused tags
except for a couple of internal tags to the extratags column.

4 years agoMerge pull request #1622 from mtmail/clang-faq-entry
Sarah Hoffmann [Thu, 2 Jan 2020 13:14:00 +0000 (14:14 +0100)]
Merge pull request #1622 from mtmail/clang-faq-entry

Documentation: add FAQ entry about clang not found

4 years agoupdate osm2pgsql (exclude country and postcode from address tags)
Sarah Hoffmann [Mon, 23 Dec 2019 14:17:04 +0000 (15:17 +0100)]
update osm2pgsql (exclude country and postcode from address tags)

4 years agoDocumentation: add FAQ entry about clang not found
marc tobias [Sat, 28 Dec 2019 20:21:39 +0000 (21:21 +0100)]
Documentation: add FAQ entry about clang not found

5 years agoMerge pull request #1612 from mtmail/cleanup-wiki-scripts
Sarah Hoffmann [Mon, 23 Dec 2019 21:05:39 +0000 (22:05 +0100)]
Merge pull request #1612 from mtmail/cleanup-wiki-scripts

refactor import_wiki* script for readability

5 years agoMerge pull request #1619 from mtmail/document-check-import-script
Sarah Hoffmann [Mon, 23 Dec 2019 21:04:25 +0000 (22:04 +0100)]
Merge pull request #1619 from mtmail/document-check-import-script

Use check_import_finished in test suite, document

5 years agorefactor import_wiki* script for readability
marc tobias [Wed, 18 Dec 2019 18:18:39 +0000 (19:18 +0100)]
refactor import_wiki* script for readability

5 years agoUse check_import_finished in test suite, document
marc tobias [Mon, 23 Dec 2019 20:25:06 +0000 (21:25 +0100)]
Use check_import_finished in test suite, document

5 years agonew script utils/check_import_finished.php
marc tobias [Mon, 2 Dec 2019 13:02:05 +0000 (14:02 +0100)]
new script utils/check_import_finished.php

5 years agoMerge pull request #1596 from mtmail/remove-obsolete-wikidata-scripts
Sarah Hoffmann [Wed, 18 Dec 2019 20:55:17 +0000 (21:55 +0100)]
Merge pull request #1596 from mtmail/remove-obsolete-wikidata-scripts

remove old wikidata script. See data-sources/wikipedia-wikidata/ for new process

5 years agoMerge pull request #1601 from mtmail/spheric-distance-on-details-page
Sarah Hoffmann [Wed, 18 Dec 2019 20:54:06 +0000 (21:54 +0100)]
Merge pull request #1601 from mtmail/spheric-distance-on-details-page

details page: differentiate between spheric distance and distance in meters

5 years agoremove duplicate addr:country from style
Sarah Hoffmann [Tue, 17 Dec 2019 19:48:27 +0000 (20:48 +0100)]
remove duplicate addr:country from style

5 years agoMerge pull request #1609 from txtor/master
Sarah Hoffmann [Tue, 17 Dec 2019 19:46:20 +0000 (20:46 +0100)]
Merge pull request #1609 from txtor/master

typo - fixes openstreetmap#1606

5 years agotypo - fixes openstreetmap#1606
Francesc Hervada-Sala [Tue, 17 Dec 2019 16:24:29 +0000 (17:24 +0100)]
typo - fixes openstreetmap#1606

5 years agoupdate osm2pgsql (deletion and address updates)
Sarah Hoffmann [Mon, 16 Dec 2019 20:27:41 +0000 (21:27 +0100)]
update osm2pgsql (deletion and address updates)

5 years agoMerge pull request #1604 from mtmail/wiki-create-pagelinkcount-earlier
Sarah Hoffmann [Sat, 14 Dec 2019 20:43:16 +0000 (21:43 +0100)]
Merge pull request #1604 from mtmail/wiki-create-pagelinkcount-earlier

wikipedia: create all language pagelinkcount tables before querying them

5 years agowikipedia: create all language pagelinkcount tables before querying them
marc tobias [Sat, 14 Dec 2019 19:36:54 +0000 (20:36 +0100)]
wikipedia: create all language pagelinkcount tables before querying them

5 years agodetails page: differentiate between spheric distance and distance in meters
marc tobias [Tue, 10 Dec 2019 23:49:32 +0000 (00:49 +0100)]
details page: differentiate between spheric distance and distance in meters

5 years agoremove old wikidata script. See data-sources/wikipedia-wikidata/ for new process
marc tobias [Sun, 1 Dec 2019 10:14:28 +0000 (11:14 +0100)]
remove old wikidata script. See data-sources/wikipedia-wikidata/ for new process

5 years agoadd test for finding housenumber 0
Sarah Hoffmann [Sun, 1 Dec 2019 19:36:59 +0000 (20:36 +0100)]
add test for finding housenumber 0

5 years agoMerge branch 'housenumber-zero' of https://github.com/mtmail/Nominatim into mtmail...
Sarah Hoffmann [Sun, 1 Dec 2019 19:17:27 +0000 (20:17 +0100)]
Merge branch 'housenumber-zero' of https://github.com/mtmail/Nominatim into mtmail-housenumber-zero

5 years agoMerge pull request #1585 from mmd-osm/patch-1
Sarah Hoffmann [Sun, 1 Dec 2019 19:13:35 +0000 (20:13 +0100)]
Merge pull request #1585 from mmd-osm/patch-1

Mention FAQ / troubleshooting page in README

5 years agobdd tests: enforce use of full import style
Sarah Hoffmann [Sun, 1 Dec 2019 15:25:39 +0000 (16:25 +0100)]
bdd tests: enforce use of full import style

5 years agoRevert "update osm2pgsql (reduce memory usage)"
Sarah Hoffmann [Sun, 1 Dec 2019 15:25:02 +0000 (16:25 +0100)]
Revert "update osm2pgsql (reduce memory usage)"

This reverts commit 347446489476151007902721ee828d55445e6159.

5 years agoupdate osm2pgsql (reduce memory usage)
Sarah Hoffmann [Fri, 29 Nov 2019 18:31:48 +0000 (19:31 +0100)]
update osm2pgsql (reduce memory usage)