]> git.openstreetmap.org Git - nominatim.git/log
nominatim.git
7 years agoadd postcodes as special items in word table
Sarah Hoffmann [Mon, 3 Jul 2017 20:13:01 +0000 (22:13 +0200)]
add postcodes as special items in word table

7 years agomake sure postcode gets recomputed on update
Sarah Hoffmann [Sun, 2 Jul 2017 14:28:02 +0000 (16:28 +0200)]
make sure postcode gets recomputed on update

7 years agouse only computed postcode when getting address
Sarah Hoffmann [Sun, 2 Jul 2017 12:16:48 +0000 (14:16 +0200)]
use only computed postcode when getting address

Postcodes from address parts are now ignored as they have
been already taken into account when computing the postcode.

7 years agoremove unused get_address_postcode function
Sarah Hoffmann [Sun, 2 Jul 2017 09:37:37 +0000 (11:37 +0200)]
remove unused get_address_postcode function

7 years agonormalize postcodes before adding to location tables
Sarah Hoffmann [Sun, 2 Jul 2017 09:32:32 +0000 (11:32 +0200)]
normalize postcodes before adding to location tables

7 years agoshow address tags and postcode in details
Sarah Hoffmann [Sat, 1 Jul 2017 21:16:01 +0000 (23:16 +0200)]
show address tags and postcode in details

7 years agoprecompute postcodes
Sarah Hoffmann [Sat, 1 Jul 2017 20:49:24 +0000 (22:49 +0200)]
precompute postcodes

Set postcode column to the best guess for the postcode for
the place.

7 years agoadd postcode to location_area tables
Sarah Hoffmann [Sat, 1 Jul 2017 17:02:25 +0000 (19:02 +0200)]
add postcode to location_area tables

7 years agoremove unused loaddata file
Sarah Hoffmann [Thu, 29 Jun 2017 21:39:31 +0000 (23:39 +0200)]
remove unused loaddata file

Load data is being done in the setup script.

7 years agoreplace AddGeometryColumn() functions
Sarah Hoffmann [Thu, 29 Jun 2017 21:34:09 +0000 (23:34 +0200)]
replace AddGeometryColumn() functions

Directly add the columns to the table definitions instead.

7 years agoremove now useless getNearestPostcode function
Sarah Hoffmann [Thu, 29 Jun 2017 21:13:40 +0000 (23:13 +0200)]
remove now useless getNearestPostcode function

Most postcodes are not in the location-area tables anymore.

7 years agoadd indexing of artificial postcodes
Sarah Hoffmann [Thu, 29 Jun 2017 19:39:00 +0000 (21:39 +0200)]
add indexing of artificial postcodes

7 years agoadd new location_postcode table
Sarah Hoffmann [Tue, 27 Jun 2017 19:10:34 +0000 (21:10 +0200)]
add new location_postcode table

Artifical postcode centroids are now saved in there.

7 years agofix syntax typo
Sarah Hoffmann [Mon, 14 Aug 2017 20:34:53 +0000 (22:34 +0200)]
fix syntax typo

7 years agoprepare for release 3.0.1 v3.0.1
Sarah Hoffmann [Sun, 13 Aug 2017 20:18:08 +0000 (22:18 +0200)]
prepare for release 3.0.1

7 years agoMerge pull request #779 from lonvia/update-osm2pgsql
Sarah Hoffmann [Wed, 26 Jul 2017 21:53:47 +0000 (23:53 +0200)]
Merge pull request #779 from lonvia/update-osm2pgsql

update osm2pgsql

7 years agoMerge pull request #776 from lonvia/vagrant-fix-country-paths
Sarah Hoffmann [Wed, 26 Jul 2017 21:44:00 +0000 (23:44 +0200)]
Merge pull request #776 from lonvia/vagrant-fix-country-paths

vagrant: download country data into correct directory

7 years agoupdate osm2pgsql
Sarah Hoffmann [Wed, 26 Jul 2017 21:40:14 +0000 (23:40 +0200)]
update osm2pgsql

Fixes #770.

7 years agoMerge pull request #778 from woodpeck/patch-1
Sarah Hoffmann [Sun, 23 Jul 2017 19:01:51 +0000 (21:01 +0200)]
Merge pull request #778 from woodpeck/patch-1

Mention explicitly that Osmosis is not required.

7 years agoMention explicitly that Osmosis is not required.
Frederik Ramm [Fri, 21 Jul 2017 07:23:38 +0000 (09:23 +0200)]
Mention explicitly that Osmosis is not required.

7 years agoMerge pull request #775 from lonvia/code-coverage
Sarah Hoffmann [Mon, 17 Jul 2017 21:19:41 +0000 (23:19 +0200)]
Merge pull request #775 from lonvia/code-coverage

enable code coverage computation for API BDD tests

7 years agovagrant: download country data into correct directory
Sarah Hoffmann [Mon, 17 Jul 2017 21:17:26 +0000 (23:17 +0200)]
vagrant: download country data into correct directory

7 years agoenable code coverage computation for API BDD tests
Sarah Hoffmann [Mon, 17 Jul 2017 20:59:13 +0000 (22:59 +0200)]
enable code coverage computation for API BDD tests

Fixes #505.

7 years agoMerge pull request #771 from rksh/patch-1
Sarah Hoffmann [Sat, 15 Jul 2017 08:34:43 +0000 (10:34 +0200)]
Merge pull request #771 from rksh/patch-1

Warn about operation order with Wikipedia data

7 years agoWarn about operation order with Wikipedia data
Andy Carra [Sat, 15 Jul 2017 01:52:54 +0000 (18:52 -0700)]
Warn about operation order with Wikipedia data

Give first-time users a tip about installing Wikipedia data before performing initial import.
once https://github.com/openstreetmap/Nominatim/issues/255 has been addressed, this note is no-longer important.

7 years agoMerge pull request #768 from SrihariThalla/update-typo-fix
Sarah Hoffmann [Fri, 7 Jul 2017 10:51:51 +0000 (12:51 +0200)]
Merge pull request #768 from SrihariThalla/update-typo-fix

[Minor] [/docs] Update file name of update.php to init updates command

7 years agoUpdate file name of update.php to init updates
Srihari Thalla [Fri, 7 Jul 2017 10:27:01 +0000 (15:57 +0530)]
Update file name of update.php to init updates

7 years agoMerge pull request #767 from manzari/patch-1
mtmail [Thu, 6 Jul 2017 23:46:04 +0000 (01:46 +0200)]
Merge pull request #767 from manzari/patch-1

add country_osm_grid download to development (vagrant) setup instructions

7 years agoUpdate VAGRANT.md
manzari [Thu, 6 Jul 2017 16:05:14 +0000 (18:05 +0200)]
Update VAGRANT.md

7 years agoMerge pull request #763 from SrihariThalla/update-doc-links
Sarah Hoffmann [Thu, 29 Jun 2017 19:00:29 +0000 (21:00 +0200)]
Merge pull request #763 from SrihariThalla/update-doc-links

Update incorrect internal links to docs

7 years agoUpdate incorrect internal links to docs
Srihari Thalla [Thu, 29 Jun 2017 11:59:15 +0000 (17:29 +0530)]
Update incorrect internal links to docs

7 years agoprepare for release 3.0.0 v3.0.0
Sarah Hoffmann [Sun, 25 Jun 2017 18:58:59 +0000 (20:58 +0200)]
prepare for release 3.0.0

7 years agomake naming of documentation files consistent
Sarah Hoffmann [Sun, 25 Jun 2017 15:18:21 +0000 (17:18 +0200)]
make naming of documentation files consistent

7 years agoadd extensive debug messages for placex
Sarah Hoffmann [Thu, 15 Jun 2017 21:08:58 +0000 (23:08 +0200)]
add extensive debug messages for placex

7 years agorefine bug report information
Sarah Hoffmann [Wed, 14 Jun 2017 14:18:54 +0000 (16:18 +0200)]
refine bug report information

7 years agoimprove update interval computation
Sarah Hoffmann [Sun, 11 Jun 2017 07:05:24 +0000 (09:05 +0200)]
improve update interval computation

Don't do anything if a downloaded diff is empty after all
(may be happening when an empty diff was published upstream).

Correctly compute the waiting interval before checking for new
data. As the interval is now computed based on the date of the
newest object in the database, the configured intervals need
to be adjusted slightly to take into account the time it takes
for the server to publish a diff.

7 years agoGuard against network failures in getDatabaseDate()
Sarah Hoffmann [Fri, 9 Jun 2017 19:49:31 +0000 (21:49 +0200)]
Guard against network failures in getDatabaseDate()

When updating use the date from the diff file instead
as we are guaranteed to get this if the file has been
successfully loaded.

7 years agorecompile installation instructions
Sarah Hoffmann [Fri, 9 Jun 2017 18:12:29 +0000 (20:12 +0200)]
recompile installation instructions

7 years agoIgnore postcodes with comma and semicolon when computing address
Sarah Hoffmann [Wed, 7 Jun 2017 21:19:56 +0000 (23:19 +0200)]
Ignore postcodes with comma and semicolon when computing address

OSM has sometimes postcode lists for cities which should
simply be ignored.

Fixes #673.

7 years agorestrict linked places to place nodes
Sarah Hoffmann [Wed, 7 Jun 2017 19:32:02 +0000 (21:32 +0200)]
restrict linked places to place nodes

Avoids getting the wrong entry when the linked place has
double tagging.

Fixes #573.

7 years agoget precomputed housenumbers and postcodes from address column
Sarah Hoffmann [Wed, 7 Jun 2017 18:35:41 +0000 (20:35 +0200)]
get precomputed housenumbers and postcodes from address column

7 years agoforce update of linker when linkee is updates
Sarah Hoffmann [Tue, 6 Jun 2017 21:46:44 +0000 (23:46 +0200)]
force update of linker when linkee is updates

Potential name changes need to be added to the linker's
name hstore.

Fixes #170.

7 years agoremove wip tags from all tests
Sarah Hoffmann [Tue, 6 Jun 2017 20:01:52 +0000 (22:01 +0200)]
remove wip tags from all tests

7 years agoRemove boundries when downgrading from polygon to line
Sarah Hoffmann [Tue, 6 Jun 2017 19:58:41 +0000 (21:58 +0200)]
Remove boundries when downgrading from polygon to line

Fixes #135.

7 years agoMerge pull request #745 from lonvia/restrict-poi-queries-results
Sarah Hoffmann [Tue, 6 Jun 2017 18:55:15 +0000 (20:55 +0200)]
Merge pull request #745 from lonvia/restrict-poi-queries-results

limit number of considered places in POI queries

7 years agoadapt postcode centroid import to new address hstore
Sarah Hoffmann [Tue, 6 Jun 2017 18:42:13 +0000 (20:42 +0200)]
adapt postcode centroid import to new address hstore

The postcode now needs to be saved in address->'postcode'
not in the postcode column which is derived only later while
indexing.

Fixes #746.

Thanks to @kkoop.

7 years agolimit number of considered places in POI queries
Sarah Hoffmann [Mon, 5 Jun 2017 19:33:50 +0000 (21:33 +0200)]
limit number of considered places in POI queries

When searching for POIs in place_classtype_ tables limit the number
of objects considered to 300. The distinct and order by clauses
forced until now to retrive all matching objects and order them
first which can cause long running queries when retriving them
for large areas like the US.

Fixes #735.

7 years agoadvertise official location for test data on nominatim.org
Sarah Hoffmann [Mon, 5 Jun 2017 20:01:42 +0000 (22:01 +0200)]
advertise official location for test data on nominatim.org

7 years agofix formatting in test README
Sarah Hoffmann [Mon, 5 Jun 2017 19:53:45 +0000 (21:53 +0200)]
fix formatting in test README

7 years agoupdate osm2pgsql (revert use of "char")
Sarah Hoffmann [Mon, 5 Jun 2017 07:08:23 +0000 (09:08 +0200)]
update osm2pgsql (revert use of "char")

7 years agoRevert "use "char" type when refering to osm_type column"
Sarah Hoffmann [Sun, 4 Jun 2017 15:57:08 +0000 (17:57 +0200)]
Revert "use "char" type when refering to osm_type column"

This reverts commit 2dd7f0156a84ef07b808244faa2d42c384e9da32.

7 years agoMerge pull request #742 from lonvia/compare-normalized
Sarah Hoffmann [Mon, 5 Jun 2017 06:44:04 +0000 (08:44 +0200)]
Merge pull request #742 from lonvia/compare-normalized

Require more exact match for special search terms

7 years agoadd special terms import to travis testing and fixup libs
Sarah Hoffmann [Sun, 4 Jun 2017 09:35:11 +0000 (11:35 +0200)]
add special terms import to travis testing and fixup libs

7 years agodisregard special phrases that do not match fully
Sarah Hoffmann [Thu, 1 Jun 2017 19:40:23 +0000 (21:40 +0200)]
disregard special phrases that do not match fully

Compare the normalized terms imported with the special
terms script with the normalized version of the query string.
Disregard them if they cannot be found. This avoids a significant
number of mismatches due to transliteration issues.

The match will only be done when a normalized word has been set
making this change backwards compatible with older databases.

7 years agoadd normalized version of special search terms on import
Sarah Hoffmann [Thu, 1 Jun 2017 17:34:16 +0000 (19:34 +0200)]
add normalized version of special search terms on import

Requires the PHP bindings for libicu, so add that as a requirement.

7 years agouse "char" type when refering to osm_type column
Sarah Hoffmann [Sun, 4 Jun 2017 12:34:01 +0000 (14:34 +0200)]
use "char" type when refering to osm_type column

When using an explicit cast to char(1) when refering to the
osm_type column postgres won't use the index in some cases.
Observed only on postgres 9.5 from the original Postgres
reporsitories.

Fixes #741.

7 years agoalso need postgres configuration changes for bug reports
Sarah Hoffmann [Fri, 2 Jun 2017 12:06:53 +0000 (14:06 +0200)]
also need postgres configuration changes for bug reports

7 years agoupdate osm2pgsql (libosmium update and clubs)
Sarah Hoffmann [Thu, 1 Jun 2017 17:44:07 +0000 (19:44 +0200)]
update osm2pgsql (libosmium update and clubs)

Adds club key.

Fixes #725.

7 years agoremove PHP version check
Sarah Hoffmann [Thu, 1 Jun 2017 17:42:28 +0000 (19:42 +0200)]
remove PHP version check

5.4 is the minimum supported version now.

7 years agoParameter to enable JSON pretty-printing
big-o [Sun, 21 May 2017 20:29:24 +0000 (21:29 +0100)]
Parameter to enable JSON pretty-printing

7 years agoMerge pull request #739 from lonvia/max-importance
Sarah Hoffmann [Wed, 31 May 2017 22:13:22 +0000 (00:13 +0200)]
Merge pull request #739 from lonvia/max-importance

when linking places compute maximum importance

7 years agowhen linking places compute maximum importance
Sarah Hoffmann [Tue, 30 May 2017 21:36:59 +0000 (23:36 +0200)]
when linking places compute maximum importance

The linker and the linkee might have different wikipedia
tags and thus different importances. Prefer the higher
value.

Fixes #562.

7 years agoadd hints about bug reporting and pull requests
Sarah Hoffmann [Sat, 27 May 2017 15:47:39 +0000 (17:47 +0200)]
add hints about bug reporting and pull requests

7 years agoupdates: always remove output file and start with correct sequence id
Sarah Hoffmann [Sat, 27 May 2017 15:02:34 +0000 (17:02 +0200)]
updates: always remove output file and start with correct sequence id

7 years agofix name of constant
Sarah Hoffmann [Sat, 27 May 2017 14:42:01 +0000 (16:42 +0200)]
fix name of constant

7 years agoupdate word statistics
Sarah Hoffmann [Fri, 26 May 2017 19:58:04 +0000 (21:58 +0200)]
update word statistics

7 years agoMerge pull request #734 from lonvia/use-pyosmium-for-updates
Sarah Hoffmann [Fri, 26 May 2017 19:43:08 +0000 (21:43 +0200)]
Merge pull request #734 from lonvia/use-pyosmium-for-updates

Use pyosmium for updates

7 years agoMerge pull request #730 from SrihariThalla/update-vagrantmd-doc
Sarah Hoffmann [Fri, 26 May 2017 19:39:37 +0000 (21:39 +0200)]
Merge pull request #730 from SrihariThalla/update-vagrantmd-doc

Update the formatting in Vagrant markdown doc

7 years agoUpdate the formatting in Vagrant markdown doc
Srihari Thalla [Tue, 23 May 2017 08:48:55 +0000 (14:18 +0530)]
Update the formatting in Vagrant markdown doc

7 years agoupdate docs for osmosis to pyosmium change
Sarah Hoffmann [Thu, 25 May 2017 14:53:44 +0000 (16:53 +0200)]
update docs for osmosis to pyosmium change

7 years agoswitch from osmosis to pyosmium for updates
Sarah Hoffmann [Thu, 25 May 2017 14:26:09 +0000 (16:26 +0200)]
switch from osmosis to pyosmium for updates

Pyosmium comes with convenient functions for finding the
right state and does not require external files for
rembering the state. Updates can now conveniently
set up by simply running ./utils/update.php --init-updates
and state is kept directly in the import_status table.

This change requires an update in the database schema.
Run the following to update:

ALTER TABLE import_status ADD COLUMN sequence_id integer;
ALTER TABLE import_status ADD COLUMN indexed boolean;
ALTER TABLE import_osmosis_log ADD COLUMN batchseq integer;

7 years agoAdd FAQ to documentation
Sarah Hoffmann [Wed, 24 May 2017 21:29:08 +0000 (23:29 +0200)]
Add FAQ to documentation

For the moment only copies the FAQ entries for installation from the wiki and adds one on running multiple extracts.

7 years agoMerge pull request #724 from lonvia/update-country-list
Sarah Hoffmann [Sat, 13 May 2017 09:48:34 +0000 (11:48 +0200)]
Merge pull request #724 from lonvia/update-country-list

Update country grid SQL file and move it to nominatim.org

7 years agoupdate docs for new country grid location
Sarah Hoffmann [Fri, 12 May 2017 22:13:56 +0000 (00:13 +0200)]
update docs for new country grid location

Also updates some dependencies.

7 years agoremove base country grid from repo
Sarah Hoffmann [Fri, 12 May 2017 21:02:50 +0000 (23:02 +0200)]
remove base country grid from repo

The updated country grid is significantly larger, so expect it to
be downloaded from the nominatim.org website instead.

7 years agoremove another use of place.country_code
Sarah Hoffmann [Sun, 23 Apr 2017 20:46:54 +0000 (22:46 +0200)]
remove another use of place.country_code

7 years agoupdate osm2pgsql (geometry fix, column reordering)
Sarah Hoffmann [Sat, 22 Apr 2017 16:16:22 +0000 (18:16 +0200)]
update osm2pgsql (geometry fix, column reordering)

7 years agoMerge branch 'roques-tetris'
Sarah Hoffmann [Sat, 22 Apr 2017 16:14:05 +0000 (18:14 +0200)]
Merge branch 'roques-tetris'

7 years agoMerge pull request #708 from lonvia/check-for-invalid-geoms
Sarah Hoffmann [Sat, 22 Apr 2017 16:12:18 +0000 (18:12 +0200)]
Merge pull request #708 from lonvia/check-for-invalid-geoms

make sure no invalid geometries end up in placex

7 years agomake sure no invalid geometries end up in placex
Sarah Hoffmann [Sat, 22 Apr 2017 08:34:03 +0000 (10:34 +0200)]
make sure no invalid geometries end up in placex

7 years agoMerge branch 'tetris' of https://github.com/roques/Nominatim into roques-tetris
Sarah Hoffmann [Thu, 20 Apr 2017 18:56:44 +0000 (20:56 +0200)]
Merge branch 'tetris' of https://github.com/roques/Nominatim into roques-tetris

7 years agouse SMALLINT for ranks and partition; reorder columns for alignment
Christian von Roques [Fri, 14 Apr 2017 13:57:09 +0000 (15:57 +0200)]
use SMALLINT for ranks and partition; reorder columns for alignment

7 years agofix typo
Sarah Hoffmann [Tue, 18 Apr 2017 20:44:39 +0000 (22:44 +0200)]
fix typo

7 years agoget pg error on correct connection
Sarah Hoffmann [Tue, 18 Apr 2017 20:29:21 +0000 (22:29 +0200)]
get pg error on correct connection

7 years agosend address interpolation import to correct postgres conn
Sarah Hoffmann [Tue, 18 Apr 2017 20:11:58 +0000 (22:11 +0200)]
send address interpolation import to correct postgres conn

7 years agoalso use address column for word count computation
Sarah Hoffmann [Tue, 18 Apr 2017 20:11:09 +0000 (22:11 +0200)]
also use address column for word count computation

7 years agoexplicitly name columns at INSERT
Christian von Roques [Fri, 14 Apr 2017 13:50:27 +0000 (15:50 +0200)]
explicitly name columns at INSERT

7 years agodeduplicate words: do not look for duplicates in empty partitions
Christian von Roques [Tue, 4 Apr 2017 17:00:36 +0000 (19:00 +0200)]
deduplicate words: do not look for duplicates in empty partitions

7 years agoupdate: getPostgresVersion requires a database connection
Christian von Roques [Tue, 4 Apr 2017 16:09:28 +0000 (18:09 +0200)]
update: getPostgresVersion requires a database connection

7 years agowith PHP7 the result of new() can no longer be assigned by reference
Christian von Roques [Sun, 2 Apr 2017 16:03:17 +0000 (18:03 +0200)]
with PHP7 the result of new() can no longer be assigned by reference

7 years agocorrect warm.php --search-only help text
Christian von Roques [Sun, 2 Apr 2017 15:13:43 +0000 (17:13 +0200)]
correct warm.php --search-only help text

7 years agoMerge pull request #700 from lonvia/structured-address-info
Sarah Hoffmann [Thu, 13 Apr 2017 20:12:19 +0000 (22:12 +0200)]
Merge pull request #700 from lonvia/structured-address-info

Move address information into hstore column

7 years agoupdate osm2pgsql (structured addresses and new libosmium)
Sarah Hoffmann [Tue, 11 Apr 2017 19:29:10 +0000 (21:29 +0200)]
update osm2pgsql (structured addresses and new libosmium)

7 years agouse centroid for near feature search on rank 30
Sarah Hoffmann [Sun, 9 Apr 2017 21:12:35 +0000 (23:12 +0200)]
use centroid for near feature search on rank 30

Rank 30 has some very large geometries (peninsulas, time zones,
etc.) for which a near feature search for the full geometry is
too expensive, so do the search on the centroid only.

7 years agofix operator precedence for hstore
Sarah Hoffmann [Sun, 9 Apr 2017 08:06:31 +0000 (10:06 +0200)]
fix operator precedence for hstore

7 years agoremove street and addr_place columns in placex
Sarah Hoffmann [Wed, 5 Apr 2017 20:19:42 +0000 (22:19 +0200)]
remove street and addr_place columns in placex

The information is onyl needed for parenting,
so no need to store it permanently.

7 years agoRemove street and addr_place from location_property_osmline
Sarah Hoffmann [Sun, 2 Apr 2017 13:19:39 +0000 (15:19 +0200)]
Remove street and addr_place from location_property_osmline

Derived columns are not needed because parent information is
always computed from scratch. So the columns are just duplicate
information.

Also get address information on nodes from address columns. The
other columns are not necessarily reliable when the node have not
been indexed yet.

7 years agoadapt more BDD tests to hstore
Sarah Hoffmann [Thu, 30 Mar 2017 19:57:34 +0000 (21:57 +0200)]
adapt more BDD tests to hstore

7 years agofix DB bd tests for address hstore
Sarah Hoffmann [Sun, 26 Mar 2017 19:19:52 +0000 (21:19 +0200)]
fix DB bd tests for address hstore

7 years agoadapt osm2pgsql tests for new address column
Sarah Hoffmann [Sat, 25 Mar 2017 22:12:51 +0000 (23:12 +0100)]
adapt osm2pgsql tests for new address column