NOTICE: help.openstreetmap.org is no longer in use from 1st March 2024. Please use the OpenStreetMap Community Forum

I have seen references to this all over the internet, but I am just trying to figure out how long this may take if it works, and if not, then what setting to go with. The Server I am setting up is just to display some offline maps, nothing super fancy or critical, so I tried to throw OSM on an old server I had lying around. everything went smooth until Time to import data into the database, and after around 3 days the Process killed itself. I tried changing a few specs in the command but it once again failed after a few days, so I decided to dig out a pretty decent workstation running a 4 core Xenon processor and 16Gb of RAM. I am very new to OSM and I am following the tutorial on teh OSM site to get this up and running, so I used the basic command that was given on the tutorial osm2pgsql -d gis --create --slim -G --hstore --tag-transform-script ~/src/openstreetmap-carto/openstreetmap-carto.lua -C 2500 --number-processes 1 -S ~/src/openstreetmap-carto/openstreetmap-carto.style ~/data/north-america-latest.osm.pbfcode just edited for the North america file that I downloaded. if this fails this time, should I modify the memory amount to more than 2500, and change the processes to more than 1, or do I have a good chance that this will wrap up without issues in a day or 2?

asked 29 Jul '18, 09:36

KD7VEA's gravatar image

KD7VEA
11223
accept rate: 0%

edited 30 Jul '18, 09:47

SK53's gravatar image

SK53 ♦
28.1k48268433

2

North America's quite large - I'd suggest testing on something small first (a small US state, perhaps). With 16Gb memory you can probably allocate more cache. With 4 cores you can probably allocate more processes.

How long your current import will take will depend on a number of other issues, such as speed of disk.

(29 Jul '18, 09:46) SomeoneElse ♦

I did test with a small file each time that I have done this, just to be sure everything was running correctly, and it did work. So for now while I assume it is still running, I assume all I can really do is wait and see what happens. Here is the last block of info I have since loading the data to the database.

Reading in file: /home/k7msh/data/north-america-latest.osm.pbf Using PBF parser. Processing: Node(995524k 190.9k/s) Way(75654k 0.89k/s) Relation(762060 17.39/s) parse time: 134134s Node stats: total(995524996), max(5787934253) in 5216s Way stats: total(75654254), max(611291042) in 85089s Relation stats: total(762074), max(8479578) in 43829s Committing transaction for planet_osm_point Committing transaction for planet_osm_line Committing transaction for planet_osm_polygon Committing transaction for planet_osm_roads Setting up table: planet_osm_nodes Setting up table: planet_osm_ways Setting up table: planet_osm_rels Using lua based tag processing pipeline with script /home/k7msh/src/openstreetmap-carto/openstreetmap-carto.lua

Going over pending ways... 36685077 ways are pending

Using 1 helper-processes

(29 Jul '18, 17:25) KD7VEA

Follow this question

By Email:

Once you sign in you will be able to subscribe for any updates here

By RSS:

Answers

Answers and Comments

Markdown Basics

  • *italic* or _italic_
  • **bold** or __bold__
  • link:[text](http://url.com/ "title")
  • image?![alt text](/path/img.jpg "title")
  • numbered list: 1. Foo 2. Bar
  • to add a line break simply add two spaces to where you would like the new line to be.
  • basic HTML tags are also supported

Question tags:

×263
×167
×2

question asked: 29 Jul '18, 09:36

question was seen: 1,916 times

last updated: 30 Jul '18, 09:47

NOTICE: help.openstreetmap.org is no longer in use from 1st March 2024. Please use the OpenStreetMap Community Forum