Skip to content

osrm-extract with europe.osm.pbf and 64GB RAM failed due to memory limit ?! #6146

Description

@kimjohans

Hello all,
i downloaded the current europe file from geofabrik.de to update my current routing data.

So i ran
osrm-extract europe-latest.osm.pbf
to extract the files, but:
...
[info] Using profile api version 4
[info] RAM: peak bytes used: 38270754816
[error] [exception] std::bad_alloc
[error] Please provide more memory or consider using a larger swapfile

On a server with 64GB RAM ??!

I am not able to create a swap file (because it is an VServer) and there is (as far as i can see) no way to limit the RAM usage of osrm-extract. That VServer is powerful enough to do all my routing-calculations and i'm not able to rent an extra server just for extracting the PBF data. Honestly, i think that 64GB RAM should be fairly enough ... or there should be an option to limit the RAM usage. I will use OpenSource projects as often as i can and help them as good as i can, but (just my two cents) an open source project can only be used successfully and widely when a lot of people (here: developers) can use it. I know nobody in my colleagues circles with such a powerful server (128 GB RAM ?!). And on the widely used vservers swapping is deactivated.

Any solution or idea (helpful ones, pls not "buy a root server", "use a smaller map" or "buy a good server") ?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions