Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Planetiler update #323

Merged
merged 2 commits into from
Feb 27, 2024
Merged

Planetiler update #323

merged 2 commits into from
Feb 27, 2024

Conversation

michaelkirk
Copy link
Member

Some really impressive file-size gains. I just need to test these new planet assets before merging.

# planetiler 0.5
115G    maps-earth-planet-v1.36/maps-earth-planet-v1.36.mbtiles

# planetiler 0.7
86G     maps-earth-planet-v1.40/maps-earth-planet-v1.40.mbtiles

Note that this is also comparing two different planet inputs, so it's not a great test, but the planet build process is so slow that I'm not willing to run a more precise experiment at the moment.

@michaelkirk
Copy link
Member Author

michaelkirk commented Feb 27, 2024

The "small example build" is running out of disk space. I'm pretty sure I'm doing something wrong with the new planetiler API.

This line from the logs is interesting:

+planetiler-build-mbtiles | 0:00:02 WAR - ❌️ 76G storage on / (overlay) requested for read phase disk, 10G available

Trying to allocate 76GB seems like an awful lot for processing Bogota...

@michaelkirk
Copy link
Member Author

I was using a data structure intended only for planet builds. Now we'll optionally use a smaller one for non-planet builds.

@michaelkirk michaelkirk force-pushed the mkirk/planetiler-0.7.0 branch from f330166 to adfd02e Compare February 27, 2024 19:52
@michaelkirk michaelkirk merged commit 3225352 into main Feb 27, 2024
4 checks passed
@michaelkirk michaelkirk deleted the mkirk/planetiler-0.7.0 branch February 27, 2024 21:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant