Run MinIO:
just start-minio
Setup Bucket:
just setup-minio
Access MinIO Console: http://localhost:9001
Stop MinIO:
just stop-minio
Relase Build:
cargo build --release
Local file seeding test:
../target/release/bbox-tile-server seed --tileset=gebco --tile-path=/tmp/tiles --maxzoom=2
or mvtbench:
just seed-s3
Set S3 env vars:
export S3_ENDPOINT_URL="http://localhost:9000"
export AWS_ACCESS_KEY_ID=miniostorage
export AWS_SECRET_ACCESS_KEY=miniostorage
Run:
../target/release/bbox-tile-server seed --tileset=ne_extracts --s3-path=s3://tiles --maxzoom=5
https://github.com/pka/mvt-benchmark
Start DB:
just start-db
Tile seeding benchmarks:
just seed-bench-files
just seed-bench-mbtiles
just seed-bench-pmtiles
time s3cmd sync ~/code/gis/vogeldatenbank/tiles/ s3://tiles
Done. Uploaded 448854168 bytes in 95.8 seconds, 4.47 MB/s.
-> real 1m38.220s
export S3_ENDPOINT_URL="http://localhost:9000"
time s5cmd cp /home/pi/code/gis/vogeldatenbank/tiles/ s3://tiles
-> real 0m15.807s
time s5cmd rm s3://tiles/*
-> real 0m3.856s
Initial sequential implementation:
export S3_ENDPOINT_URL="http://localhost:9000"
cargo build --release
time ../target/release/bbox-tile-server upload --srcdir=/home/pi/code/gis/vogeldatenbank/tiles/ --s3-path=s3://tiles
-> real 0m53.257s
Parallel tasks:
Default values (8+2 threads / 256 tasks)
-> real 0m13.578s (10s-20s)
Local QGIS NaturalEarth WMS
../target/release/bbox-tile-server seed --tileset=ne_extracts --maxzoom=18 --s3-path=s3://tiles
-> 14s
Local QGIS NaturalEarth WMS to local directory
../target/release/bbox-tile-server seed --tileset=ne_extracts --maxzoom=18 --tile-path=/tmp/tiles
-> 13s