Uploading large GEOJson to elastic

Question

I'm having some trouble uploading a GEOJson to my local elastic server.

curl -XPOST 'http://localhost:9200/geo/_doc' -d @earth-lands-1m.geo.json 

The file is a GeometryCollection with a lot of objects:

{"type":"GeometryCollection", "geometries": [ <polygon objects>] }

The file is 140M and this doesn't give any output, what am I doing wrong?

Answer 1

Files so large are more or less guaranteed to fail. I'd recommend

• splitting the geojson features first
• and using bulk sync (python) or json-to-es-bulk (nodejs + curl) to split the payloads even further.
• On top of that, have a look at tuning for indexing speed if you're still unsatisfied w/ the ... indexing speed.