I'm designing a data indexing pipeline to OpenSearch using Firehose(using the built-in transformation lambda), like : data source ----(putRecordBatch)----> firehose ---(Lambda transformation)--> OpenSearch
New data added to data store will be indexed via this flow in near-real time. There is requirement of both creating new documents, and doing partial update on existing documents(ie, updating select attributes of a specified document id).
Does Firehose integration with OpenSearch support Upsert(Update if document is seen in OpenSearch, else insert)?
Thanks
As far as I can tell that is not possible.
I've found this question: How can AWS Kinesis Firehose lambda send update and delete requests to ElasticSearch? which confirms my thought.