Search code examples
apache-sparkapache-hudi

Apache Hudi commit id for current ingestion


How to get the current ingestion commit Id .I know HoodieDataSourceHelpers.latestCommit method can use to find the latest commit. But what happen if there is concurrent write in different thread. i need to find each thread commitID


Solution

  • Hudi does not allow concurrent writing at the moment. In any case HoodieDataSourceHelpers.latestCommit will return the latest commit always.