Search code examples
amazon-web-servicesaws-cloudformationamazon-kinesis-firehose

How can the RetryOptions of an AWS Kinesis Firehose's RedshiftDestinationConfiguration be managed via CloudFormation


  • The AWS CLI API defines a RedshiftDestinationConfiguration of a Kinesis Firehose as having a RetryOptions parameter. ref

  • The cloudformation schema also defines a RedshiftDestinationConfiguration of a Kinesis Firehose but has no RetryOptions parameter. ref

Is there a way to set and update the retry options of a firehose that is being maintained via cloudformation files?


Solution

  • The AWS::KinesisFireHose::DeliveryStream Resource was initially added to CloudFormation on June 9 2016, while the Amazon Redshift COPY retry feature was added on May 18, 2016. (Presumably the CloudFormation resource was originally implemented before the RetryOptions parameter was finalized.)

    Unfortunately, unlike other AWS SDKs which tend to track new AWS features more closely, there's generally a significant lag between new AWS feature announcements and their implementation in CloudFormation resources.

    Until AWS implements this feature in the official AWS CloudFormation resource, you can implement a workaround using a Custom Resource that calls UpdateDestination directly to set the unsupported RetryOptions parameter.