Search code examples
performance-testingload-testingamazon-kinesis

How to put 25k record to kinesis stream and Test tool to acknowledge it

I have developed a piece of software which writes record to Amazon kinesis Stream web service. i am trying to understand do we have any software tool which will allow me to measure what maximum throughput my code is generating to Kinesis Stream for 1 Shard in one second. Yes i do agree it depends on hardware configurations too. But for start i want o know for general purpose machine then might be i will able to see horizontal scalability

With this i am trying to achieve 25k records per second to write to kinesis stream

Reference : Kinesis http://aws.amazon.com/kinesis/

Solution

  • I believe you can use Apache JMeter for this as

    1. Download and install JMeter
    2. Download Amazon Kinesis Java Client Library and drop jars to JMeter classpath (you can use /lib folder of your JMeter installation)
    3. Using JSR223 Sampler, "groovy" as a language and AmazonKinesisRecordProducerSample as a reference implement the code which will write records to stream

    See Beanshell vs JSR223 vs Java JMeter Scripting: The Performance-Off You've Been Waiting For! guide for instructions on installing "groovy" engine support and scripting best practices.