Search code examples
testingautomationautomated-testsjbehavethucydides

Is it possible to perform automated testing using data that generates in runtime?


Currently I am using Thucydides & JBehave to perform test cases by writing a feature story file which is pre-defined. Is there any way to perform test on runtime data using storyfile? If not, can you please suggest me a way to do so? Thanks in advance.


Solution

  • Actually is pretty much mandatory to gave good random data generator in your Testing framework. In order to avoid the static data and later suffer from it. It's also know as Pesticide Paradox:

    If you keep applying the same pesticide, the insects eventually build up resistance and the pesticide no longer works.

    This article can explain it additionally.

    Another working option, from my experience is the Oracle. I agree that building such complex functionality at first may seems like an overhead. But it works very well with the dynamic data generators.

    I'll share some summary after using such approach for 8 months. More then 10 million test cases per run, the actual limitations comes from the computing power that you have, no regression without finding bugs(often in large amounts).