I want to set up an automation system to run nightly regression tests for a command line tool on a Linux environment. There are some automation scripts which are written in Ruby, but I'd like a complete system which includes:
The nature of this command-tool is low-level which deals with system hardware. Some of the features of the tool could crash the system it is being run on. I want this kind of cases to be reported as well. So, an ideal solution might be to have two computers linked through a network like (like ssh, etc). One system could be for logging and reporting the test results, the other system where the tool is actually run.
Appreciate any ideas you might have.
The Jenkins CI server should be able to do what you need. You might have to do some custom work to set up test reports to your liking, but Jenkins is well suited out of the box for the rest of your listed requirements.
As a quick intro I would suggesting checking out some screencasts or other videos on Jenkins - this talk is an example.