[Goldi]

Is there a way to automatically run unit tests on a device / simulator?
The goal is to have a script that would run nightly, build the CODs (and load them), and then run a set of sanity tests. If any of the tests fail - a mail should be sent (or any other notification message should be activated).
I looked at BUnit, but it only runs on the device itself, and requires manual activation and a person that would look at the screen and see the result.
Thanks

[dankarlinski]

Wirelessly posted (White and Nerdy)

I would imagine there would be something like that thru a BES, but not BIS. When you reboot however, it does run a security check. Hope this helps. =)

[Goldi]

The BES can load the tests to the device.
However, there is still the need to close the loop, and get the results of the run back to the build machine. How would you recommend that the BES would return the result?

[ptys]

Yes, there is, but it's not free. Our ant script builds everything, launches our app server, mds simulator, and the device simulator, and the test app executes automatically running all the unit tests. Then the test app talks back to our ant task to report unit tests results, everything gets shut down, and the script continues.

The unit tests are based on J2MEUnit, but we've modified it to work more like JUnit, so tests are wired together automatically during the build, you just define your test*() methods.

Originally Posted by Goldi

Is there a way to automatically run unit tests on a device / simulator?
The goal is to have a script that would run nightly, build the CODs (and load them), and then run a set of sanity tests. If any of the tests fail - a mail should be sent (or any other notification message should be activated).
I looked at BUnit, but it only runs on the device itself, and requires manual activation and a person that would look at the screen and see the result.
Thanks

[Goldi]

Sounds exactly like what we are looking for.
When you say that it is not free - Is it a product (that we can buy), or an in-house solution?
Can you elaborate how the test app talks back with the ANT script? Is it through log files, direct TCP connection, or something else?

[ptys]

Originally Posted by Goldi

Sounds exactly like what we are looking for.
When you say that it is not free - Is it a product (that we can buy), or an in-house solution?
Can you elaborate how the test app talks back with the ANT script? Is it through log files, direct TCP connection, or something else?

It's an in-house solution. Not free, meaning it doesn't come with the RIM dev environment, or in any free library.

The test app talks back to the build script using TCP. There is an ant task that we created that will listen on a certain port for the test app output and test results.

[Goldi]

Thanks. I hoped to be able to use a communication mechanism that already exists, such as the JDWP or the JavaLauncher.
I hope RIM would add such a capability in the future.