Rockbox.org home
release
dev builds
extras
themes manual
wiki
device status forums
mailing lists
IRC bugs
patches
dev guide



Rockbox mail archive

Subject: Testing

Testing

From: Björn Stenberg <bjorn_at_haxx.se>
Date: Tue, 19 Oct 2010 15:24:22 +0200

Thomas Martitz wrote:
> I think we should work a lot more with RC builds to let users test
> on targets for which we don't currently have a maintainer around.

I agree, but providing RC builds alone is not very useful. We need to help the users with their testing. And we need to help users report the results of their testing.

What we need is basically to design a batch test system that is "executed" by humans. In plain language: We need to write test cases. Lots of them. And then we need to write a web based test report tool where users can report their results.

I'm envisioning a tool/webpage where you enter the svn revision and target you are testing and then go down a list of dozens and dozens of test cases, ticking a checkbox (works/doesn't/other, or something) for every test.

This would allow non-programming users to contribute enormously to the development and improvement of the code. And it would, potentially, allow for actual regression tracking.

We discussed this on the last devcon, but it never came to much. I still think this could be a really big step forward.

-- 
Björn
Received on 2010-10-19

Page was last modified "Jan 10 2012" The Rockbox Crew
aaa