From: Björn Stenberg <bjorn_at_haxx.se>
Date: Tue, 19 Oct 2010 15:24:22 +0200

Thomas Martitz wrote:
> I think we should work a lot more with RC builds to let users test
> on targets for which we don't currently have a maintainer around.

I agree, but providing RC builds alone is not very useful. We need to help the users with their testing. And we need to help users report the results of their testing.

What we need is basically to design a batch test system that is "executed" by humans. In plain language: We need to write test cases. Lots of them. And then we need to write a web based test report tool where users can report their results.

I'm envisioning a tool/webpage where you enter the svn revision and target you are testing and then go down a list of dozens and dozens of test cases, ticking a checkbox (works/doesn't/other, or something) for every test.

This would allow non-programming users to contribute enormously to the development and improvement of the code. And it would, potentially, allow for actual regression tracking.

We discussed this on the last devcon, but it never came to much. I still think this could be a really big step forward.

-- 
Björn

Received on 2010-10-19