What kind of testing for executables?

[Intransition]

What kind of testing is it when you test a projects executables:
system/functional or integration?

 

[Caleb Clausen]

What kind of testing is it when you test a projects executables:
system/functional or integration?

These terms are so broad and mean so many things to so many people
that I think you can just take your pick.

 

[R.. Kumar]

What kind of testing is it when you test a projects executables:
system/functional or integration?

Is this about the terminology ?

I'd like to know what tools are being used for testing command-line
programs ?

I looked around to see samples of shoulda in command line gems but could
not find any. Currently, I am using a shell program (without a name or
repo) written by the git people (Junio Hamano) to test git. I used it to
test a shell app I wrote, and now I an using it for a ruby command line
app.

Sadly, it compares the standard output of a program - expected vs
actual. Which means every time I tweak or improve the output, my tests
fail. It ignores stderr. But otherwise it serves my purpose a lot -- far
better than no auto testing.

If this is OT, I could start a new thread for that.

 

[Intransition]

Is this about the terminology ?

I'd like to know what tools are being used for testing command-line
programs ?

I looked around to see samples of shoulda in command line gems but could
not find any. Currently, I am using a shell program (without a name or
repo) written by the git people (Junio Hamano) to test git. I used it to
test a shell app I wrote, and now I an using it for a ruby command line
app.

Sadly, it compares the standard output of a program - expected vs
actual. Which means every time I tweak or improve the output, my tests
fail. It ignores stderr. But otherwise it serves my purpose a lot -- far
better than no auto testing.

If this is OT, I could start a new thread for that.

No worries. I use either Cucumber (with Aruba) or QED.

And yes, checking the $stdout is part of test assertions, but I keep
it to specific snippets not the whole output, via
'out.index(pattern)'.

 

[R.. Kumar]

No worries. I use either Cucumber (with Aruba) or QED.

And yes, checking the $stdout is part of test assertions, but I keep
it to specific snippets not the whole output, via
'out.index(pattern)'.

Is there some project you've used Cucumber or QED in (command-line). I
could see the test cases, and copy from there.
I didn't find much on the main page of QED. I did glance at Aruba some
days back but was lost.

 

[Intransition]

Is there some project you've used Cucumber or QED in (command-line). I
could see the test cases, and copy from there.
I didn't find much on the main page of QED. I did glance at Aruba some
days back but was lost.

Cucumber and Aruba:
http://github.com/proutils/lemon/tree/master/features/

QED
http://github.com/proutils/pom/tree/master/test/functional/
(see bump.rdoc)