How would you troubleshoot this issue?

[laredotornado]

I'm using Java 1.5 on a Mac OS 10.5.6, using a Resin 3.0.19
container. I'm trying to run a JUnit test to test my web service
client against the web service, which runs locally. A strange thing
happens. The 1016th test always fails with the below exception.
However, if I switch the order of the tests (in other words, make the
1016th the 1st so that some other test becomes the 1016th), the new
test in the 1016th position also fails with the same exception . This
happens repeatedly no matter what test is in the 1016th slot.

What advice do you have for troubleshooting this problem? My
suspicion is that this may be deeper than a coding issue, but I wanted
to get your advice.

Thanks, - Dave

=======================Maven 1.1 output
======================================
[junit] dir attribute ignored if running in the same VM
[junit] Running
myco.dor.dmv.driver.matching.test.MatchingServiceInvalidTest
[junit] Tests run: 1016, Failures: 1, Errors: 0, Time elapsed:
790.74 sec
-------------------------------------------------------------------------------

Unable to obtain goal [test:single]
Test myco.dor.dmv.driver.matching.test.MatchingServiceInvalidTest failed

-------------------------------------------------------------------------------
BUILD FAILED
-------------------------------------------------------------------------------
Total time : 13 minutes 14 seconds
Finished at : Tuesday, October 27, 2009 10:24:21 AM MDT
Final Memory : 183M/254M
-------------------------------------------------------------------------------


============================Stack trace
================================
Testcase: test440MatchInvalid_GenderNull
(myco.dor.dmv.driver.matching.test.MatchingServiceInvalidTest):
FAILED
Got Axis Fault. Test failed:Invalid argument
junit.framework.AssertionFailedError: Got Axis Fault. Test
failed:Invalid argument
at
myco.dor.dmv.driver.matching.test.MatchingServiceTestBase._testMatch
(MatchingServiceTestBase.java:91)
at
myco.dor.dmv.driver.matching.test.MatchingServiceTestBase._testMatch
(MatchingServiceTestBase.java:58)
at
myco.dor.dmv.driver.matching.test.MatchingServiceInvalidTest._testMatchInvalidCaseType
(MatchingServiceInvalidTest.java:13525)
at
myco.dor.dmv.driver.matching.test.MatchingServiceInvalidTest._testInvalidMatchGenderNull
(MatchingServiceInvalidTest.java:13241)
at
myco.dor.dmv.driver.matching.test.MatchingServiceInvalidTest.test440MatchInvalid_GenderNull
(MatchingServiceInvalidTest.java:4106)
at org.apache.commons.jelly.tags.ant.AntTag.doTag(AntTag.java:
195)
at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:
250)
at org.apache.commons.jelly.impl.ScriptBlock.run
(ScriptBlock.java:95)
at org.apache.commons.jelly.TagSupport.invokeBody
(TagSupport.java:186)
at org.apache.commons.jelly.tags.core.OtherwiseTag.doTag
(OtherwiseTag.java:41)
at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:
250)
at org.apache.commons.jelly.impl.ScriptBlock.run
(ScriptBlock.java:95)
at org.apache.commons.jelly.TagSupport.invokeBody
(TagSupport.java:186)
at org.apache.commons.jelly.tags.core.ChooseTag.doTag
(ChooseTag.java:38)
at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:
250)
at org.apache.commons.jelly.impl.ScriptBlock.run
(ScriptBlock.java:95)
at org.apache.commons.jelly.TagSupport.invokeBody
(TagSupport.java:186)
at org.apache.commons.jelly.tags.core.IfTag.doTag(IfTag.java:
42)
at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:
250)
at org.apache.commons.jelly.impl.ScriptBlock.run
(ScriptBlock.java:95)
at org.apache.maven.jelly.tags.werkz.MavenGoalTag.runBodyTag
(MavenGoalTag.java:83)
at org.apache.maven.jelly.tags.werkz.MavenGoalTag
$MavenGoalAction.performAction(MavenGoalTag.java:116)
at org.apache.maven.werkz.Goal.fire(Goal.java:691)
at org.apache.maven.werkz.Goal.attain(Goal.java:623)
at org.apache.maven.plugin.PluginManager.attainGoals
(PluginManager.java:712)
at org.apache.maven.MavenSession.attainGoals(MavenSession.java:
265)
at org.apache.maven.cli.App.doMain(App.java:307)
at org.apache.maven.cli.App.main(App.java:217)
at com.werken.forehead.Forehead.run(Forehead.java:551)
at com.werken.forehead.Forehead.main(Forehead.java:581)

 

[John B. Matthews]

I'm using Java 1.5 on a Mac OS 10.5.6,

Mac OS 10.5.8 is the current minor version of 10.5 (Leopard). I seem to
recall a Java 1.5 update in there.

using a Resin 3.0.19 container. I'm trying to run a JUnit test to
test my web service client against the web service, which runs
locally.

What version of JUnit? I'm not sure how to ensure that Resin is using a
particular version, but you might try another.

A strange thing happens. The 1016th test always fails with the below
exception. However, if I switch the order of the tests (in other
words, make the 1016th the 1st so that some other test becomes the
1016th), the new test in the 1016th position also fails with the same
exception . This happens repeatedly no matter what test is in the
1016th slot.

Interestingly, 1016 = 2^10 - 2^3. It's hard not to imagine it's a bad
index of some kind.

 

[laredotornado]

Mac OS 10.5.8 is the current minor version of 10.5 (Leopard). I seem to
recall aJava1.5 update in there.


What version of JUnit? I'm not sure how to ensure that Resin is using a
particular version, but you might try another.


Interestingly, 1016 = 2^10 - 2^3. It's hard not to imagine it's a bad
index of some kind.

John, to answer your question, it is JUnit 4.4.

Patricia, per your suggestion, I inserted a trial test


public void testMyTest() {
assertTrue(true);
} // testMyTest

as the 1016th test. It was executed successfully and the execution
died at the 1017th test (same exception as above). However, as I
said, making that 1017th test the 1st causes it to execute fine.
Starting to think this is some constraint on my side, but can't think
what.

Thanks for everyone's help, - Dave