Bug 6094 - [Touch.Unit] all test cases are shown in reverser order and don't return positive results anymore
Summary: [Touch.Unit] all test cases are shown in reverser order and don't return posi...
Alias: None
Product: iOS
Classification: Xamarin
Component: Tools ()
Version: 5.3.x
Hardware: Macintosh Mac OS
: --- normal
Target Milestone: Untriaged
Assignee: Sebastien Pouliot
Depends on:
Reported: 2012-07-12 09:16 UTC by René Ruppert
Modified: 2013-06-02 12:42 UTC (History)
3 users (show)

Is this bug a regression?: ---
Last known good build:

Notice (2018-05-24): bugzilla.xamarin.com is now in read-only mode.

Please join us on Visual Studio Developer Community and in the Xamarin and Mono organizations on GitHub to continue tracking issues. Bugzilla will remain available for reference in read-only mode. We will continue to work on open Bugzilla bugs, copy them to the new locations as needed for follow-up, and add the new items under Related Links.

Our sincere thanks to everyone who has contributed on this bug tracker over the years. Thanks also for your understanding as we make these adjustments and improvements for the future.

Please create a new report on Developer Community or GitHub with your current version information, steps to reproduce, and relevant error messages or log files if you are hitting an issue that looks similar to this resolved bug and you do not yet see a matching new report.

Related Links:

Description René Ruppert 2012-07-12 09:16:17 UTC
I have tried to run my test cases in MT 5.3 and noticed that all my tests are now shown in reversed order and positive results are no longer showing up. Only failed tests return something.
Comment 1 Sebastien Pouliot 2012-07-15 13:32:03 UTC
There was no defined order for test cases in 5.2 (and earlier) versions. IOW before 5.3 it depended on how reflection returns the method names which, right now (not sure if it's mandated by the ECMA spec), is related to their order in the source files.

The test runner in 5.3 adds two buttons: The first to sort the tests (up / down) alphabetically, the second to filter: all, failed, ignored and passed tests. That makes it easier and faster to find tests when you have huge test suites, e.g. by name (ensuring it's sorted) or simply showing the failed tests.

You can override them (in your own test apps) but by default (if I did not lose too much memory on vacations ;-) it should be "unsorted" and "all" (i.e. just like before). If not then please specify which version of 5.3 you're using and I'll verify the defaults are sane (well like before) for the next release.
Comment 2 René Ruppert 2012-07-16 10:37:37 UTC
In 5.2 they appeared in order of the source but in 5.3 the order is exactly the other way round by default. I have not gotten into any of the sort buttons yet (currently back to 5.2 because of the UIAlertView bug).
Comment 3 Sebastien Pouliot 2012-07-16 10:58:05 UTC
I can't be certain without knowing the exact 5.3.x version you're using. Some stuff could have been fixed between what I see today and the version you are using.

However I'm sure the next version shows everything (successes, failures, ignored) by default and it not ordered alphabetically (or reversed) but I did not check it it exactly matches 5.2.12. The source code (available on github) shows no sorting is done unless specified* (unless mono returns them differently since the default order is undefined).

* check your app's Options to ensure it was not, somehow, changed. "Display", "Sort Names" should be "OFF".
Comment 4 Sebastien Pouliot 2013-06-02 12:42:35 UTC