Incorrect test count in Visual Studio when using NUnitTestOrdering library

[AutomationSifu]

For some reason I'm getting a very large number of tests in Visual studio while using the NUnitTestOrdering library. For example I have a TestFixture that has 5 tests but shows up in Visual Studio as 95 tests when sorted by the trait, Category.

When running tests with NUnit Gui and the NUnitTestOrdering library I get the correct number of tests and the tests run successfully.

I like running tests in Visual Studio when debugging as it's much quicker. What's the best way to run tests in Visual Studio while also using the NUnitTestOrdering library when running tests using the NUnit gui?

Thanks!

[Sebazzz]

Can you upload me a small reproducible example?

[AutomationSifu]

Still in progress. It's going to take a little time to set up.

[Sebazzz]

No problem! Met vriendelijke groet, Sebastiaan Dammann

…

________________________________ Van: AutomationSifu <notifications@github.com> Verzonden: dinsdag, oktober 9, 2018 8:03 PM Aan: Sebazzz/NUnitTestOrdering CC: Sebastiaan Dammann; Comment Onderwerp: Re: [Sebazzz/NUnitTestOrdering] Incorrect test count in Visual Studio when using NUnitTestOrdering library (#9) Still in progress. It's going to take a little time to set up. — You are receiving this because you commented. Reply to this email directly, view it on GitHub<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FSebazzz%2FNUnitTestOrdering%2Fissues%2F9%23issuecomment-428291418&data=02%7C01%7C%7C7b292c6997d0449a90c308d62e1186f4%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636747050137626026&sdata=SXYvVpfurCBENUBiFFXQLprIfgkMfGpM7Tp3620xIyg%3D&reserved=0>, or mute the thread<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FABXCsStcCDwkKCNp1SO1U0VK71InfPHRks5ujOT0gaJpZM4XEW0b&data=02%7C01%7C%7C7b292c6997d0449a90c308d62e1186f4%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636747050137626026&sdata=mRDUi9jgvFntp%2FaGElPNQuFwcXex6jA6qabAWTMp6g0%3D&reserved=0>.

[AutomationSifu]

I know what the issue is now. When a testfixture is listed in two different hierarchies in the EnableTestOrdering.cs file, Visual Studio duplicates the number of tests.

[AutomationSifu]

I've attached a small sample EnableTestOrdering file to illustration the issue. In the sample file the Risk_Assessment_Generic test is the one that's being duplicated in Visual Studio.

sampleEnableTestOrdering.txt

[AutomationSifu]

@Sebazzz I hope all is well! Let me know if everything makes sense.

Thanks!

[AutomationSifu]

Hi @Sebazzz. I hope all is well! Checking in.

Thanks!

[Sebazzz]

When a testfixture is listed in two different hierarchies in the EnableTestOrdering.cs file, Visual Studio duplicates the number of tests

That makes sense. If you have the hierarchy twice, the tests are executed twice and are, essentially, twice the tests.

[AutomationSifu]

It runs the same test twice when I run the tests by category in Visual Studio even if the test is in a different hierarchy. In order to run successfully in Visual Studio I have to comment out the other hierarchies with the same test listed.

[Sebazzz]

That is probably due to the filter the VS extension uses. I don't believe it can be fixed from inside this library.

If you have the time, please try to debug it.

[AutomationSifu]

When you say debug it. Are you referring to debugging the VS extension?

Thanks!

[Sebazzz]

Yes, that's right. Met vriendelijke groet, Sebastiaan Dammann

…

________________________________ Van: AutomationSifu <notifications@github.com> Verzonden: Monday, April 29, 2019 5:49:34 PM Aan: Sebazzz/NUnitTestOrdering CC: Sebastiaan Dammann; Mention Onderwerp: Re: [Sebazzz/NUnitTestOrdering] Incorrect test count in Visual Studio when using NUnitTestOrdering library (#9) When you say debug it. Are you referring to debugging the VS extension? Thanks! — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub<https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FSebazzz%2FNUnitTestOrdering%2Fissues%2F9%23issuecomment-487634527&data=02%7C01%7C%7Cd25207aca3c340a0993108d6ccba47d1%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636921497764437247&sdata=TkUPfFnNzmzBbvRKtGBVXbnDFRQUQuBJRiwB6l3iwks%3D&reserved=0>, or mute the thread<https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAAK4FMJDSLOEXRGV5YTXGV3PS4KI5ANCNFSM4FYRNUNQ&data=02%7C01%7C%7Cd25207aca3c340a0993108d6ccba47d1%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636921497764447252&sdata=Hxk8JSLrUjwnvT2TZ7OH%2F1WZDOLEes9iV6ODIrZfAmE%3D&reserved=0>.

[AutomationSifu]

Thanks what's the best way to go about that?