Split out non concurrent test collections.

[michaelgsharp]

Split out non-concurrent test collections to improve performance.

[codecov]

Codecov Report

Attention: 65 lines in your changes are missing coverage. Please review.

Comparison is base (373a864) 68.80% compared to head (a8dfb40) 68.81%.
Report is 1 commits behind head on main.

Additional details and impacted files

@@           Coverage Diff            @@
##             main    #6937    +/-   ##
========================================
  Coverage   68.80%   68.81%            
========================================
  Files        1249     1249            
  Lines      249436   249644   +208     
  Branches    25468    25481    +13     
========================================
+ Hits       171635   171783   +148     
- Misses      71211    71271    +60     
  Partials     6590     6590            

Flag	Coverage Δ
Debug	68.81% <75.00%> (+<0.01%)	⬆️
production	63.28% <95.45%> (+0.01%)	⬆️
test	88.41% <68.04%> (-0.09%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Files	Coverage Δ
.../Microsoft.ML.TorchSharp/NasBert/NasBertTrainer.cs	80.36% <100.00%> (+0.24%)	⬆️
...c/Microsoft.ML.TorchSharp/TorchSharpBaseTrainer.cs	84.98% <100.00%> (ø)
...ft.ML.Core.Tests/UnitTests/TestResourceDownload.cs	0.00% <ø> (ø)
...ft.ML.TensorFlow.Tests/TensorFlowEstimatorTests.cs	98.50% <ø> (ø)
...t/Microsoft.ML.TensorFlow.Tests/TensorflowTests.cs	91.71% <ø> (ø)
test/Microsoft.ML.Tests/DatabaseLoaderTests.cs	94.41% <100.00%> (+0.17%)	⬆️
...rosoft.ML.TorchSharp.Tests/ObjectDetectionTests.cs	100.00% <ø> (ø)
test/Microsoft.ML.TorchSharp.Tests/QATests.cs	40.50% <ø> (ø)
...oft.ML.TorchSharp.Tests/TextClassificationTests.cs	85.17% <ø> (ø)
src/Microsoft.ML.TorchSharp/NasBert/NerTrainer.cs	91.10% <94.73%> (+2.86%)	⬆️
... and 1 more

... and 5 files with indirect coverage changes

[ericstj]

Consider trying out @ViktorHofer's solution for excluding the entire project from the SLN traversal. dotnet/xdt@main...DoCoolFiltering

[michaelgsharp]

I thought I would do that in another PR so that we can start getting the benefits now of the faster tests/no timeouts. And I have excluded this assembly from helix testing as well for non x64, so it won't affect those tests at all either.

[tarekgh]

I am not fully understand @ericstj comment. This looks excluding some source file when running on x64. How excluding the entire project work here?

[ericstj]

Yeah, this was just a consider. I'm completely fine excluding things as you did, since it looks like we already do that for a lot of other projects. If you feel strongly about not building this then file an issue on that.

[michaelgsharp]

@tarekgh could you take a quick look at this when you have a minute? It just splits out some test assemblies so we can run more in parallel.

[tarekgh]

Added a couple of questions. LGTM!

[michaelgsharp]

/backport to release/3.0

[github-actions]

Started backporting to release/3.0: https://github.com/dotnet/machinelearning/actions/runs/7455070236

[michaelgsharp]

/backport to release/3.0

[github-actions]

Started backporting to release/3.0: https://github.com/dotnet/machinelearning/actions/runs/7464450572