Visual Studio test discovery for sqlprojs

[tobymiller]

@zijchen You might recall I'm writing a tSQLt test runner for Microsoft.Build.Sql projects. Test discovery is working happily when using dotnet test (via VSTest). But in Visual Studio 2022 with the preview for Microsoft.Build.Sql the tests don't show up, even after building and clicking 'Run All'.

I wonder if VSTest discovery is just not enabled for sqlprojs in Visual Studio? Would you expect this to work?

[zijchen]

Is the test discovery working for any SDK version or stopped working with 2.0.0-preview.1?

[tobymiller]

I didn't try it before so I expect it's never done VSTest discovery for sqlprojs, but I can try some combinations if you like. Is it the SDK that might make the difference, or the visual studio preview module?

[zijchen]

You can just try 2.0.0-preview.1 vs an earlier one. It's either missing from the extension entirely, or caused by the change in v2 to remove the .dll from output.

[tobymiller]

Weirdly it isn't working for either, but possibly for different reasons. I took the logs from the 'Test' section when attempting test discovery in VS, vs the logs from dotnet test -t for the same project:

v1.0.0 (VS):

ProjectData: Could not find project with GUID 08f0b22a-b94c-4a5e-8833-8e1595847121
ProjectData: Could not find project with GUID 08f0b22a-b94c-4a5e-8833-8e1595847121
ProjectData: Could not find project with GUID 08f0b22a-b94c-4a5e-8833-8e1595847121
No tests found to run.
ProjectData: Could not find project with GUID 08f0b22a-b94c-4a5e-8833-8e1595847121
ProjectData: Could not find project with GUID 08f0b22a-b94c-4a5e-8833-8e1595847121
ProjectData: Could not find project with GUID 08f0b22a-b94c-4a5e-8833-8e1595847121
Starting test discovery for requested test run
========== Starting test discovery ==========
No test is available in <path>\<project>\<project>.TsqltTest\bin\Debug\<project>.TsqltTest.dll. Make sure that test discoverer & executors are registered and platform & framework version settings are appropriate and try again.
========== Test discovery finished: 0 Tests found in 617.9 ms ==========
No tests found to run.

---

v1.0.0 (dotnet test)

dotnet test DB\<project>\<project>.TsqltTest\<project>.TsqltTest.sqlproj -t
  Determining projects to restore...
  All projects are up-to-date for restore.
  <project>.TsqltTest -> <path>\<project>\<project>.TsqltTest\bin\Debug\<project>.TsqltTest.dll
  <project>.TsqltTest -> <path>\<project>\<project>.TsqltTest\bin\Debug\<project>.TsqltTest.dacpac
Test run for <path>\<project>\<project>.TsqltTest\bin\Debug\<project>.TsqltTest.dll (.NETCoreApp,Version=v8.0)
VSTest version 17.11.1 (x64)

The following Tests are available:
    [dbo].[test placeholder test]

---

v2.0.0-preview.1 (VS)

ProjectData: Could not find project with GUID 08f0b22a-b94c-4a5e-8833-8e1595847121
ProjectData: Could not find project with GUID 08f0b22a-b94c-4a5e-8833-8e1595847121
ProjectData: Could not find project with GUID 08f0b22a-b94c-4a5e-8833-8e1595847121
No tests found to run.
ProjectData: Could not find project with GUID 08f0b22a-b94c-4a5e-8833-8e1595847121
ProjectData: Could not find project with GUID 08f0b22a-b94c-4a5e-8833-8e1595847121
ProjectData: Could not find project with GUID 08f0b22a-b94c-4a5e-8833-8e1595847121
Starting test discovery for requested test run
========== Starting test discovery ==========
No test is available in <path>\<project>\<project>.TsqltTest\bin\Debug\<project>.TsqltTest.dll. Make sure that test discoverer & executors are registered and platform & framework version settings are appropriate and try again.
========== Test discovery finished: 0 Tests found in 617.9 ms ==========
No tests found to run.
Test data store opened in 0.002 sec.
No tests found to run.

---

v2.0.0-preview.1 (dotnet test)

dotnet test DB\<project>\<project>.TsqltTest\<project>.TsqltTest.sqlproj -t
  Determining projects to restore...
  All projects are up-to-date for restore.
  <project>.TsqltTest -> <path>\<project>\<project>.TsqltTest\bin\Debug\<project>.TsqltTest.dacpac
Test run for <path>\<project>\<project>.TsqltTest\bin\Debug\<project>.TsqltTest.dacpac (.NETCoreApp,Version=v8.0)
VSTest version 17.11.1 (x64)

The following Tests are available:
    [<project>.TsqltTest].[dbo].[test placeholder test]

[tobymiller]

Ignore the extra project name in the test – that was a change in the runner.

It looks like VS does expect to run test discovery for a dll, even when there is none in v2. But even in v1 where there was a dll, it still couldn't find the tests.

[zijchen]

Looks like we need to add some support to VS test explorer for SDK style database projects