Benjamin Day Consulting, Inc.: The Blog

Run tests from your TFS Team Build without a test list (.vsmdi) with code coverage

I got around to trying Buck Hodges' power toy that lets you run unit tests in your Team Foundation Server (TFS) Team Build without having to use a test list (aka “.vsmdi” file). 

It works well but getting code coverage to run with it was kind of a trick.  There's a post on forums.microsoft.com that discusses how to do it but -- uhhh -- it's kind of hard to understand and -- uhhh -- didn't work (exactly).  (The installation instructions for the power toy itself was super easy).

Here's the process for getting it all working with code coverage.

Download the power toy zip and extract the contents to a directory on your Team Build Server.

Copy “Microsoft.TeamFoundation.PowerToys.Tasks.QualityTools.dll“ to “C:\Program Files\Microsoft Visual Studio 8\Common7\IDE\PrivateAssemblies\“.

Copy "Microsoft.TeamFoundation.Build.targets" to "C:\Program files\MsBuild\Microsoft\VisualStudio\v8.0\TeamBuild".

Let's assume that you have an existing Team Build (MSBuild) script you're using to run a test list.  Open up the build script (TFSBuild.proj) and find the section that looks like this:

<ItemGroup> <!-- TEST ARGUMENTS If the RunTest is set to true then the following test arguments will be used to run tests. To add/delete new testlist or to choose a metadata file (.vsmdi) file, edit this value. For e.g. to run BVT1 and BVT2 type tests mentioned in the Helloworld.vsmdi file, add the following - <MetaDataFile Include="$(SolutionRoot)\HelloWorld\HelloWorld.vsmdi"> <TestList>BVT1;BVT2</TestList> </MetaDataFile> Where BVT1 and BVT2 are valid test types defined in the HelloWorld.vsmdi file. MetaDataFile - Full path to test metadata file. TestList - The test list in the selected metadata file to run. Please note that you need to specify the vsmdi file relative to $(SolutionRoot) --> <MetaDataFile Include="$(SolutionRoot)\MyTestLists.vsmdi"> <TestList>All Tests</TestList> </MetaDataFile> </ItemGroup>

Change that section so that it looks like this:

<ItemGroup> <TestContainerInOutput Include="MyProject.UnitTests.dll" /> </ItemGroup>

The important part here is removing the “MetaDataFile“ block and adding the “TestContainerInOutput” block.  (I removed the extra code comments, too but this is optional.)

Ok.  This takes case of getting the unit tests executing.  Now we need to add support for code coverage.  Since code coverage is configured in a testrunconfig file, we need need to tell the msbuild/test engine which testrunconfig to load and where to get it (the file's path).

Go back to the top of your MSBuild script and find the first “PropertyGroup” element.  It'll probably start something like this:

<PropertyGroup> <!-- TEAM PROJECT The team project which will be built using this build type. --> <TeamProject>My Team Project</TeamProject> <!-- BUILD DIRECTORY The directory on the build machine that will be used to build the selected solutions. The directory must be a local path on the build machine (e.g. c:\build). --> <BuildDirectoryPath>C:\code\TfsBuild\build</BuildDirectoryPath>

Find the end of the PropertyGroup tag and add a reference to your testrunconfig before the closing “PropertyGroup“ tag:

<RunConfigFile>$(SolutionRoot)\MyTestRunConfig.testrunconfig</RunConfigFile> </PropertyGroup>

Save your build script, check it in, and re-run your Team Build.  You should now be getting unit test and code coverage data without having to use a .vsmdi test list. 

-Ben

posted @ Friday, February 09, 2007 10:45 AM