TFS 2015 Test Agent has not been configured. Run the Test Agent Configuration Tool to configure the test agent.

Overview

At the time of writing if you are using Lab Management with TFS, and you have upgraded to 2015, you should keep using the Test Controller and Agents for 2013.

If you install the TFS 2015 agents, and try and run them without configuring through test management, you will receive the following message:

“Test Agent has not been configured. Run the Test Agent Configuration Tool to configure the test agent”

Detail

In the  news (https://www.visualstudio.com/news/vs2015-vs) it was announced that Agents no longer needed a Test Controller, as the agent orchestration is managed by the server (TFS or VSO). This is to support the continuous delivery model, and this is outlined in this post:

http://blogs.msdn.com/b/visualstudioalm/archive/2015/05/29/testing-in-continuous-integration-and-continuous-deployment-workflows.aspx

Using the Test Hub allows for the creation of a machine group, for already provisioned machines:

The recommendation does not apply to Lab Management, as the labs require a test controller, or load tests, as they also require a controller.

If you are using MTM to run your automated tests, you must use a lab environment (https://msdn.microsoft.com/en-us/library/dd380741.aspx#AddEnvironment), therefore a controller.

If this is on an upgraded machine, you will notice that the 2013 versions have the necessary tools:

This is supported with the documentation at

https://msdn.microsoft.com/en-us/library/hh546459.aspx

where the guidance is

“To install a test controller

1. Agents for Microsoft Visual Studio 2013 Update 5, if you haven’t already. Follow the installation instructions on the download page.”

and https://msdn.microsoft.com/en-us/library/dd648127.aspx where the compatible and supported combinations are:

TFS	Microsoft Test Manager, with Lab Center	Controller	Agent
2015: upgrade from 2013	2013	2013	2013
2015: new install	2013	2013	2013
2015: upgrade from 2015 or new install	2015	2013	2013
2013	2015	2013	2013

You will notice that the controller and the agents are all specified as being 2013.

I would anticipate that there will be an update to this in the next Server on Premises release. Where there will be a closing of the gap with the Release Management/Lab Management story.