Load Test Plug-ins<\/strong><\/p>\nThis blog post is going to go over creating a load test plug-in and show a few different ways you can use a plug-in to modify your load test.\u00a0 These plug-ins are a powerful extensibility point of the load test architecture.\u00a0 They give you the opportunity to do things such as change the selected test, change the userload, add data to the web test context, modify the test environment before the test runs or clean up the environment when the test completes.<\/p>\n
Overview<\/h3>\n
1) Here are the following events that you can connect to:<\/p>\n
a. Heartbeat \u2013 This event is raised every second. If you want to monitor some vairable and then modify user load based on that variable, this would be a good event to connect to.<\/p>\n
b. LoadTestStarting \u2013 This event is raised when the load test starts. This is a good event for things such as setting up the envoironment or maybe starting logging for a report you might want to create.<\/p>\n
c. LoadTestFinished \u2013 This event is raised when the load test completes. This is a good event for things such as cleaning up the envoironment or maybe stopping logging for a report you might want to create.<\/p>\n
d. LoadTestAborted \u2013 This event is raised if a load test is aborted.<\/p>\n
e. WarmupComplete \u2013 This event is raised if you are using a warmup period and when the warmup period completes.<\/p>\n
f. TestSelected \u2013 This event is raised when a test has been selected to be executed. You can change what test is about to be executed from this event.<\/p>\n
g. TestStarting \u2013 This event is raised when a test iteration is about to start. You can add items to the test context from this event.<\/p>\n
h. TestFinished \u2013 This event is raised when a test completes. You get information about the test that was just executed.<\/p>\n
i. ThresholdExceeded \u2013 This event is raised when a threshold rule has been exceeded. You are given information about the counter that caused the rule to fire.<\/p>\n
2) Creating a LoadTest Plug-in<\/p>\n
a. Open the test project that contains your load test.<\/p>\n
b. Add a new class file<\/p>\n
c. Add a using statement for<\/p>\n
using Microsoft.VisualStudio.TestTools.LoadTesting;<\/p>\n
d. Have the class implement the ILoadTestPlugin interface.\u00a0<\/p>\n
public class Class2 : ILoadTestPlugin<\/p>\n
e. There is one method in the interface that you have to implement:<\/p>\n
public void Initialize(LoadTest loadTest)<\/p>\n
f. Here is an example plugin:<\/p>\n
using Microsoft.VisualStudio.TestTools.LoadTesting;<\/p>\n
namespace TestProject3<\/p>\n
{<\/p>\n
public class PluginExample : ILoadTestPlugin<\/p>\n
{<\/p>\n
LoadTest m_loadTest;<\/p>\n
region ILoadTestPlugin Members<\/h2>\n
public void Initialize(LoadTest loadTest)<\/p>\n
{<\/p>\n
m_loadTest = loadTest;<\/p>\n
}<\/p>\n
endregion<\/h2>\n
}<\/p>\n
}<\/p>\n
g. To set the plugin on your load test, first compile the plugin. Then right click on the root node of the load test and select \u201cSet Load Test Plug-in\u2026\u201d. In the dialog that appears, select your plug-in.<\/p>\n
Examples<\/h3>\n
Now let\u2019s create some examples.<\/p>\n
Storing extra information with a run<\/h4>\n
The first example we will create is storing extra information along with your load test. One common question we get is I would also like to store build number or something like that with my load tests. Then the users would like to be able to use this information in a report they are creating.<\/p>\n
First we will create a separate table in the load test results store to hold the new info. Part of the key for all load test tables in the LoadTestRunId. Here is a simple table definition:<\/p>\n
CREATE TABLE [dbo].[LoadTestBuildInfo](<\/p>\n
[LoadTestRunId] [int] NOT NULL,<\/p>\n
[Build] [nvarchar](100) NULL,<\/p>\n
CONSTRAINT [PK_LoadTestBuildInfo] PRIMARY KEY CLUSTERED<\/p>\n
(<\/p>\n
[LoadTestRunId] ASC<\/p>\n
) ON [PRIMARY]<\/p>\n
So we need three things to write to this table. The connection string, the run id and the build. We will add the build information as a Load Test Context parameter. The connection string we will make an option parameter. The run id we will get from the database.<\/p>\n
Unfortunately, we do not give you the runid through an API, so we will just query the LoadTestRun table for the max run id. Unless you have multiple runs going at once, this will be the value you need.<\/p>\n
First here is a hlper class that contains the sql operations:<\/p>\n
using System;<\/p>\n
using System.Globalization;<\/p>\n
using System.Data.SqlClient;<\/p>\n
namespace ApiDemo<\/p>\n
{<\/p>\n
class SqlHelper<\/p>\n
{<\/p>\n
static string s_connectionString;<\/p>\n
public static void SetConnectionString(string connectionString)<\/p>\n
{<\/p>\n
s_connectionString = connectionString;<\/p>\n
}<\/p>\n
public static int GetRunId()<\/p>\n
{<\/p>\n
string sql = “SELECT MAX(LoadTestRunId) FROM LoadTestRun”;<\/p>\n
using (SqlConnection connection = new SqlConnection(s_connectionString))<\/p>\n
{<\/p>\n
connection.Open();<\/p>\n
using (SqlCommand sqlCommand = new SqlCommand(sql, connection))<\/p>\n
{<\/p>\n
using (SqlDataReader dataReader = sqlCommand.ExecuteReader())<\/p>\n
{<\/p>\n
if (dataReader.Read())<\/p>\n
{<\/p>\n
return dataReader.GetInt32(0);<\/p>\n
}<\/p>\n
}<\/p>\n
}<\/p>\n
}<\/p>\n
throw new Exception(“Unable to get the run id”);<\/p>\n
}<\/p>\n
public static void StoreBuild(int id, string build)<\/p>\n
{<\/p>\n
string sql = string.Format(“INSERT INTO LoadTestBuildInfo (LoadTestRunId,Build) Values ({0},'{1}’)”, id, build);<\/p>\n
using (SqlConnection connection = new SqlConnection(s_connectionString))<\/p>\n
{<\/p>\n
connection.Open();<\/p>\n
using (SqlCommand sqlCommand = new SqlCommand(sql, connection))<\/p>\n
{<\/p>\n
sqlCommand.ExecuteNonQuery();<\/p>\n
}<\/p>\n
}<\/p>\n
}<\/p>\n
}<\/p>\n
}<\/p>\n
Second, here is the load test plugin:<\/p>\n
using Microsoft.VisualStudio.TestTools.LoadTesting;<\/p>\n
namespace ApiDemo<\/p>\n
{<\/p>\n
public class PluginExample : ILoadTestPlugin<\/p>\n
{<\/p>\n
LoadTest m_loadTest;<\/p>\n
static string s_connectionString = “Data Source=”.\\SQLEXPRESS”;Initial Catalog=LoadTest;Integrated Security=True”;<\/p>\n
public void Initialize(LoadTest loadTest)<\/p>\n
{<\/p>\n
m_loadTest = loadTest;<\/p>\n
m_loadTest.LoadTestStarting += new System.EventHandler(m_loadTest_LoadTestStarting);<\/p>\n
}<\/p>\n
void m_loadTest_LoadTestStarting(object sender, System.EventArgs e)<\/p>\n
{<\/p>\n
\/\/first get the connection string<\/p>\n
if (m_loadTest.Context.ContainsKey(“ConnectionString”))<\/p>\n
{<\/p>\n
SqlHelper.SetConnectionString(m_loadTest.Context[“ConnectionString”].ToString());<\/p>\n
}<\/p>\n
else<\/p>\n
{<\/p>\n
SqlHelper.SetConnectionString(s_connectionString);<\/p>\n
}<\/p>\n
\/\/now we need to get the runid.<\/p>\n
int loadTestRunId = SqlHelper.GetRunId();<\/p>\n
\/\/now store the build info<\/p>\n
if (m_loadTest.Context.ContainsKey(“Build”))<\/p>\n
{<\/p>\n
SqlHelper.StoreBuild(loadTestRunId, m_loadTest.Context[“Build”].ToString());<\/p>\n
}<\/p>\n
}<\/p>\n
}<\/p>\n
}<\/p>\n
Now that you have the build stored with the run id, you can easily add this to any custom reports.<\/p>\n
Changing the Selected Test<\/h4>\n
This sample will show you how to change the test that the engine has selected. Maybe you have a situation in which your test mix has 4 tests. After a certain amount of time, you no longer want to run Test4. So any time it is selected, you want to replace it with one of the other 3. You can do this from the TestSelected event. We will also use the heartbeat event to keep track of how much time has been executed. In the heartbeat event, we will increase a counter once warm-up is complete. Then in the TestSelected event, after 120 seconds, we will always switch WebTest1 with WebTest2. You can make this more intelligent by selecting a test from the list of tests in the scenario specified in the event args.<\/p>\n
using Microsoft.VisualStudio.TestTools.LoadTesting;<\/p>\n
using System.Collections.Generic;<\/p>\n
using System.Linq;<\/p>\n
namespace ApiDemo<\/p>\n
{<\/p>\n
public class PluginExample2 : ILoadTestPlugin<\/p>\n
{<\/p>\n
LoadTest m_loadTest;<\/p>\n
int count = 0;<\/p>\n
public void Initialize(LoadTest loadTest)<\/p>\n
{<\/p>\n
m_loadTest = loadTest;<\/p>\n
m_loadTest.TestSelected += new System.EventHandler(m_loadTest_TestSelected);<\/p>\nm_loadTest.Heartbeat += new System.EventHandler(m_loadTest_Heartbeat);<\/p>\n}<\/p>\n
void m_loadTest_Heartbeat(object sender, HeartbeatEventArgs e)<\/p>\n
{<\/p>\n
if(e.IsWarmupComplete)<\/p>\n
{<\/p>\n
count++;<\/p>\n
}<\/p>\n
}<\/p>\n
void m_loadTest_TestSelected(object sender, TestSelectedEventArgs e)<\/p>\n
{<\/p>\n
if (count > 120 && e.TestName.Equals(“WebTest1”))<\/p>\n
{<\/p>\n
e.TestName = “WebTest2”;<\/p>\n
}<\/p>\n
}<\/p>\n
}<\/p>\n
}<\/p>\n
Change the User Load<\/h4>\n
This sample will show you how you can change the user load of a running load test. You can create your own custom load profiles with this extensibility point. In this example we will create a plugin which reads the load from a text file and then changes the load of the running test to that value.<\/p>\n
The file name that stores the user load can be set from a load test context parameter.\u00a0 Then we will read that file at every heartbeat event, and change the load to that value. Another good demo of this would be to create a simple winforms app that writes the new user load to a file or registry location. Then have the plugin read from that location. Then you could turn a knob or enter the user load that way. With the way this sample is written, you would simply add a number to the text file and save it. You can change the value while the test is running.<\/p>\n
using System;<\/p>\n
using System.IO;<\/p>\n
using Microsoft.VisualStudio.TestTools.LoadTesting;<\/p>\n
namespace ApiDemo<\/p>\n
{<\/p>\n
public class PluginSample3 : ILoadTestPlugin<\/p>\n
{<\/p>\n
LoadTest m_loadTest;<\/p>\n
string m_fileName;<\/p>\n
public void Initialize(LoadTest loadTest)<\/p>\n
{<\/p>\n
m_loadTest = loadTest;<\/p>\n
m_loadTest.Heartbeat += new System.EventHandler(m_loadTest_Heartbeat);<\/p>\n\/\/initialize the file name<\/p>\n
if (m_loadTest.Context.ContainsKey(“FileName”))<\/p>\n
{<\/p>\n
m_fileName = m_loadTest.Context[“FileName”].ToString();<\/p>\n
}<\/p>\n
else<\/p>\n
{<\/p>\n
m_fileName = @”c:Userload.txt”;<\/p>\n
}<\/p>\n
}<\/p>\n
void m_loadTest_Heartbeat(object sender, HeartbeatEventArgs e)<\/p>\n
{<\/p>\n
int load = GetUserLoadFromFile();<\/p>\n
if (load != -1)<\/p>\n
{<\/p>\n
m_loadTest.Scenarios[0].CurrentLoad = load;<\/p>\n
}<\/p>\n
}<\/p>\n
private int GetUserLoadFromFile()<\/p>\n
{<\/p>\n
int newLoad = -1;<\/p>\n
try<\/p>\n
{<\/p>\n
using (StreamReader streamReader = new StreamReader(m_fileName))<\/p>\n
{<\/p>\n
string load = streamReader.ReadToEnd();<\/p>\n
try<\/p>\n
{<\/p>\n
if (!string.IsNullOrEmpty(load))<\/p>\n
{<\/p>\n
newLoad = int.Parse(load);<\/p>\n
}<\/p>\n
}<\/p>\n
catch (FormatException)<\/p>\n
{<\/p>\n
\/\/ignore<\/p>\n
}<\/p>\n
}<\/p>\n
}<\/p>\n
catch (IOException)<\/p>\n
{<\/p>\n
\/\/ignore<\/p>\n
}<\/p>\n
return newLoad;<\/p>\n
}<\/p>\n
}<\/p>\n
}<\/p>\n
Here is a picture of my userload. I start at 25, up to 52, down to 7 and back to 25.<\/p>\n
![](\"https:\/\/devblogs.microsoft.com\/devops\/wp-content\/uploads\/sites\/6\/2015\/12\/UserLoad.jpg\")
<\/p>\n
Adding values to Test Context<\/h4>\n
This sample will show you how you can modify the test context that is being passed to a test. You do this from the test starting event. Maybe there is a value you are reading in from a database or some other value that you want to pass into each test. Another problem is that load test context parameters are not copied to test context of unit tests. This plug-in would copy those values:<\/p>\n
using System;<\/p>\n
using System.Collections.Generic;<\/p>\n
using System.Text;<\/p>\n
using Microsoft.VisualStudio.TestTools.LoadTesting;<\/p>\n
namespace Blog<\/p>\n
{<\/p>\n
public class CopyParamtersPlugin : ILoadTestPlugin<\/p>\n
{<\/p>\n
\/\/store the load test object.<\/p>\n
LoadTest mLoadTest;<\/p>\n
public void Initialize(LoadTest loadTest)<\/p>\n
{<\/p>\n
mLoadTest = loadTest;<\/p>\n
\/\/connect to the TestStarting event.<\/p>\n
mLoadTest.TestStarting += new EventHandler(mLoadTest_TestStarting);<\/p>\n}<\/p>\n
void mLoadTest_TestStarting(object sender, TestStartingEventArgs e)<\/p>\n
{<\/p>\n
\/\/When the test starts, copy the load test context parameters to<\/p>\n
\/\/the test context parameters<\/p>\n
foreach (string key in mLoadTest.Context.Keys)<\/p>\n
{<\/p>\n
e.TestContextProperties.Add(key, mLoadTest.Context[key]);<\/p>\n
}<\/p>\n
}<\/p>\n
}<\/p>\n
}<\/p>\n","protected":false},"excerpt":{"rendered":"
This week I have had two questions that involved the need to create a load test plugin.\u00a0\u00a0 In the latest scenario the person wanted Cloud-based load test to ramp up the user count randomly. Yes plugins work the same for both on-premises and Cloud-based load testing.\u00a0 In this post i will walk through creating a […]<\/p>\n","protected":false},"author":63,"featured_media":45953,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[1,252],"tags":[],"class_list":["post-10662","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-devops","category-testing"],"acf":[],"blog_post_summary":"
This week I have had two questions that involved the need to create a load test plugin.\u00a0\u00a0 In the latest scenario the person wanted Cloud-based load test to ramp up the user count randomly. Yes plugins work the same for both on-premises and Cloud-based load testing.\u00a0 In this post i will walk through creating a […]<\/p>\n","_links":{"self":[{"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/posts\/10662","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/users\/63"}],"replies":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/comments?post=10662"}],"version-history":[{"count":0,"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/posts\/10662\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/media\/45953"}],"wp:attachment":[{"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/media?parent=10662"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/categories?post=10662"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/tags?post=10662"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
![\"image\"](\"https:\/\/devblogs.microsoft.com\/devops\/wp-content\/uploads\/sites\/6\/2015\/12\/3302.image_thumb_637CEAB4.png\" "\\"image\\"")
<\/p>\n![\"image\"](\"https:\/\/devblogs.microsoft.com\/devops\/wp-content\/uploads\/sites\/6\/2015\/12\/7127.image_thumb_1C2794C2.png\" "\\"image\\"")
<\/p>\n![\"image\"](\"https:\/\/devblogs.microsoft.com\/devops\/wp-content\/uploads\/sites\/6\/2015\/12\/6567.image_thumb_5E9A36F8.png\" "\\"image\\"")
<\/p>\n![\"image\"](\"https:\/\/devblogs.microsoft.com\/devops\/wp-content\/uploads\/sites\/6\/2015\/12\/4807.image_thumb_0C1B56BC.png\" "\\"image\\"")
<\/p>\n![\"image\"](\"https:\/\/devblogs.microsoft.com\/devops\/wp-content\/uploads\/sites\/6\/2015\/12\/1602.image_thumb_476EBC7A.png\" "\\"image\\"")
<\/p>\n![\"image\"](\"https:\/\/devblogs.microsoft.com\/devops\/wp-content\/uploads\/sites\/6\/2015\/12\/7450.image_thumb_428C08BE.png\" "\\"image\\"")
<\/p>\n