{"id":15391,"date":"2016-04-11T21:30:32","date_gmt":"2016-04-11T14:30:32","guid":{"rendered":"https:\/\/blogs.msdn.microsoft.com\/visualstudioalm\/?p=15391"},"modified":"2019-02-14T17:34:07","modified_gmt":"2019-02-15T01:34:07","slug":"test-execution-improvements-apr-2016","status":"publish","type":"post","link":"https:\/\/devblogs.microsoft.com\/devops\/test-execution-improvements-apr-2016\/","title":{"rendered":"Test execution improvements \u2013 Apr 2016"},"content":{"rendered":"<p>About a month ago, I published a blog detailing <a title=\"Testing tools roadmap\" href=\"https:\/\/blogs.msdn.microsoft.com\/visualstudioalm\/2016\/03\/10\/visual-studio-team-services-testing-tools-roadmap\/\">Testing tools roadmap<\/a> and the value we have delivered over the last six months. If you have not seen it yet, I will encourage you to read and provide feedback. We continue to focus on efficient test execution across automated, manual and exploratory testing\u00a0scenarios. Here are some enhancements that we intend to deliver in the\u00a0next 6 months:<\/p>\n<p>NOTE: As with any roadmap, timeline is subject to change and designs below are early mockups to illustrate concepts.<\/p>\n<p><strong>MStest convergence\u00a0: DONE.\u00a0 <\/strong>Please find more information <a href=\"https:\/\/blogs.msdn.microsoft.com\/visualstudioalm\/2016\/06\/17\/taking-the-mstest-framework-forward-with-mstest-v2\/\">here <\/a><\/p>\n<p>We are consolidating many variants of MStest into a single variant that works across different application platforms &#8211; Win32, Phone, UWP, ASP.NET Core 1.0, and .NET Core. This consolidation will bring in one of the highest asked items on UserVoice (<a title=\"Data Row Support\" href=\"https:\/\/visualstudio.uservoice.com\/forums\/330519-team-services\/suggestions\/3865310-allow-use-of-datatestmethod-datarow-in-all-unit\"><em>DataRow support<\/em><\/a>), a clean end-user extensibility mechanism, and a single codebase to evolve.<\/p>\n<p>&nbsp;<\/p>\n<p><strong>Test explorer enhancements:<\/strong> We have been getting lots of feedback on improving VS IDE test explorer experience on <a title=\"User Voice\" href=\"https:\/\/visualstudio.uservoice.com\/forums\/330519-team-services\/suggestions\/5126061-test-explorer-is-severely-limited\">UserVoice<\/a> \u2013 we are starting with a few important ones and will continue to work on others to make it more usable.<\/p>\n<ul>\n<li>Open the Test Explorer window immediately after tests are run (especially when run from the code editor window)<\/li>\n<li>Enable select-and-copy from the test details pane<\/li>\n<li>Enable select-and-copy from the Test Output window in the Test Explorer<\/li>\n<li>Fix test duration reporting<\/li>\n<li>Don&#8217;t ask to run the test from previous build if build fails<\/li>\n<\/ul>\n<p><strong>Flaky tests and test history: <\/strong>We will make it easy for you to identify flaky tests and provide test results history across all workflows, various branches and environments.<\/p>\n<p><strong>Test History: DONE<\/strong><\/p>\n<p>&nbsp;<\/p>\n<p><img decoding=\"async\" class=\" wp-image-15392 alignnone\" src=\"https:\/\/devblogs.microsoft.com\/devops\/wp-content\/uploads\/sites\/6\/2016\/04\/Test-History-1024x576.png\" alt=\"Test History\" width=\"672\" height=\"378\" \/><\/p>\n<p><strong>BDT support for Azure, SCVMM and VMWare environments:\u00a0 DONE. <\/strong><\/p>\n<p>We now have in-built tasks in CI\/RM workflows to dynamically provision VMs and take appropriate actions like start, stop, snapshot, restore etc. You can leverage these tasks to create powerful BDT workflows for your needs. This should enable you to bring MTM and XAML based BDT workflows forward.<\/p>\n<p><strong>Insights across Exploratory Testing sessions:<\/strong>\u00a0 <strong>DONE<\/strong>.<\/p>\n<p>You can view all the exploratory sessions your team has completed in the Runs hub in Test Hub group. You can group your sessions by the user stories explored, sessions or session owners and gather additional insights.<\/p>\n<p><a href=\"https:\/\/devblogs.microsoft.com\/wp-content\/uploads\/sites\/6\/2019\/05\/XT-Session.jpg\"><img decoding=\"async\" class=\" wp-image-15402 aligncenter\" src=\"https:\/\/devblogs.microsoft.com\/devops\/wp-content\/uploads\/sites\/6\/2016\/04\/XT-Session-1024x473.jpg\" alt=\"XT Session\" width=\"710\" height=\"328\" \/><\/a><\/p>\n<p>&nbsp;<\/p>\n<p><strong>Feedback mode in Exploratory Testing extension: <\/strong>We plan to extend the Exploratory testing browser extension to include \u201cfeedback\u201d mode targeted at Stakeholders. In this mode, stakeholders can provide feedback responses to solicited feedback or submit voluntary feedback for the engineering teams to process.<\/p>\n<p><strong>Load testing:\u00a0\u00a0 DONE. <\/strong><\/p>\n<p>We intend to deliver a compelling Import\/Create &#8211; execute &#8211; analyze web experience for all VSTS and Azure App Service Plan customers.\u00a0 We will enhance the reporting capabilities to include run-over-run comparisons. You will be able to create load tests using HTTP archive,\u00a0Fiddler traces or by importing a VS web test.\u00a0 You can also\u00a0bring your own load test rig either on premises or on Azure IaaS and use it with cloud load testing service.\u00a0\u00a0Similar to VSTS CI\/RM tasks, Azure app service customers will be able to include performance tests as part of their deployment pipeline.<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>About a month ago, I published a blog detailing Testing tools roadmap and the value we have delivered over the last six months. If you have not seen it yet, I will encourage you to read and provide feedback. We continue to focus on efficient test execution across automated, manual and exploratory testing\u00a0scenarios. Here are [&hellip;]<\/p>\n","protected":false},"author":191,"featured_media":45953,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[224,226,1,252],"tags":[],"class_list":["post-15391","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-azure","category-ci","category-devops","category-testing"],"acf":[],"blog_post_summary":"<p>About a month ago, I published a blog detailing Testing tools roadmap and the value we have delivered over the last six months. If you have not seen it yet, I will encourage you to read and provide feedback. We continue to focus on efficient test execution across automated, manual and exploratory testing\u00a0scenarios. Here are [&hellip;]<\/p>\n","_links":{"self":[{"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/posts\/15391","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/users\/191"}],"replies":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/comments?post=15391"}],"version-history":[{"count":0,"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/posts\/15391\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/media\/45953"}],"wp:attachment":[{"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/media?parent=15391"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/categories?post=15391"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/tags?post=15391"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}