{"id":13333,"date":"2016-03-18T08:46:14","date_gmt":"2016-03-18T08:46:14","guid":{"rendered":"https:\/\/blogs.msdn.microsoft.com\/visualstudioalm\/?p=13333"},"modified":"2019-02-14T17:36:15","modified_gmt":"2019-02-15T01:36:15","slug":"cloud-load-testing-rich-reports-in-the-web","status":"publish","type":"post","link":"https:\/\/devblogs.microsoft.com\/devops\/cloud-load-testing-rich-reports-in-the-web\/","title":{"rendered":"Cloud-load testing: rich reports in the web"},"content":{"rendered":"<p>As\u00a0perf. engineers run load tests, they not only want to analyze a load test run, but also obtain a quick overview of the key metrics, identify problem areas to focus on, view diagnostic information to analyze failures, etc. In addition,\u00a0when their application changes, they\u00a0want to compare load test\u00a0runs to understand if the app changes have caused any performance regressions or have led to the desired improvements. And, last but not the least, the ability to share load test results with the team is important too!<\/p>\n<p>Over the last few sprints, we have added rich\u00a0reporting capability in the web, so that\u00a0when you run a cloud-load test, you\u00a0can do all the above effortlessly. Whether you have run a test using Visual Studio IDE or run an Apache JMeter test using the portal, the rich reports are available for all types of tests. This blog covers some of these capabilities.<\/p>\n<ol>\n<li><strong>Load test run report<\/strong> &#8211; This report includes\u00a0the key performance indicators\u00a0such as Avg. response time, RPS, failed requests, etc. in the &#8216;summary&#8217; view. The &#8216;charts&#8217; tab contains the charts for performance and throughput indicators\u00a0for your\u00a0load test, while the &#8216;diagnostics&#8217; tab\u00a0provides insights into any test errors and important status messages from the load test service that may have\u00a0occurred during the load test run.\u00a0Load test run report is available for viewing not only after the load test run is completed, but you also get to see these metrics &#8216;live&#8217; when the load test is running.<\/li>\n<\/ol>\n<p><a href=\"https:\/\/devblogs.microsoft.com\/wp-content\/uploads\/sites\/6\/2019\/05\/ChartsTab.jpg\"><img decoding=\"async\" class=\"alignnone size-large wp-image-13353\" src=\"https:\/\/devblogs.microsoft.com\/devops\/wp-content\/uploads\/sites\/6\/2016\/03\/ChartsTab-1024x359.jpg\" alt=\"ChartsTab\" width=\"879\" height=\"308\" \/><\/a><\/p>\n<p>Once the load test completes, you also get to see the &#8220;Top 5 slowest requests&#8221; and &#8220;Top 5 slowest transactions&#8221; for your test, as applicable. This helps you quickly identify the problem area to focus on. Pick the top slowest request or transaction that&#8217;s critical to your app and focus on improving the\u00a0response \/ transaction time to improve the performance of your app.<\/p>\n<p><a href=\"https:\/\/devblogs.microsoft.com\/wp-content\/uploads\/sites\/6\/2019\/05\/SummaryView.jpg\"><img decoding=\"async\" class=\"alignnone size-large wp-image-13363\" src=\"https:\/\/devblogs.microsoft.com\/devops\/wp-content\/uploads\/sites\/6\/2016\/03\/SummaryView-1024x506.jpg\" alt=\"SummaryView\" width=\"879\" height=\"434\" \/><\/a><\/p>\n<p>&nbsp;<\/p>\n<p><strong>2. Compare two load test runs: <\/strong>Want to compare your current load test run to a previous run that\u00a0represents the baseline? You can simply pick the two runs and compare them\u00a0to know if the new run fared better than the previous one.<\/p>\n<p><a href=\"https:\/\/devblogs.microsoft.com\/wp-content\/uploads\/sites\/6\/2019\/05\/CompareTwoRuns.png\"><img decoding=\"async\" class=\"alignnone size-large wp-image-13373\" src=\"https:\/\/devblogs.microsoft.com\/devops\/wp-content\/uploads\/sites\/6\/2016\/03\/CompareTwoRuns-1024x559.png\" alt=\"CompareTwoRuns\" width=\"879\" height=\"480\" \/><\/a><\/p>\n<p>A quick glance at the key metrics tells you\u00a0whether performance improved\u00a0or regressed. You can also compare\u00a0perf. data over the course of load test execution, in the chart.<\/p>\n<p><a href=\"https:\/\/devblogs.microsoft.com\/wp-content\/uploads\/sites\/6\/2019\/05\/R2R-Comparison.jpg\"><img decoding=\"async\" class=\"alignnone size-large wp-image-13383\" src=\"https:\/\/devblogs.microsoft.com\/devops\/wp-content\/uploads\/sites\/6\/2016\/03\/R2R-Comparison-1024x606.jpg\" alt=\"R2R Comparison\" width=\"879\" height=\"520\" \/><\/a><\/p>\n<p><strong>3. Share the results with your team:\u00a0<\/strong>These reports are available in the VSTS portal, so your team members can also view it. Just share the URL of the comparison report you generated.<\/p>\n<p>Go ahead, try it out and share your feedback. You can reach us at <a href=\"mailto:vsoloadtest@microsoft.com\">vsoloadtest@microsoft.com<\/a><\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>As\u00a0perf. engineers run load tests, they not only want to analyze a load test run, but also obtain a quick overview of the key metrics, identify problem areas to focus on, view diagnostic information to analyze failures, etc. In addition,\u00a0when their application changes, they\u00a0want to compare load test\u00a0runs to understand if the app changes have [&hellip;]<\/p>\n","protected":false},"author":86,"featured_media":45953,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-13333","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-devops"],"acf":[],"blog_post_summary":"<p>As\u00a0perf. engineers run load tests, they not only want to analyze a load test run, but also obtain a quick overview of the key metrics, identify problem areas to focus on, view diagnostic information to analyze failures, etc. In addition,\u00a0when their application changes, they\u00a0want to compare load test\u00a0runs to understand if the app changes have [&hellip;]<\/p>\n","_links":{"self":[{"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/posts\/13333","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/users\/86"}],"replies":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/comments?post=13333"}],"version-history":[{"count":0,"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/posts\/13333\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/media\/45953"}],"wp:attachment":[{"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/media?parent=13333"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/categories?post=13333"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/tags?post=13333"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}