[Test TFS-Git Port tool] CSharpGenerateTypeDialog test fails intermittently in build queues #222
Description
Ported from TFS ID: 1111422 (vstfs:///WorkItemTracking/WorkItem/1111422)
Repro Steps:
Recent 2 failures, both seem to have different failure logs though:
1)
Main-PerCheckin-VisualStudioIntegrationTests_20150119.25 - Partially Succeeded
Open Build Report in Visual Studio | Open Build Report in Web Access
2)
Main-PerCheckin-Debug_20150119.27 - Partially Succeeded
Open Build Report in Visual Studio | Open Build Report in Web Access
FAILURE 1:
2/3 scenarios passed.
System.InvalidOperationException: Sequence contains no matching element
at System.Linq.Enumerable.First[TSource](IEnumerable`1 source, Func`2 predicate)
at Roslyn.CommonToBothHosts.Test.AbstractOkCancelDialogAction.<>c__DisplayClass24_0.<SelectComboBoxItem>b__0(IEnumerable`1 items) in C:\Builds\Roslyn\Main-PerCheckin-VisualStudioIntegrationTests\src\Closed\Hosting\RoslynTaoActions\Actions\Common\AbstractOkCancelDialogAction.cs:line 264
at Roslyn.CommonToBothHosts.Test.AbstractOkCan
Test: CSharpGenerateTypeDialog started: 1/19/2015 8:08:18 PM
Executing action [1/19/2015 8:08:18 PM] StartTarget
Begin Waiting for Apex Communication
Resetting options...
Done resetting options
Scenario: Generate Type Dialog C#-to-VB
Executing action [1/19/2015 8:08:19 PM] AddProject
Executing action [1/19/2015 8:08:21 PM] AddProject
Executing action [1/19/2015 8:08:23 PM] AddItem
Executing action [1/19/2015 8:08:23 PM] OpenFile
Executing action [1/19/2015 8:08:23 PM] SetEditorText
Executing action [1/19/2015 8:08:24 PM] PlaceCursor
Executing action [1/19/2015 8:08:24 PM] GenerateTypeDialog
Button CancelButton clicked
Executing action [1/19/2015 8:08:33 PM] GenerateTypeDialog
--------------------------------
System.InvalidOperationException: Sequence contains no matching element
at System.Linq.Enumerable.First[TSource](IEnumerable`1 source, Func`2 predicate)
at Roslyn.CommonToBothHosts.Test.AbstractOkCancelDialogAction.<>c__DisplayClass24_0.<SelectComboBoxItem>b__0(IEnumerable`1 items) in C:\Builds\Roslyn\Main-PerCheckin-VisualStudioIntegrationTests\src\Closed\Hosting\RoslynTaoActions\Actions\Common\AbstractOkCancelDialogAction.cs:line 264
at Roslyn.CommonToBothHosts.Test.AbstractOkCancelDialogAction.SelectComboBoxItem(String automationId, Func`2 selector) in C:\Builds\Roslyn\Main-PerCheckin-VisualStudioIntegrationTests\src\Closed\Hosting\RoslynTaoActions\Actions\Common\AbstractOkCancelDialogAction.cs:line 233
at Roslyn.CommonToBothHosts.Test.AbstractOkCancelDialogAction.SelectComboBoxItem(String automationId, String text) in C:\Builds\Roslyn\Main-PerCheckin-VisualStudioIntegrationTests\src\Closed\Hosting\RoslynTaoActions\Actions\Common\AbstractOkCancelDialogAction.cs:line 263
at Roslyn.CommonToBothHosts.Test.AbstractGenerateTypeDialogAction.SelectAccess(String access) in C:\Builds\Roslyn\Main-PerCheckin-VisualStudioIntegrationTests\src\Closed\Hosting\RoslynTaoActions\Actions\Common\AbstractGenerateTypeDialogAction.cs:line 23
================================
Saved screenshot: C:\Builds\Roslyn\Main-PerCheckin-VisualStudioIntegrationTests\bin\Screenshots\2015-01-19_20-08-34_59 - Exception System.Reflection.TargetInvocationException.png
--------------------------------
System.InvalidOperationException: Sequence contains no matching element
at System.Linq.Enumerable.First[TSource](IEnumerable`1 source, Func`2 predicate)
at Roslyn.CommonToBothHosts.Test.AbstractOkCancelDialogAction.<>c__DisplayClass24_0.<SelectComboBoxItem>b__0(IEnumerable`1 items) in C:\Builds\Roslyn\Main-PerCheckin-VisualStudioIntegrationTests\src\Closed\Hosting\RoslynTaoActions\Actions\Common\AbstractOkCancelDialogAction.cs:line 264
at Roslyn.CommonToBothHosts.Test.AbstractOkCancelDialogAction.SelectComboBoxItem(String automationId, Func`2 selector) in C:\Builds\Roslyn\Main-PerCheckin-VisualStudioIntegrationTests\src\Closed\Hosting\RoslynTaoActions\Actions\Common\AbstractOkCancelDialogAction.cs:line 233
at Roslyn.CommonToBothHosts.Test.AbstractOkCancelDialogAction.SelectComboBoxItem(String automationId, String text) in C:\Builds\Roslyn\Main-PerCheckin-VisualStudioIntegrationTests\src\Closed\Hosting\RoslynTaoActions\Actions\Common\AbstractOkCancelDialogAction.cs:line 263
at Roslyn.CommonToBothHosts.Test.AbstractGenerateTypeDialogAction.SelectAccess(String access) in C:\Builds\Roslyn\Main-PerCheckin-VisualStudioIntegrationTests\src\Closed\Hosting\RoslynTaoActions\Actions\Common\AbstractGenerateTypeDialogAction.cs:line 23
================================
Button CancelButton clicked
Executing action [1/19/2015 8:10:34 PM] RemoveProject
Executing action [1/19/2015 8:10:35 PM] RemoveProject
Executing action [1/19/2015 8:10:35 PM] CloseTarget
Test finished: 1/19/2015 8:10:35 PM
Executing action [1/19/2015 8:10:35 PM] CloseTarget
Closing VS. force Close = True, closeVsToFreeHandles = False
FAILURE 2:
1/3 scenarios passed.
System.Exception: Timed out waiting for Generate Type dialog after 120 seconds.
at Roslyn.Hosting.Test.GenerateTypeDialogAction.Execute(TaoEngine engine) in C:\Builds\Roslyn\Main-PerCheckin-Debug\src\Closed\Hosting\RoslynTaoActions\Actions\EditorTestApp\GenerateTypeDialogAction.cs:line 36
at Tao.Engine.DebuggableActionExecutor.Execute() in F:\dd\Omni\Tao\Tao.Engine\ActionExecutor.cs:line 139
at Tao.Engine.DefaultActionExecutor.Execute() in F:\dd\Omni\Tao\Tao.Engine\ActionExecutor.c
Test: CSharpGenerateTypeDialog started: 1/19/2015 5:57:31 PM
Executing action [1/19/2015 5:57:31 PM] StartTarget
Scenario: Generate Type Dialog C#-to-VB
Executing action [1/19/2015 5:57:31 PM] AddProject
Executing action [1/19/2015 5:57:31 PM] AddProject
Executing action [1/19/2015 5:57:31 PM] AddItem
Executing action [1/19/2015 5:57:31 PM] OpenFile
Executing action [1/19/2015 5:57:32 PM] SetEditorText
Executing action [1/19/2015 5:57:32 PM] PlaceCursor
Executing action [1/19/2015 5:57:32 PM] GenerateTypeDialog
Actual ISuggestedAction count: 10
Actual ISuggestedAction: Generate class for 'A' in 'Global Namespace' (in new file)
Actual ISuggestedAction: Preview changes
Actual ISuggestedAction: Generate class for 'A' in 'Global Namespace'
Actual ISuggestedAction: Preview changes
Actual ISuggestedAction: Generate class for 'A' in 'C'
Actual ISuggestedAction: Preview changes
Actual ISuggestedAction: Generate new type...
Actual ISuggestedAction: Suppress CS0168
Actual ISuggestedAction: with #pragma directive
Actual ISuggestedAction: Preview changes
Button CancelButton clicked
Executing action [1/19/2015 5:57:40 PM] GenerateTypeDialog
--------------------------------
System.Exception: Timed out waiting for Generate Type dialog after 120 seconds.
at Roslyn.Hosting.Test.GenerateTypeDialogAction.Execute(TaoEngine engine) in C:\Builds\Roslyn\Main-PerCheckin-Debug\src\Closed\Hosting\RoslynTaoActions\Actions\EditorTestApp\GenerateTypeDialogAction.cs:line 36
at Tao.Engine.DebuggableActionExecutor.Execute() in F:\dd\Omni\Tao\Tao.Engine\ActionExecutor.cs:line 139
at Tao.Engine.DefaultActionExecutor.Execute() in F:\dd\Omni\Tao\Tao.Engine\ActionExecutor.cs:line 36
================================
Created screenshots folder: C:\Builds\Roslyn\Main-PerCheckin-Debug\bin\Screenshots
System.ComponentModel.Win32Exception (0x80004005): The handle is invalid
at System.Drawing.Graphics.CopyFromScreen(Int32 sourceX, Int32 sourceY, Int32 destinationX, Int32 destinationY, Size blockRegionSize, CopyPixelOperation copyPixelOperation)
at System.Drawing.Graphics.CopyFromScreen(Int32 sourceX, Int32 sourceY, Int32 destinationX, Int32 destinationY, Size blockRegionSize)
at Roslyn.Hosting.Test.ScreenshotExceptionLogger.SaveScreenToFile(String fileName) in C:\Builds\Roslyn\Main-PerCheckin-Debug\src\Closed\Hosting\Test\Execution\Logging\ScreenshotExceptionLogger.cs:line 52
at Roslyn.Hosting.Test.ScreenshotExceptionLogger.SaveScreen(String description) in C:\Builds\Roslyn\Main-PerCheckin-Debug\src\Closed\Hosting\Test\Execution\Logging\ScreenshotExceptionLogger.cs:line 23
Executing action [1/19/2015 5:59:42 PM] RemoveProject
Executing action [1/19/2015 5:59:42 PM] RemoveProject
Executing action [1/19/2015 5:59:42 PM] CloseTarget
System.ComponentModel.Win32Exception (0x80004005): The handle is invalid
at System.Drawing.Graphics.CopyFromScreen(Int32 sourceX, Int32 sourceY, Int32 destinationX, Int32 destinationY, Size blockRegionSize, CopyPixelOperation copyPixelOperation)
at System.Drawing.Graphics.CopyFromScreen(Int32 sourceX, Int32 sourceY, Int32 destinationX, Int32 destinationY, Size blockRegionSize)
at Roslyn.Hosting.Test.ScreenshotExceptionLogger.SaveScreenToFile(String fileName) in C:\Builds\Roslyn\Main-PerCheckin-Debug\src\Closed\Hosting\Test\Execution\Logging\ScreenshotExceptionLogger.cs:line 52
at Roslyn.Hosting.Test.ScreenshotExceptionLogger.SaveScreen(String description) in C:\Builds\Roslyn\Main-PerCheckin-Debug\src\Closed\Hosting\Test\Execution\Logging\ScreenshotExceptionLogger.cs:line 23
Test finished: 1/19/2015 5:59:42 PM
Revisions:
- Created by Manish Vasani (1/19/2015 11:38:35 PM)
I have also seen this test fail intermittently on my local machine while running test.exe. Passes fine on next run.
- Edited by Manish Vasani (1/19/2015 11:38:35 PM)
The test failed again, 3rd failure in half a day. I am going to disable this test.
Main-PerCheckin-Debug_20150120.1 - Check-in Rejected
Open Build Report in Visual Studio | Open Build Report in Web Access
- Edited by Manish Vasani (1/19/2015 11:38:35 PM)
Associated with changeset 1400799: Skip intermittently failing integration test.
- Edited by Jonathon Marolf (1/19/2015 11:38:35 PM)
Main-PerCheckin-Debug_20150120.1 is a timeout issue.
Main-PerCheckin-VisualStudioIntegrationTests_20150119.25 is a focus issue.