TEST PLAN

Version: 1.0

Created: 8/29/2013

Updated: 08/29/2013

Status: DRAFT

Company confidential Page 1

 Revision and Signoff Sheet

Document History

Version Date Author Description of Change

0.1 08/29/2013 Swati Seela Draft

Approvers List
Approver / Approval /
Name Role
Reviewer Review Date

Reference Documents
Version Date Document Name

1.0 CARGURUJI -FSD

Company confidential Page 2

 Table of Contents
1. INTRODUCTION........................................................................................................................ 5
1.1. Purpose......................................................................................................................... 5
1.2. Project Overview .......................................................................................................... 5
1.3. Audience ....................................................................................................................... 5
2. TEST STRATEGY ........................................................................................................................ 5
2.1. Test Objectives ............................................................................................................. 5
2.2. Test Assumptions ......................................................................................................... 6
2.3. Test Principles............................................................................................................... 7
2.4. Data Approach .............................................................................................................. 7
2.5. Scope and Levels of Testing.......................................................................................... 7
2.5.1. Exploratory ...................................................................................................... 7
2.5.2. Functional Test ................................................................................................ 7
TEST ACCEPTANCE CRITERIA ........................................................................... 8
TEST DELIVERABLES ......................................................................................... 8
MILESTONE LIST............................................................................................... 9
2.5.3. User Acceptance Test (UAT) ............................................................................ 9
TEST DELIVERABLES ......................................................................................... 9
2.6. Test Effort Estimate .................................................................................................... 10
3. EXECUTION STRATEGY ........................................................................................................... 10
3.1. Entry and Exit Criteria................................................................................................. 10
3.2. Test Cycles .................................................................................................................. 11
3.3. Validation and Defect Management .......................................................................... 11
3.4. Test Metrics ................................................................................................................ 11
3.5. Defect tracking & Reporting ....................................................................................... 12
4. TEST MANAGEMENT PROCESS .............................................................................................. 13
4.1. Test Management Tool ................................................. Error! Bookmark not defined.
4.2. Test Design Process .................................................................................................... 13
4.3. Test Execution Process ............................................................................................... 13
4.4. Test Risks and Mitigation Factors ............................................................................... 14
4.1. Communications Plan and Team Roster .................................................................... 16

Company confidential Page 3

 4.2. Role Expectations ....................................................................................................... 16
4.2.1. Project Management..................................................................................... 16
4.2.2. Test Planning (Test Lead) .............................................................................. 16
4.2.3. Test Team ...................................................................................................... 16
4.2.4. Test Lead ....................................................................................................... 17
4.2.5. Development Team ....................................................................................... 17
5. TEST ENVIRONMENT.............................................................................................................. 17

Company confidential Page 4

1. INTRODUCTION

1.1. Purpose

This test plan describes the testing approach and overall framework that will drive the testing of the
Arrow. The document introduces:

 Test Strategy: rules the test will be based on, including the givens of the project (e.g.: start / end
dates, objectives, assumptions); description of the process to set up a valid test (e.g.: entry / exit
criteria, creation of test cases, specific tasks to perform, scheduling, data strategy).
 Execution Strategy: describes how the test will be performed and process to identify and report
defects, and to fix and implement fixes.
 Test Management: process to handle the logistics of the test and all the events that come up
during execution (e.g.: communications, escalation procedures, risk and mitigation, team roster)

1.2. Project Overview

The overall goal of this project is 3 fold.

1. Attract and excite diverse audience
2. Provide useful, timely content in a compelling, easy-to-use design
3. Allow the Arrow site users to maintain most site content using their web browser.

1.3. Audience.

 Project team members perform tasks specified in this document, and provide input and
recommendations on this document.
 Project Manager Plans for the testing activities in the overall project schedule, reviews the
document, tracks the performance of the test according to the task herein specified, approves
the document and is accountable for the results.
 The stakeholders’ representatives and participants may take part in the UAT test to ensure the
business is aligned with the results of the test.
 Technical Team ensures that the test plan and deliverables are in line with the design, provides
the environment for testing and follows the procedures related to the fixes of defects.
 Business analysts will provide their inputs on functional changes.

2. TEST STRATEGY

2.1. Test Objectives

The objective of the test is to verify that the functionality of ARROW works according to the
specifications.

Company confidential Page 5

 The test will execute and verify the test scripts, identify, fix and retest all high and medium severity
defects per the entrance criteria, prioritize lower severity defects for future fixing.

The final product of the test is twofold:

 A production-ready software;
 A set of stable test scripts that can be reused for Functional and UAT test execution.

2.2. Test Assumptions

Key Assumption

 Production like data required and be available in the system prior to start of Functional Testing

General

 Exploratory Testing would be carried out once the build is ready for testing
 Performance testing is not considered for this estimation.
 All the defects would come along with a snapshot JPEG format
 The Test Team will be provided with access to Test environment via VPN connectivity
 The Test Team assumes all necessary inputs required during Test design and execution will be
supported by Development/BUSINESS ANALYSTs appropriately.
 Test case design activities will be performed by QA Group
 Test environment and preparation activities will be owned by Dev Team
 BUSINESS ANALYST will review and sign-off all Test cases prepared by Test Team prior to start of
Test execution
 Project Manager/BUSINESS ANALYST will review and sign-off all test deliverables
 The project will provide test planning, test design and test execution support
 Test team will manage the testing effort with close coordination with Project PM/BUSINESS
ANALYST
 Project team has the knowledge and experience necessary, or has received adequate training in
the system, the project and the testing processes.
 The system will be treated as a black box; if the information shows correctly online and in the
reports, it will be assumed that the database is working properly.
 Cycle 3 will be initiated if there are more defects in Cycle 2.

Functional Testing
 During Functional testing, testing team will use preloaded data which is available on the system
at the time of execution

Company confidential Page 6

 UAT

 UAT test execution will be performed by end users (L1, L2 and L3) and QA Group will provide
their support on creating UAT script.

2.3. Test Principles

 Testing will be focused on meeting the business objectives, and quality.

 Testing will be a repeatable, quantifiable, and measurable activity.
 Testing will be divided into distinct phases, each with clearly defined objectives and goals.
 There will be entrance and exit criteria.

2.4. Data Approach

 In functional testing, ARROW will contain pre-loaded test data and which is used for testing
activities.

2.5. Scope and Levels of Testing

2.5.1. Exploratory

PURPOSE: the purpose of this test is to make sure critical defects are removed before the
next levels of testing can start.

SCOPE: Manager, dealer and admin modules

TESTERS: Testing team.

METHOD: this exploratory testing is carried out in the application without any test scripts
and documentation

TIMING: at the beginning of each cycle.

2.5.2. Functional Test

PURPOSE: Functional testing will be performed to check the functions of application. The
functional testing is carried out by feeding the input and validates the output from the
application.

Scope: The below excel sheet details about the scope of Functional test. Note: The scope is
high level due to changes in the requirement.

Company confidential Page 7

 Functional Testing
[Link]

TESTERS: Testing Team.

METHOD: The test will be performed according to Functional scripts.

TIMING: after Exploratory test is completed.

TEST ACCEPTANCE CRITERIA

1. Approved Functional Specification document, Use case documents must be available
prior to start of Test design phase.
2. Test cases approved and signed-off prior to start of Test execution
3. Development completed, unit tested with pass status and results shared to Testing team
to avoid duplicate defects
4. Test environment with application installed, configured and ready to use state

Sign-off Readiness

•Approved Functional Specification •Development completed & unit

Document tested
•Approved Use cases •Application deployed and system
•Approved Test cases ready for testing on Test environment
•Production like data is available to
test all functionalities.

TEST DELIVERABLES

[Link]. Deliverable Name Author Reviewer

1. Test Plan Test Lead Project Manager/
Business Analyst’s
2. Functional Test Cases Test Team Business Analyst’s
Sign off
3. Logging Defects in HP ALM Test Team Test Lead/
Programming Lead
(4. Daily/weekly status report Test Team/ Test Lead Test Lead/ Project
Manager
5. Test Closure report Test Lead Project Manager

Company confidential Page 8

 MILESTONE LIST
The milestone list is tentative and may change due to below reasons

a) Any issues in the System environment readiness

b) Any change in scope/addition in scope
c) Any other dependency that impacts efforts and timelines

DFRT Execution
[Link]

2.5.3. User Acceptance Test (UAT)

PURPOSE: this test focuses on validating the business logic. It allows the end users to
complete one final review of the system prior to deployment.

TESTERS: the UAT is performed by the end users (L1, L2 and L3).

METHOD: Since the business users are the most indicated to provide input around business
needs and how the system adapts to them, it may happen that the users do some validation
not contained in the scripts. Test team write the UAT test cases based on the inputs from End
user (L1,L2 and L3 users) and Business Analyst’s.

TIMING: After all other levels of testing (Exploratory and Functional) are done. Only after this
test is completed the product can be released to production.

TEST DELIVERABLES

[Link]. Deliverable Name Author Reviewer

1. UAT Test Cases Test Team Business Analyst’s
Sign off

Company confidential Page 9

2.6. Test Effort Estimate

New_Detailed DRFT
Test estimate [Link]
3.
Note: this estimate is for the TCOE team only Testing Schedule

4. EXECUTION STRATEGY

4.1. Entry and Exit Criteria

 The entry criteria refer to the desirable conditions in order to start test execution; only the
migration of the code and fixes need to be assessed at the end of each cycle.
 The exit criteria are the desirable conditions that need to be met in order proceed with the
implementation.
 Entry and exit criteria are flexible benchmarks. If they are not met, the test team will assess the
risk, identify mitigation actions and provide a recommendation. All this is input to the project
manager for a final “go-no go” decision.
 Entry criteria to start the execution phase of the test: the activities listed in the Test Planning
section of the schedule are 100% completed.
 Entry criteria to start each cycle: the activities listed in the Test Execution section of the schedule
are 100% completed at each cycle.

Test Technical
Exit Criteria Notes
Team Team
100% Test Scripts executed

95% pass rate of Test Scripts

No open Critical and High severity defects

95% of Medium severity defects have been closed

All remaining defects are either cancelled or
documented as Change Requests for a future release
All expected and actual results are captured and
documented with the test script

Company confidential Page 10

4.2. Test Cycles

o There will be two cycles for functional testing. Each cycle will execute all the scripts .
o The objective of the first cycle is to identify any blocking, critical defects, and most of the
high defects. It is expected to use some work-around in order to get to all the scripts.
o The objective of the second cycle is to identify remaining high and medium defects, remove
the work-around from the first cycle and obtain performance results.
 UAT test will consist of one cycle.

4.3. Validation and Defect Management

Defects found during the Testing will be categorized as:

Severity Impact
1 (Critical)  This bug is critical enough to crash the system, cause file corruption, or
cause potential data loss
 It causes an abnormal return to the operating system (crash or a
system failure message appears).
 It causes the application to hang and requires re-booting the system.
2 (High)  It causes a lack of vital program functionality with workaround.

3 (Medium)  This Bug will degrade the quality of the System. However there is an
intelligent workaround for achieving the desired functionality - for
example through another screen.
 This bug prevents other areas of the product from being tested.
However other areas can be independently tested.
4 (Low)  There is an insufficient or unclear error message, which has minimum
impact on product use.
5(Cosmetic)  There is an insufficient or unclear error message that has no impact on
product use.

4.4. Test Metrics

Test metrics to measure the progress and level of success of the test will be developed and shared
with the project manager for approval. The below are some of the metrics

Report Description Frequency

Test To report on % complete, %WIP, % Pass, % Fail Weekly / Daily

preparation (optional)
& Defects severity wise Status – Open, closed, any other
Execution Status

Company confidential Page 11

 Status

Daily To report on Pass, Fail, Total defects, highlight Daily

execution Showstopper/ Critical defects

status

Project Project driven reporting (As requested by PM) Weekly – If project

Weekly team needs weekly
Status update apart from
report daily and there is
template available
with project team to
use.

4.5. Defect tracking & Reporting

Following flowchart depicts Defect Tracking Process:

Company confidential Page 12

5. TEST MANAGEMENT PROCESS

5.1. Test Design Process

Establishing Incorporating
SME /Peer
Understanding Traceability Preparation of Review
Review of Test
Requirements Matrix in HP Test cases comments in
cases
ALM test cases

 The tester will understand each requirement and prepare corresponding test case to
ensure all requirements are covered.
 Each of the Test cases will undergo review by the BUSINESS ANALYST and the review
defects are captured and shared to the Test team. The testers will rework on the review
defects and finally obtain approval and sign-off.
 During the preparation phase, tester will use the prototype, use case and functional
specification to write step by step test cases.
 Testers will maintain a clarification Tracker sheet and same will be shared periodically
with the Requirements team and accordingly the test case will be updated. The
clarifications may sometimes lead to Change Requests or not in scope or detailing
implicit requirements.
 Sign-off for the test cases would be communicates through mail by Business Analyst’s.
 Any subsequent changes to the test case if any will be directly updated in HP ALM.

5.2. Test Execution Process

Participate in
Execute each of Mark Status as Raise defects for Send the daily Complete the
Defect Triage
the test step in Pass/Fail in HP the failed test status report to test execution of
cycle and explain
test case ALM cases in HP ALM Test Lead all the test cases
the defects

Company confidential Page 13

  Once all Test cases are approved and the test environment is ready for testing, tester
will start a exploratory test of the application to ensure the application is stable for
testing.
 Each Tester is assigned Test cases directly in HP ALM.
 Testers to ensure necessary access to the testing environment, HP ALM for updating
test status and raise defects. If any issues, will be escalated to the Test Lead and in turn
to the Project Manager as escalation.
 If any showstopper during Exploratory testing will be escalated to the respective
development SPOCs for fixes.
 Each tester performs step by step execution and updates the executions status. The
tester enters Pass or Fail Status for each of the step directly in HP ALM.
 Tester will prepare a Run chart with day-wise execution details
 If any failures, defect will be raised as per severity guidelines in HP ALM tool detailing
steps to simulate along with screenshots if appropriate.
 Daily Test execution status as well as Defect status will be reported to all stakeholders.
 Testing team will participate in defect triage meetings in order to ensure all test cases
are executed with either pass/fail category.
 If there are any defects that are not part of steps but could be outside the test steps,
such defects need to be captured in HP ALM and map it against the test case level or at
the specific step that issue was encountered after confirming with Test Lead.
 This process is repeated until all test cases are executed fully with Pass/Fail status.
 During the subsequent cycle, any defects fixed applied will be tested and results will be
updated in HP ALM during the cycle.

As per Process, final sign-off or project completion process will be followed

5.3. Test Risks and Mitigation Factors

Risk Prob. Impact Mitigation Plan

SCHEDULE  The testing team can control the

Testing schedule is tight. If the start preparation tasks (in advance)
of the testing is delayed due to and the early communication
design tasks, the test cannot be with involved parties.
High High
extended beyond the UAT  Some buffer has been added to
scheduled start date. the schedule for contingencies,
although not as much as best
practices advise.
RESOURCES Holidays and vacation have been
Not enough resources, resources on estimated and built into the
Medium High
boarding too late (process takes schedule; deviations from the
around 15 days. estimation could derive in delays in

Company confidential Page 14

 Risk Prob. Impact Mitigation Plan

the testing.
DEFECTS Defect management plan is in place
Defects are found at a late stage of to ensure prompt communication
the cycle or at a late cycle; defects and fixing of issues.
discovered late are most likely be
Medium High
due to unclear specifications and
are time consuming to resolve.

SCOPE Scope is well defined but the

Scope completely defined changes are in the functionality are
Medium Medium
not yet finalized or keep on
changing.
Natural disasters Teams and responsibilities have
been spread to two different
geographic areas. In a catastrophic
Low Medium event in one of the areas, there will
resources in the other areas needed
to continue (although at a slower
pace) the testing activities.
Non-availability of Independent Test Due to non availability of the
environment and accessibility environment, the schedule gets
Medium High
impacted and will lead to delayed
start of Test execution.
Delayed Testing Due To new Issues During testing, there is a good
chance that some “new” defects
may be identified and may become
an issue that will take time to
resolve.
There are defects that can be raised
during testing because of unclear
document specification. These
defects can yield to an issue that will
Medium High
need time to be resolved.
If these issues become
showstoppers, it will greatly impact
on the overall project schedule.
If new defects are discovered, the
defect management and issue
management procedures are in
place to immediately provide a
resolution.

Company confidential Page 15

5.1. Communications Plan and Team Roster

5.2. Role Expectations

The following list defines in general terms the expectations related to the roles directly involved in
the management, planning or execution of the test for the project.

S Roles Name Contact Info

N
0
.
1. Project Manager

2. Test Lead
3. Business Analyst
4. Development Lead
5. Testing Team
6. Development Team
7. Technical Lead

5.2.1. Project Management

 Project Manager: reviews the content of the Test Plan, Test Strategy and Test Estimates
signs off on it.

5.2.2. Test Planning (Test Lead)

 Ensure entrance criteria are used as input before start the execution.
 Develop test plan and the guidelines to create test conditions, test cases, expected
results and execution scripts.
 Provide guidelines on how to manage defects.
 Attend status meetings in person or via the conference call line.
 Communicate to the test team any changes that need to be made to the test
deliverables or application and when they will be completed.
 Provide on premise or telecommute support.
 Provide functional (Business Analysts) and technical team to test team personnel (if
needed).

5.2.3. Test Team

 Develop test conditions, test cases, expected results, and execution scripts.

Company confidential Page 16

  Perform execution and validation.
 Identify, document and prioritize defects according to the guidance provided by the Test
lead.
 Re-test after software modifications have been made according to the schedule.
 Prepare testing metrics and provide regular status.

5.2.4. Test Lead

 Acknowledge the completion of a section within a cycle.

 Give the OK to start next level of testing.
 Facilitate defect communications between testing team and technical / development
team.

5.2.5. Development Team

 Review testing deliverables (test plan, cases, scripts, expected results, etc.) and provide
timely feedback.
 Assist in the validation of results (if requested).
 Support the development and testing processes being used to support the project.
 Certify correct components have been delivered to the test environment at the points
specified in the testing schedule.
 Keep project team and leadership informed of potential software delivery date slips
based on the current schedule.
 Define processes/tools to facilitate the initial and ongoing migration of components.
 Conduct first line investigation into execution discrepancies and assist test executors in
creation of accurate defects.
 Implement fixes to defects according to schedule.

6. TEST ENVIRONMENT

CARGURUJI’s servers will be hosted at X company’s site.

CARGURUJI will be hosted on two servers: One to host the actual website and (language) code, and
the other to host the (database name) database.

A windows environment with Internet Explorer 4, 5 and 5.5, and with Firefox 4-6, as well as Google
Chrome 4.0 and later should be available to each tester.

Company confidential Page 17