First Vietnamese QA Firm
LQA – Toward the Perfection 1
Software Testing
Report
Presented by: Tham Nguyen
Hanoi, Feb 2017
LQA – Toward the Perfection 2
Agenda
Duration: 4 Hours
Purpose: Introduce fundamental test report
and guide how to create test report
Audience: Testers
Content:
Part 1: Test Report introduction
Part 2: Test Metrics
Part 3: Report Bug
Part 4: Status report
Part 5: Release report
LQA – Toward the Perfection 3
What is Test Report?
• Test reporting is Collecting and analyzing data from testing
activities and subsequently consolidating the data in a report to
inform stakeholders (ISTQB Glossary of Testing Terms)
• Test Reporting is the means of communicating the results of
testing
• The test reports are designed to document the results of testing
as defined in the test plan. Without a well-developed test plan,
it is difficult to develop a meaningful test report.
• A test report is designed to accomplished three objectives:
Define the scope of testing:
Normally a brief recap of the test plan
Present the results of testing.
Draw conclusions and make recommendations based on those
results.
LQA – Toward the Perfection 4
What is Test Report?
• Testing produces potentially valuable information so Test report
must be generated and communicated effectively to be valuable
• Common communication goals
Notify (“We have 24 bugs remaining to close”)
Enlighten (“See the time lost due to reopens”)
Influence (“We propose a bug triage meeting”)
• The metrics should be used as part of regular status reports
(dashboards) as well as periodic analyses
LQA – Toward the Perfection 5
Test Report responsible
• Organizational Diagram Example.
• What is your responsibility in your Test Team?
• Who will you send report to?
LQA – Toward the Perfection 6
Elements of Test Report
A typical Test Report template will contain
1. Purpose of the document 7. Lessons Learned
2. Application Overview 8. Recommendations
9. Best Practices
3. Testing Scope
10. Exit Criteria
4. Metrics 11. Conclusion/Sign Off
5. Types of testing performed ‘Go Live’
6. Test Environment & Tools 12. Definitions, Acronyms, and
Abbreviations
LQA – Toward the Perfection 7
Test Metrics
In software testing, Metric is a quantitative measure of the degree to
which a system, system component, or process possesses a given
attribute. In other words, metrics helps estimating the progress,
quality and health of a software testing effort
• Generation of Software Test Metrics is the most important
responsibility of the Software Test Lead/Manager.
• Test Metrics are used to,
• Take the decision for next phase of activities such as, estimate the
cost & schedule of future projects.
• Understand the kind of improvement required to success the project
• Take decision on process or technology to be modified etc.
LQA – Toward the Perfection 8
Test Metrics
Example
LQA – Toward the Perfection 9
Report Bug
Before create new defect, make sure:
Ensure you’re running corrected Test environment.
Search for existing bugs in Connect to see if your issue has already been reported.
Try to identify specifics steps that would allow us to consistently reproduce the issue you’re
seeing, if possible.
Please file separate bug reports for each problem encountered.
LQA – Toward the Perfection 10
Report Bug
Title: Summarizing your problem concisely improves our
ability to understand and fix bugs
Description: A good bug report clearly explains clearly step –
by – step to reproduce bug. what you were expecting to see,
and how it differs from what you actually saw happen
Area (category): A good bug report has the correct area
selected
Other information as Status, priority, Milestone, Version,…
Screenshots, attachments: Use screenshots to guide us
through relatively complex steps or to highlight where we
need to look to see the issue you’re reporting.
LQA – Toward the Perfection 11
Status report – Daily report to Test leader
Send To: Test Leader
Communication type: informal
When: Daily meeting?
Tool: email, tool online, excel….
Template and Case study
LQA – Toward the Perfection 12
Status report – Daily report to stakeholders
Send To: Stakeholders (project team, SM, customers….)
Communication type: Formal
Tool: email
Template and Case study
LQA – Toward the Perfection 13
Status report – Weekly report to stakeholders
Send To: Stakeholders (project team, SM, customers….)
Communication type: Formal
Tool: email
Template and Case study
LQA – Toward the Perfection 14
Release report
Send To: Stakeholders (project team, SM, customers….)
Communication type: Formal
Tool: email
Template and Case study
LQA – Toward the Perfection 15
QnA/Discussion
LQA – Toward the Perfection 16
LQA – Toward the Perfection 17
Reference
• Foundations of Software Testing_ISTQB Certification, Chapter 1
• Foundation Syllabus_2011
• ISTQB Glossary of Testing Terms v3.01
– http://www.istqb.org/
LQA – Toward the Perfection 18
Contact Us!
Website: http://lqa.com.vn
Email: [email protected]
Phone: +84 90 414 0881
LQA – Toward the Perfection 19
