Performance Test Report
For
Website [Link]
Contact Points:
Mark Ferguson @ mferguson@[Link] in UK and Europe
Pulakesh Barma @ pulakesh@[Link] from all other countries
Chakkilam Infotech Ltd
Suite#106,107, MGR Estates
Dwarakapuri Colony, Punjagutta
Hyderabad -500082
[Link]
Table of Contents
1.
PERFORMANCE TEST CONTEXT ............................................................................................... 3
2.
DESCRIPTION OF THE APPLICATION ...................................................................................... 3
2.1
2.2
3.
TECHNOLOGIES ............................................................................................................................ 3
FUNCTIONALITIES ........................................................................................................................ 3
PERFORMANCE TEST GOALS AND REQUIREMENTS.......................................................... 4
3.1
BUSINESS TRANSACTIONS ............................................................................................................ 4
3.2
TRANSACTION STEPS (T IMING POINTS)........................................................................................ 4
3.2.1
About XampPerf ..................................................................................................................... 4
3.2.2
List All Members..................................................................................................................... 5
3.2.3
Search by Email...................................................................................................................... 5
3.2.4
List Limited Members ............................................................................................................. 5
3.2.5
Registration ............................................................................................................................ 6
3.3
PERFORMANCE REQUIREMENTS ................................................................................................... 6
3.3.1
PerfReq001 - Response Time Requirement............................................................................. 6
3.3.2
PerfReq002 - Processor Time Requirement ........................................................................... 6
3.3.3
PerfReq003 - Failed Transactions Requirement .................................................................... 6
4.
PERFORMANCE TEST PROCESS................................................................................................. 7
5.
PERFORMANCE TEST RESULTS................................................................................................. 8
5.1
SUMMARY .................................................................................................................................... 8
5.1.1. Overall Transactional Summary ................................................................................................. 8
5.1.2. Transactional Steps and Http Requests Transactions Summary................................................. 9
5.1.3. Performance Result Graphs.......................................................................................................11
6.
CONCLUSION ..................................................................................................................................11
Performance Test Report
Page 2 of 11
1. Performance Test Context
A performance Test was conducted for a website with few (~6) dynamic as well as static
pages. The basic functionality of the website is to create logins database.
This is a test website created by Chakkilam team for demonstration purposes only. It is
not intended to use it in any production.
2. Description of the application
It is a simple web application which allows any user to register them on line and later use
functionalities like search an user by email, list all users in the database or list limited
users in the database.
2.1
Technologies
The application is built on XAMP technology.
2.2
Functionalities
Following is the depiction of web application functionalities and its usages in pictorial
representation. For independent transactions and the steps, refer sections 3.1 and 3.2.
Performance Test Report
Page 3 of 11
3. Performance Test Goals and Requirements
The goal of the performance testing is to verify whether the website is meeting the
minimum performance requirements or not. The performance requirements are listed
below:
The performance testing for the website [Link] is planned to
verify the response times and throughput of the transactions with maximum load of 160
number of concurrent users.
The business transactions and its associated steps with expected response time
requirements are listed below.
3.1
Business Transactions
S. No.
3.2
Transaction Name
Description
About XampPerf
Navigate to [Link] Clicks on About XampPerf
List All Members
Navigate to Index Page Login List all members
Logout
Search by Email
Navigate to Index Page Login Search by Email
Logout
List Limited Members Navigate to Index Page Login List limited Members
Logout
Registration
Navigate to Index Page Register
Transaction Steps (Timing Points)
Maximum Simultaneous Users: 160
3.2.1 About XampPerf
Step Name
Description
Response Time
Requirement
Load Index Page
Navigate to
[Link]
< 2 seconds
Load About Page
Navigate to
[Link] and click
on Click Here
< 2 seconds
Performance Test Report
Page 4 of 11
3.2.2 List All Members
Step Name
Description
Response Time Requirement
Load Index Page
Navigate to [Link]
< 2 seconds
Load Login Page
Navigate to [Link] and click on Login
< 2 seconds
Submit Login
Detail
Provide valid users name and password and
click on 'Submit' button, which will load
'Search' page.
< 4 seconds
List All Members
Click on 'Search by Total Members'
< 5 seconds
Logout
Click on 'Logout'
< 2 seconds
3.2.3 Search by Email
Step Name
Description
Response Time
Requirement
Load Index Page
Navigate to [Link]
< 2 seconds
Load Login Page
Navigate to [Link] and click on Login
< 2 seconds
Submit Login Detail
Provide valid users name and password and click < 4 seconds
on 'Submit' button, which will load 'Search' page.
Enter Email
Provide Valid Email and click on 'Search by
Email'
< 5 seconds
Logout
Click on 'Logout'
< 2 seconds
3.2.4 List Limited Members
Step Name
Description
Response Time
Requirement
Load Index Page
Navigate to [Link]
< 2 seconds
Load Login Page
Navigate to [Link] and click on Login
< 2 seconds
Submit Login Detail
Provide valid users name and password and click
on 'Submit' button, which will load 'Search' page.
< 4 seconds
Provide Numbers
Enter required records number and Submit
< 4 seconds
List Limited Members Click on 'Search by Limited Members'
< 5 seconds
Logout
< 2 seconds
Click on 'Logout'
Performance Test Report
Page 5 of 11
3.2.5 Registration
Step Name
Description
Response Time Requirement
Load Index Page
Navigate to [Link]
< 2 seconds
Load Registration Page Navigate to [Link] and click on
Registration
< 2 seconds
Submit Registration
Detail
< 4 seconds
3.3
Provide valid registration details and
click on 'Submit' button.
Performance Requirements
3.3.1 PerfReq001 - Response Time Requirement
90% of response time of all web actions (transaction steps) must be less than 2 sec / 5 sec
when load is ramped up to 160 concurrent users. Please find response time requirement
of each transaction steps in section 3.2. (Transactions Steps Timing Points)
3.3.2 PerfReq002 - Processor Time Requirement
% Processor Time of web server, application server and database server must not be
more than 75% for > 10 minutes at any point during the performance run.
3.3.3 PerfReq003 - Failed Transactions Requirement
The percentage of failed transactions must not be more than 5% when the load is ramped
up to 160 concurrent users.
Performance Test Report
Page 6 of 11
4. Performance Test Process
Chakkilam has conducted following Performance Tests to verify the performance Test
Goals:
1. Baseline Test
i. Number of concurrent users 1
ii. Duration of the test 30 minutes
2. Benchmark Test
i. Number of concurrent users 24 (15% of max concurrent users)
ii. Duration of the test 1 hour 45 minutes
3. Load Test
i. Number of concurrent users 160
ii. Duration of the test 11 hours
iii. Load ramp up The number of concurrent users were ramped up as depicted
in the figure below.
Performance Test Report
Page 7 of 11
5. Performance Test Results
5.1
Summary
Based on the preliminary analysis of the performance test, Chakkilam team made the
following observations:
The overall performance of the website doesnt conform to the performance
requirements.
-
10% transactions are under performing i.e. response time SLA (Performance
Requirement 01) is not achieved
50% transactions (all http requests e.g. images, css, php etc.)are failing
(Performance Requirement 03)
5.1.1. Overall Transactional Summary
Following is the summary report for business transactions involved in the performance
run.
[Link].
Business Transaction
Name
Total
Transactions
Passed
Transactions
Failed
Transactions
% Failed
1.
2.
3.
4.
About XampPerf
List All Members
Search By Email
List Limited
Members
Registration
474
442
432
449
474
442
432
449
0
0
0
0
0
0
0
0
456
456
5.
Performance Test Report
Page 8 of 11
5.1.2. Transactional Steps and Http Requests Transactions Summary
Following is the summary report of all individual steps of business transactions involved
in the performance run.
Response Time (in secs) - is the time spent actively by step to download objects, business
processing and page loading.
Transactions: is all HTTP requests (page, images etc.) associated with a step.
Transacti
on Name
SL
A
Sta
tus
Response Time (in secs)
P
F
P
F
Transactions
Resp
onse
Tine
SLA
(in
secs)
SLA: < 5% Failed
Transactions
Min
About
Index
Page
About
About
Page
List All
Members
Index
Page
List All
Members
Login
Page
List All
Members
Submit
Login
Detail
List All
Members
List
All
Members
List All
Members
Logout
Search By
Email
Index
Std.
Dev.
1.36
0.43
1.37
1.79
0.8
0.86
0.82
1.36
Avg
1.64
0.52
1.62
2.22
0.98
1.01
0.98
1.63
Performance Test Report
Max
4.56
2.66
4.63
4.34
4.66
1.75
4.57
90%
1.79
0.57
0.37
2.39
1.15
1.09
1.3
1.82
0.37
0.12
0.3
0.32
0.26
0.26
0.12
0.35
Passed
Failed
Http Status:
#
Http
Status: #
7110
472
{200: 7110}
{404: 47}
{-998: 1}
474
{200: 7110}
{404: 2}
6630
438
{200: 6630}
{404:
438}
1326
{200: 1326}
{404: 1}
884
199
{200: 442}
{302: 442}
{404:
199}
442
{200: 442}
884
{200: 884}
6735
442
{200: 6735}
{404:
442}
%
Failed
6.22
<2
0.84
<2
6.2
<2
0.08
<2
18.37
<4
<5
<2
6.16
<2
Page 9 of 11
Page
Search By
Email
Login
page
Search By
Email
Submit
Login
Detail
Search By
Email
Submit
Email
Search By
Email
Search By
Email
Search By
Email
Logout
List
Limited
Members
Index
Page
List
Limited
Members
Login
Page
List
Limited
Members
Submit
Login
Detail
Limit List
Submit
List
Limited
Members
List
Limited
Members
List
Limited
Members
List
Limited
Members
Logout
Registrati
on
Index
P
F
1.78
0.8
0.81
0.43
0.82
1.36
1.79
0.81
0.81
0.96
0.82
1.37
2.21
0.96
0.97
0.55
1.01
1.65
5.23
0.96
0.97
1.62
0.99
1.62
Performance Test Report
4.91
4.05
1.77
3.75
4.26
10.37
2.26
4.05
2.98
2.78
3.97
4.47
2.42
1.82
1.09
1.12
0.64
1.65
0.39
1.82
1.9
1.9
1.1
1.79
0.35
0.26
0.13
0.24
0.32
1.82
2.48
0.2
0.19
0.22
0.21
0.33
1347
{200: 1347}
{404: 2}
898
{200: 449}
{302: 449}
{404: 2}
449
449
{200: 449}
{404:
449}
449
{200: 449}
898
{200: 898}
6480
426
{200: 6480}
{404:
426}
1296
{200: 1296}
{404: 5}
864
228
{200: 432}
{302: 432}
{404:
228}
432
432
{200: 432}
{404:
432}
864
{200: 864}
864
{200: 864}
6840
452
{200: 6840}
{404:
0.15
<2
0.15
<4
50
<2
<5
<2
6.17
<2
0.38
<2
20.88
<4
50
<2
<5
<2
6.2
<2
Page 10 of 11
452}
Page
Registrati
on
Registrati
on Page
Register
Submit
Registrati
on Detail
0.94
0.8
1.1
0.94
1.89
1.85
1.21
1.08
0.11
0.13
912
{200: 912}
{404: 1}
912
115
{200: 456}
{302: 456}
{404: 4}
0.44
<2
11.2
<4
5.1.3. Performance Result Graphs
6. Conclusion
The performance test team has found issues related to performance of the website during
preliminary steps. The performance team will continue to do further analysis and will
submit a detail report within a week period of time.
Performance Test Report
Page 11 of 11
