Scribd
Upload
40 views10 pages

Performance Test Failures Summary

The document provides status reports from security testing performed on various features of an alarm system. It shows that the Basic Security Testing, DoorContact Test, System Security Feature Testing, and ZWave Functional Testing all failed, while the Keyfob Test passed some scenarios but failed others. It provides details on the number of passed and failed tests for each feature and scenario.

Uploaded by

harish
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
40 views10 pages

Performance Test Failures Summary

The document provides status reports from security testing performed on various features of an alarm system. It shows that the Basic Security Testing, DoorContact Test, System Security Feature Testing, and ZWave Functional Testing all failed, while the Keyfob Test passed some scenarios but failed others. It provides details on the number of passed and failed tests for each feature and scenario.

Uploaded by

harish
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd

Features Overview

Overview Chart
Features Status Scenario Status

Features Status
Feature Name Status Passed Failed Known Undefined Duration
Basic Security Testing failed 46 13 0 0 1882.05s
DoorContact Test failed 43 9 0 0 1090.48s
System Security Feature Testing failed 6 3 0 0 488.67s
ZWave Functional Testing failed 13 13 0 0 857.83s
Keyfob Test failed 13 8 0 0 402.84s

Scenario Status
Feature
Scenario Status Passed Failed Known Undefined Retries
Name
Basic
verify the wifi network name/wifi ssid in
Security failed 2 1 0 0 0
registerd panel
Testing
Basic
Security LyricDAS_1095_User to Disarm the panel failed 2 1 0 0 0
Testing
Basic
LyricDAS_1052_User to Arm Away the
Security failed 2 1 0 0 0
panel
Testing
Basic
LyricDAS_1097_User to Arm Stay the
Security passed 3 0 0 0 0
panel
Testing
Basic
Security Time synchronization to panel passed 1 0 0 0 0
Testing
Basic
Security LyricDAS_1052_User to Arm Away the
passed 3 0 0 0 0

Page 1 of 10
Features Overview

Testing panel
Basic
Security LyricDAS_1095_User to Disarm the panel passed 3 0 0 0 0
Testing
Basic
Security time synchronization to panel passed 1 0 0 0 0
Testing
Basic Verify the default Entry and Exit delay
Security and default chime and default camera failed 2 1 0 0 0
Testing settings
Basic
Configure the Entry and Exit delay
Security failed 2 1 0 0 0
duration as 15,30,45 and 60 seconds
Testing
Basic
Configure the Entry and Exit delay
Security passed 3 0 0 0 0
duration as 15,30,45 and 60 seconds
Testing
Basic
Configure the Entry and Exit delay
Security passed 3 0 0 0 0
duration as 15,30,45 and 60 seconds
Testing
Basic
Configure the Entry and Exit delay
Security passed 3 0 0 0 0
duration as 15,30,45 and 60 seconds
Testing
Basic
Configure the Entry and Exit delay
Security passed 3 0 0 0 0
duration as 15,30,45 and 60 seconds
Testing
Basic
Configure the Entry and Exit delay
Security passed 3 0 0 0 0
duration as 15,30,45 and 60 seconds
Testing
Basic
Configure the Entry and Exit delay
Security passed 3 0 0 0 0
duration as 15,30,45 and 60 seconds
Testing
Basic
Configure the Entry and Exit delay
Security passed 3 0 0 0 0
duration as 15,30,45 and 60 seconds
Testing
Basic
Security LyricDAS_1095_User to Disarm the panel passed 2 0 0 0 0
Testing
Basic
Security Time synchronization to panel passed 1 0 0 0 0
Testing
Basic LyricDAS_1085_2_11_Verify User to
Security configure the chime volume with multiple passed 3 0 0 0 0
Testing levels and read the chime volume levels
Basic LyricDAS_1085_2_11_Verify User to
Security configure the chime volume with multiple passed 3 0 0 0 0
Testing levels and read the chime volume levels
Basic LyricDAS_1085_2_11_Verify User to
Security configure the chime volume with multiple passed 3 0 0 0 0
Testing levels and read the chime volume levels

Page 2 of 10
Features Overview

Basic LyricDAS_1085_2_11_Verify User to


Security configure the chime volume with multiple passed 3 0 0 0 0
Testing levels and read the chime volume levels
Basic LyricDAS_1085_2_11_Verify User to
Security configure the chime volume with multiple passed 3 0 0 0 0
Testing levels and read the chime volume levels
Basic LyricDAS_1085_2_11_Verify User to
Security configure the chime volume with multiple passed 3 0 0 0 0
Testing levels and read the chime volume levels
Basic LyricDAS_1085_2_11_Verify User to
Security configure the chime volume with multiple passed 3 0 0 0 0
Testing levels and read the chime volume levels
Basic LyricDAS_1085_2_11_Verify User to
Security configure the chime volume with multiple failed 2 1 0 0 0
Testing levels and read the chime volume levels
Basic LyricDAS_1085_2_11_Verify User to
Security configure the chime volume with multiple failed 2 1 0 0 0
Testing levels and read the chime volume levels
Basic LyricDAS_1085_2_11_Verify User to
Security configure the chime volume with multiple failed 2 1 0 0 0
Testing levels and read the chime volume levels
Basic
Security Time synchronization to panel passed 2 0 0 0 0
Testing
Basic LyricDAS_Verify Base Station Camera
Security settings ON and OFF for Disarm, failed 2 1 0 0 0
Testing ArmAway and ArmStay modes
Basic LyricDAS_Verify Base Station Camera
Security settings ON and OFF for Disarm, passed 3 0 0 0 0
Testing ArmAway and ArmStay modes
Basic LyricDAS_Verify Base Station Camera
Security settings ON and OFF for Disarm, passed 3 0 0 0 0
Testing ArmAway and ArmStay modes
Basic LyricDAS_Verify Base Station Camera
Security settings ON and OFF for Disarm, passed 3 0 0 0 0
Testing ArmAway and ArmStay modes
Basic LyricDAS_Verify Base Station Camera
Security settings ON and OFF for Disarm, passed 3 0 0 0 0
Testing ArmAway and ArmStay modes
Basic LyricDAS_Verify Base Station Camera
Security settings ON and OFF for Disarm, passed 3 0 0 0 0
Testing ArmAway and ArmStay modes
Basic LyricDAS_Verify Base Station Camera
Security settings ON and OFF for Disarm, passed 3 0 0 0 0
Testing ArmAway and ArmStay modes
Basic LyricDAS_Verify Base Station Camera
Security settings ON and OFF for Disarm, passed 3 0 0 0 0
Testing ArmAway and ArmStay modes
Basic LyricDAS_Verify Base Station Camera

Page 3 of 10
Features Overview

Security settings ON and OFF for Disarm, passed 3 0 0 0 0


Testing ArmAway and ArmStay modes
Basic LyricDAS_Verify Base Station Camera
Security settings ON and OFF for Disarm, passed 3 0 0 0 0
Testing ArmAway and ArmStay modes
Basic LyricDAS_Verify Base Station Camera
Security settings ON and OFF for Disarm, passed 3 0 0 0 0
Testing ArmAway and ArmStay modes
Basic LyricDAS_Verify Base Station Camera
Security settings ON and OFF for Disarm, passed 3 0 0 0 0
Testing ArmAway and ArmStay modes
Basic LyricDAS_Verify Base Station Camera
Security settings ON and OFF for Disarm, passed 3 0 0 0 0
Testing ArmAway and ArmStay modes
Basic LyricDAS_Verify Base Station Camera
Security settings ON and OFF for Disarm, passed 3 0 0 0 0
Testing ArmAway and ArmStay modes
Basic LyricDAS_Verify Base Station Camera
Security settings ON and OFF for Disarm, passed 3 0 0 0 0
Testing ArmAway and ArmStay modes
Basic LyricDAS_Verify Base Station Camera
Security settings ON and OFF for Disarm, passed 3 0 0 0 0
Testing ArmAway and ArmStay modes
Basic
Security Time synchronization to panel passed 2 0 0 0 0
Testing
Basic
Panic/Clear Alaram in Disarm then Panic
Security passed 3 0 0 0 0
/Clear Alaram in ArmAway
Testing
Basic
Panic/Clear Alaram in Disarm then Panic
Security passed 3 0 0 0 0
/Clear Alaram in ArmAway
Testing
Basic
Panic/Clear Alaram in Disarm then Panic
Security failed 2 1 0 0 0
/Clear Alaram in ArmAway
Testing
Basic
Panic/Clear Alaram in Disarm then Panic
Security passed 3 0 0 0 0
/Clear Alaram in ArmAway
Testing
Basic
Panic/Clear Alaram in Disarm then Panic
Security passed 3 0 0 0 0
/Clear Alaram in ArmAway
Testing
Basic
Panic/Clear Alaram in Disarm then Panic
Security failed 2 1 0 0 0
/Clear Alaram in ArmAway
Testing
Basic
Add user and read the user details.Add
Security passed 3 0 0 0 0
Duplicate user and verify
Testing
Basic
Security Add user and read the user details.Add
failed 2 1 0 0 0

Page 4 of 10
Features Overview

Testing Duplicate user and verify


Basic
Add user and read the user details.Add
Security passed 3 0 0 0 0
Duplicate user and verify
Testing
Basic
Security Edit user and verify the Edited user details passed 3 0 0 0 0
Testing
Basic
Security Edit user and verify the Edited user details failed 2 1 0 0 0
Testing
Basic
Delete user and verify the deleted user
Security passed 3 0 0 0 0
details.
Testing
DoorContact
time synchronization to panel passed 2 0 0 0 0
Test
DoorContact LyricDAS_SensorEnrollment_1_User to
passed 3 0 0 0 0
Test Disarm the panel
DoorContact LyricDAS_SensorEnrollment_2_ Start
failed 2 1 0 0 0
Test Sensor Enrollment
DoorContact LyricDAS_SensorEnrollment_3_ Trigger
passed 2 0 0 0 0
Test the Sensor on for Enrollment
DoorContact LyricDAS_SensorEnrollment_3_1_Trigger
passed 3 0 0 0 0
Test the Sensor off for Enrollment
DoorContact
time synchronization to panel passed 2 0 0 0 0
Test
LyricDAS_SensorEnrollment_4_To Check
DoorContact
sensor enrollment is saved and stop passed 3 0 0 0 0
Test
enrollment
LyricDAS_SensorEnrollment_4_To Check
DoorContact
sensor enrollment is saved and stop passed 3 0 0 0 0
Test
enrollment
DoorContact
time synchronization to panel passed 2 0 0 0 0
Test
DoorContact LyricDAS_SensorEnrollment_5_Trigger
passed 5 0 0 0 0
Test the Sensor on fault
DoorContact
time synchronization to panel passed 2 0 0 0 0
Test
DoorContact LyricDAS_SensorEnrollment_5_1_Trigger
passed 5 0 0 0 0
Test the Sensor off fault
DoorContact
time synchronization to panel passed 1 0 0 0 0
Test
DoorContact LyricDAS_SensorEnrollment_6_Trigger
failed 4 1 0 0 0
Test the Sensor tamper on
DoorContact
time synchronization to panel passed 2 0 0 0 0
Test
DoorContact LyricDAS_SensorEnrollment_6_1_Trigger
passed 3 0 0 0 0
Test the Sensor tamper off
DoorContact LyricDAS_SensorEnrollment_6_2_Disarm

Page 5 of 10
Features Overview

Test the panel and get the tamper status passed 2 0 0 0 0


DoorContact LyricDAS_SensorEnrollment_8_Bypass
passed 3 0 0 0 0
Test the Specific Zone
DoorContact LyricDAS_SensorEnrollment_9_ Trigger
passed 2 0 0 0 0
Test the Sensor fault
DoorContact LyricDAS_SensorEnrollment_9_1 Trigger
passed 1 0 0 0 0
Test the Sensor fault
DoorContact LyricDAS_SensorEnrollment_10_User to
passed 3 0 0 0 0
Test Disarm the panel
DoorContact LyricDAS_SensorEnrollment_11_ Trigger
failed 2 1 0 0 0
Test the Sensor fault
DoorContact LyricDAS_SensorEnrollment_5_1_Trigger
failed 2 1 0 0 0
Test the Sensor off fault
DoorContact LyricDAS_SensorEnrollment_9_ Get the
passed 3 0 0 0 0
Test Sensor status and panel status
DoorContact LyricDAS_SensorEnrollment_9_ Get the
passed 3 0 0 0 0
Test Sensor status and panel status
DoorContact LyricDAS_SensorEnrollment_10_User to
failed 2 1 0 0 0
Test Disarm the panel
DoorContact LyricDAS_1052_User to Arm Away the
passed 3 0 0 0 0
Test panel
DoorContact
time synchronization to panel passed 1 0 0 0 0
Test
LyricDAS_SensorEnrollment_5_Trigger
DoorContact
the Sensor on fault when panel is in passed 3 0 0 0 0
Test
ArmAway
LyricDAS_SensorEnrollment_5_1_Trigger
DoorContact
the Sensor off fault when panel is in passed 3 0 0 0 0
Test
ArmAway
DoorContact
time synchronization to panel passed 1 0 0 0 0
Test
DoorContact LyricDAS_SensorEnrollment_10_User to
passed 3 0 0 0 0
Test Disarm the panel
DoorContact LyricDAS_1097_User to Arm Stay the
failed 2 1 0 0 0
Test panel
DoorContact
time synchronization to panel passed 1 0 0 0 0
Test
LyricDAS_SensorEnrollment_5_Trigger
DoorContact
the Sensor on fault when panel is in failed 2 1 0 0 0
Test
Armstay
LyricDAS_SensorEnrollment_5_1_Trigger
DoorContact
the Sensor off fault when panel is in passed 3 0 0 0 0
Test
Armstay
DoorContact
time synchronization to panel passed 1 0 0 0 0
Test
DoorContact LyricDAS_SensorEnrollment_1_User to
passed 3 0 0 0 0
Test Disarm the panel
DoorContact

Page 6 of 10
Features Overview

Test time synchronization to panel passed 1 0 0 0 0


DoorContact Start/Stop LED Test and validate the
passed 3 0 0 0 0
Test response
DoorContact Start/Stop LED Test and validate the
passed 3 0 0 0 0
Test response
DoorContact
time synchronization to panel passed 1 0 0 0 0
Test
DoorContact
Start Range Test and validate the response failed 2 1 0 0 0
Test
DoorContact
time synchronization to panel passed 2 0 0 0 0
Test
DoorContact
Get the Range value passed 2 0 0 0 0
Test
DoorContact
Stop Range Test and validate the response failed 2 1 0 0 0
Test
DoorContact
Start Walk Test and validate the response passed 3 0 0 0 0
Test
DoorContact LyricDAS_SensorEnrollment_5_Trigger
passed 5 0 0 0 0
Test the Sensor on fault
DoorContact
time synchronization to panel passed 2 0 0 0 0
Test
DoorContact LyricDAS_SensorEnrollment_5_1_Trigger
passed 5 0 0 0 0
Test the Sensor off fault
DoorContact
Stop Walk Test and validate the response passed 3 0 0 0 0
Test
DoorContact LyricDAS_SensorEnrollment_10_ Delete
passed 3 0 0 0 0
Test sensor from the panel
System
Security LyricDAS_SensorEnrollment_10_User to
passed 3 0 0 0 0
Feature Disarm the panel
Testing
System
Configure the Entry and Exit delay 15
Security
seconds and arm the panel , verify event failed 2 1 0 2 0
Feature
after 15 seconds
Testing
System
Security LyricDAS_SensorEnrollment_10_User to
passed 3 0 0 0 0
Feature Disarm the panel
Testing
System
Configure the Entry and Exit delay 30
Security
seconds and arm the panel , verify event passed 5 0 0 0 0
Feature
after 30 seconds
Testing
System
Security LyricDAS_SensorEnrollment_10_User to
passed 3 0 0 0 0
Feature Disarm the panel
Testing
System
Configure the Entry and Exit delay 45

Page 7 of 10
Features Overview

Security seconds and arm the panel , verify event failed 2 1 0 2 0


Feature after 45 seconds
Testing
System
Security LyricDAS_SensorEnrollment_10_User to
passed 3 0 0 0 0
Feature Disarm the panel
Testing
System
Configure the Entry and Exit delay 60
Security
seconds and arm the panel , verify event failed 2 1 0 2 0
Feature
after 60 seconds
Testing
System
Security LyricDAS_SensorEnrollment_10_User to
passed 3 0 0 0 0
Feature Disarm the panel
Testing
ZWave
LyricDAS_SensorEnrollment_1_User to
Functional passed 3 0 0 0 0
Disarm the panel
Testing
ZWave
Functional time synchronization to panel passed 2 0 0 0 0
Testing
ZWave
LyricDAS_180_Zwave- Send API to
Functional passed 3 0 0 0 0
exclude the dimmer or multilevel switch
Testing
ZWave
Zwave- Trip dimmer or multilevel switch
Functional passed 3 0 0 0 0
to exclude
Testing
ZWave
LyricDAS_180_Zwave- Send API to
Functional passed 3 0 0 0 0
include the dimmer or multilevel switch
Testing
ZWave
Zwave- Trip dimmer or multilevel switch
Functional failed 2 1 0 0 0
to include
Testing
ZWave LyricDAS_181_Zwave device dimmer
Functional switch on ,set percentage and off then failed 2 1 0 0 0
Testing verify status of each test
ZWave LyricDAS_181_Zwave device dimmer
Functional switch on ,set percentage and off then failed 2 1 0 0 0
Testing verify status of each test
ZWave LyricDAS_181_Zwave device dimmer
Functional switch on ,set percentage and off then failed 2 1 0 0 0
Testing verify status of each test
ZWave LyricDAS_181_Zwave device dimmer
Functional switch on ,set percentage and off then failed 2 1 0 0 0
Testing verify status of each test
ZWave LyricDAS_181_Zwave device dimmer
Functional switch on ,set percentage and off then failed 2 1 0 0 0
Testing verify status of each test
ZWave LyricDAS_181_Zwave device dimmer

Page 8 of 10
Features Overview

Functional switch on ,set percentage and off then failed 2 1 0 0 0


Testing verify status of each test
ZWave LyricDAS_181_Zwave device dimmer
Functional switch on ,set percentage and off then failed 2 1 0 0 0
Testing verify status of each test
ZWave
LyricDAS_180_Zwave- Send API to
Functional passed 3 0 0 0 0
exclude the dimmer or multilevel switch
Testing
ZWave
Zwave- Trip dimmer or multilevel switch
Functional passed 3 0 0 0 0
to exclude
Testing
ZWave
Functional time synchronization to panel passed 2 0 0 0 0
Testing
ZWave
LyricDAS_180_Zwave- Send API to
Functional passed 3 0 0 0 0
exclude the binary switch
Testing
ZWave
Functional Zwave- Trip binary switch to exclude passed 3 0 0 0 0
Testing
ZWave
LyricDAS_180_Zwave- Send API to
Functional passed 3 0 0 0 0
include the binary switch
Testing
ZWave
Functional Zwave- Trip binary switch to include passed 3 0 0 0 0
Testing
ZWave LyricDAS_181_Zwave device binary
Functional switch on ,set percentage and off then failed 2 1 0 0 0
Testing verify status of each test
ZWave LyricDAS_181_Zwave device binary
Functional switch on ,set percentage and off then failed 2 1 0 0 0
Testing verify status of each test
ZWave LyricDAS_181_Zwave device binary
Functional switch on ,set percentage and off then failed 2 1 0 0 0
Testing verify status of each test
ZWave LyricDAS_181_Zwave device binary
Functional switch on ,set percentage and off then failed 2 1 0 0 0
Testing verify status of each test
ZWave
LyricDAS_180_Zwave- Send API to
Functional failed 2 1 0 0 0
exclude the binary switch
Testing
ZWave
Functional Zwave- Trip binary switch to exclude passed 3 0 0 0 0
Testing
LyricDAS_SensorEnrollment_1_User to
Keyfob Test passed 3 0 0 0 0
Disarm the panel
LyricDAS_SensorEnrollment_2_ Start
Keyfob Test passed 3 0 0 0 0
Sensor Enrollment for keyfob
Keyfob Test Time synchronization to panel passed 2 0 0 0 0

Page 9 of 10
Features Overview

Keyfob Test LyricDAS_SensorEnrollment_3_ Trigger failed 3 1 0 0 0


the keyfob Sensor Enrollment
LyricDAS_SensorEnrollment_3_1_Trigger
Keyfob Test passed 1 0 0 0 0
the Sensor for Enrollment
Keyfob Test time synchronization to panel passed 1 0 0 0 0
LyricDAS_SensorEnrollment_4_To Check
Keyfob Test sensor enrollment is saved and stop failed 2 1 0 0 0
enrollment
LyricDAS_SensorEnrollment_4_To Check
Keyfob Test sensor enrollment is saved and stop passed 3 0 0 0 0
enrollment
Keyfob Test time synchronization to panel passed 1 0 0 0 0
LyricDAS_SensorEnrollment_5_Press the
Keyfob Test failed 2 1 0 0 0
keyfob button for ArmAway
Keyfob Test time synchronization to panel passed 1 0 0 0 0
LyricDAS_SensorEnrollment_6_Press the
Keyfob Test failed 2 1 0 0 0
keyfob button for Disarm
Keyfob Test time synchronization to panel passed 1 0 0 0 0
LyricDAS_SensorEnrollment_7_Press the
Keyfob Test failed 2 1 0 0 0
keyfob button for ArmStay
Keyfob Test time synchronization to panel passed 1 0 0 0 0
LyricDAS_SensorEnrollment_8_Press the
Keyfob Test failed 2 1 0 0 0
keyfob button for panic
Keyfob Test time synchronization to panel passed 1 0 0 0 0
Panic/Clear Alaram in Disarm then Panic
Keyfob Test failed 2 1 0 0 0
/Clear Alaram in ArmAway
Keyfob Test time synchronization to panel passed 1 0 0 0 0
LyricDAS_SensorEnrollment_6_Press the
Keyfob Test failed 2 1 0 0 0
keyfob button for Disarm
LyricDAS_SensorEnrollment_11_ Delete
Keyfob Test passed 3 0 0 0 0
keyfob from the panel

Page 10 of 10

You might also like