Description
The bgp_speaker automation test case failed with error "ERROR! 'dict object' has no attribute u'10.154.239.129'"
This script starts 3 bgp peers on the PTF container and announces routes to DUT switch. However, the DUT switch
could not establish BGP session with the peers simulated by exabgp on PTF.
Image from the 201811 branch does not have this issue.
Steps to reproduce the issue:
- The t0 topology is used.
- DUT switch is running image from master branch.
- Run the bgp_speaker test case from sonic-mgmt docker.
Describe the results you received:
In ansible log:
TASK [test : Verify accepted prefixes of the dynamic neighbors are correct] ****
task path: /var/johnar/sonic-mgmt/ansible/roles/test/tasks/bgp_speaker.yml:161
Thursday 03 January 2019 11:39:12 +0000 (0:00:03.158) 0:01:51.172 ******
fatal: [arc-switch1029-t0]: FAILED! => {"failed": true, "msg": "ERROR! 'dict object' has no attribute u'10.154.239.129'"}
Check bgp neighbors on DUT switch while script was executing the above task:
$ show ip bgp summary
BGP router identifier 10.1.0.32, local AS number 65100
RIB entries 12807, using 1401 KiB of memory
Peers 8, using 36 KiB of memory
Peer groups 2, using 112 bytes of memory
Neighbor V AS MsgRcvd MsgSent TblVer InQ OutQ Up/Down State/PfxRcd
10.0.0.57 4 64600 3245 50 0 0 0 00:02:07 6400
10.0.0.59 4 64600 3244 3246 0 0 0 00:02:02 6400
10.0.0.61 4 64600 3245 3251 0 0 0 00:02:06 6400
10.0.0.63 4 64600 3245 3248 0 0 0 00:02:05 6400
Total number of neighbors 4
Describe the results you expected:
After the exabgp tool announced routes to DUT switch, the DUT switch should be able to establish session with the
exabgp peers. The dynamic neighbors should can be observed in output of "show ip bgp summary".
$ show ip bgp summary
BGP router identifier 10.1.0.32, local AS number 65100
RIB entries 12811, using 1401 KiB of memory
Peers 11, using 50 KiB of memory
Peer groups 2, using 112 bytes of memory
Neighbor V AS MsgRcvd MsgSent TblVer InQ OutQ Up/Down State/PfxRcd
10.0.0.57 4 64600 3319 122 0 0 0 00:05:45 6400
10.0.0.59 4 64600 3319 3322 0 0 0 00:05:45 6400
10.0.0.61 4 64600 3318 3322 0 0 0 00:05:43 6400
10.0.0.63 4 64600 3316 3322 0 0 0 00:05:42 6400
*10.154.239.129 4 65432 4 6411 0 0 0 00:00:45 1
*10.154.239.130 4 65432 4 6411 0 0 0 00:00:46 1
*192.168.0.2 4 65432 4 6411 0 0 0 00:00:48 1
Total number of neighbors 7
* - dynamic neighbor
3 IPv4 dynamic neighbor(s), limit 100
Additional information you deem important (e.g. issue happens only occasionally):
**Output of `show version`:**
```
SONiC Software Version: SONiC.HEAD.842-1e8d3ec
Distribution: Debian 9.6
Kernel: 4.9.0-8-amd64
Build commit: 1e8d3ec
Build date: Tue Jan 1 13:38:01 UTC 2019
Built by: johnar@jenkins-worker-4
```
**Attach debug file `sudo generate_dump`:**
```
$ sudo generate_dump
Create switch, #0 INIT_SWITCH=false
Jan 03 11:59:11 INFO LOG: Initializing SX log with STDOUT as output file.
init_buffer_resource_limits[
num_ingress_pools:8
num_egress_pools:8
num_total_pools:21
num_port_queue_buff:16
num_port_pg_buff:8
unit_size:96
max_buffers_per_port:93
init_buffer_resource_limits]
The SAI dump is generated to /tmp/sai_sdk_dump_01_03_2019_11_59_AM
Jan 03 11:59:13 ERROR SAI_SWITCH: mlnx_sai_switch.c[4690]- mlnx_shutdown_switch: Failed to delete default router - Entry Not Found.
Jan 03 11:59:13 ERROR SAI_ACL: mlnx_sai_acl.c[10972]- mlnx_acl_rpc_call: Failed to send data througn the socket - No such file or directory
Jan 03 11:59:13 ERROR LOG: ASSERT in cl_thread.c[99]- cl_thread_destroy
Jan 03 11:59:13 ERROR LOG: ASSERT - Retrieved a list of 6 elements.
Jan 03 11:59:13 ERROR LOG: ASSERT - Element 0: /usr/lib/libsxcomp.so.1(cl_thread_destroy+0xad) [0x7fdd2bb3884d].
Jan 03 11:59:13 ERROR LOG: ASSERT - Element 1: /usr/lib/libsai.so.1(mlnx_acl_deinit+0x27d) [0x7fdd36c2f0ad].
Jan 03 11:59:13 ERROR LOG: ASSERT - Element 2: /usr/lib/libsai.so.1(+0x17cf97) [0x7fdd36ca6f97].
Jan 03 11:59:13 ERROR LOG: ASSERT - Element 3: saisdkdump() [0x4018a2].
Jan 03 11:59:13 ERROR LOG: ASSERT - Element 4: /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7fdd357ecb45].
Jan 03 11:59:13 ERROR LOG: ASSERT - Element 5: saisdkdump() [0x401b00].
```
bgpd.log.1.gz
bgpd.log.gz
syslog.1.gz
syslog.2.gz
Description
The bgp_speaker automation test case failed with error "ERROR! 'dict object' has no attribute u'10.154.239.129'"
This script starts 3 bgp peers on the PTF container and announces routes to DUT switch. However, the DUT switch
could not establish BGP session with the peers simulated by exabgp on PTF.
Image from the 201811 branch does not have this issue.
Steps to reproduce the issue:
Describe the results you received:
In ansible log:
Check bgp neighbors on DUT switch while script was executing the above task:
Describe the results you expected:
After the exabgp tool announced routes to DUT switch, the DUT switch should be able to establish session with the
exabgp peers. The dynamic neighbors should can be observed in output of "show ip bgp summary".
Additional information you deem important (e.g. issue happens only occasionally):
bgpd.log.1.gz
bgpd.log.gz
syslog.1.gz
syslog.2.gz