gnrc_sixlowpan_frag: check if own message queue is full by miri64 · Pull Request #10679 · RIOT-OS/RIOT

miri64 · 2018-12-29T22:00:48Z

Contribution description

When issueing the sending of the next fragment the current version of gnrc_sixlowpan_frag doesn't check if the queue is full. This leads to leakage of the packet buffer, since when it is full, the package never gets released.

This change adds a checks and error exits in case the queue is full.

Testing procedure

See #10672. Packet buffer will still run full though.

Issues/PRs references

Found on the hunt for #10672, but doesn't fix it fully.

When issueing the sending of the next fragment the current version of `gnrc_sixlowpan_frag` doesn't check if the queue is full. This leads to leakage of the packet buffer, since when it is full, the package never gets released. This change adds a checks and error exits in case the queue is full.

miri64 · 2018-12-29T22:08:12Z

The bug found here #10672 (comment) definitely becomes reproducably fixed.

miri64 · 2018-12-29T22:20:55Z

@gschorcht would be interesting if this already fixes the issue with ESP-now, since the remaining race-condition could also be an issue with native.

TimoRoth · 2018-12-29T23:04:40Z

would be interesting if this already fixes the issue with ESP-now, since the remaining race-condition could also be an issue with native.

Unfortunately it's still happening for me.
The way it behaves is quite interesting. At first the ping response times just spike up from around 50ms before to 250ms to 500ms without any lost packages, then after roughly 10 seconds, the first timeouts start showing up, then all pings timeout, with occasionally still one reply getting through, until all of them timeout. At some point then one of the nodes starts spamming "error: packet buffer full", but printing one ping timeout message every 3 seconds, until after 4 or 5 of them it spams the error without interruption, while the other node is only seeing timeouts the whole time.

Edit: Another observation: if I reboot the faulted node, the other node gets replies again in 50ms, but the now rebooted one still gets replies within 250ms, increasing continously, until this time the other node goes into the error state.

miri64 · 2018-12-29T23:07:34Z

@TimoRoth can you give the output of the pktbuf command (requires the gnrc_pktbuf_cmd module to be compiled in) after the node reports packet buffer full and finishes the ping command?

TimoRoth · 2018-12-29T23:25:42Z

First another observation: I re-flashed my nodes, went away for a few minutes, and then started the pings, and things started to explode pretty much immediately, rather than after a few minutes of nice and fast pings.

Scratch that, hard-reset the nodes, and it still happened pretty much right away. Seems to be entirely random or related to some unknown factor.

pktbuf output

2018-12-30 00:19:58,988 - INFO #  pktbuf
2018-12-30 00:19:58,997 - INFO # packet buffer: first byte: 0x3ffb8da8, last byte: 0x3ffba5a8 (size: 6144)
2018-12-30 00:19:58,999 - INFO #   position of last byte used: 6136
2018-12-30 00:19:59,005 - INFO # =========== chunk   0 (0x3ffb8da8 size:  192) ===========
2018-12-30 00:19:59,011 - INFO # 00000000  38  8E  FB  3F  C0  90  FB  3F  F5  00  00  00  01  00  00  00
2018-12-30 00:19:59,017 - INFO # 00000010  01  00  00  00  00  00  00  00  00  8F  FB  3F  B8  91  FB  3F
2018-12-30 00:19:59,023 - INFO # 00000020  F5  00  00  00  01  00  00  00  01  00  00  00  18  00  00  00
2018-12-30 00:19:59,029 - INFO # 00000030  30  8F  FB  3F  B0  92  FB  3F  F5  00  00  00  01  00  00  00
2018-12-30 00:19:59,035 - INFO # 00000040  01  00  00  00  00  00  00  00  78  8F  FB  3F  A8  93  FB  3F
2018-12-30 00:19:59,043 - INFO # 00000050  F5  00  00  00  01  00  00  00  01  00  00  00  08  00  00  00
2018-12-30 00:19:59,049 - INFO # 00000060  D0  8E  FB  3F  B0  95  FB  3F  F5  00  00  00  01  00  00  00
2018-12-30 00:19:59,055 - INFO # 00000070  01  00  00  00  00  00  00  00  28  99  FB  3F  A0  A0  FB  3F
2018-12-30 00:19:59,061 - INFO # 00000080  F5  00  00  00  01  00  00  00  01  00  00  00  C0  E9  3C  71
2018-12-30 00:19:59,067 - INFO # 00000090  00  00  00  00  70  8E  FB  3F  14  00  00  00  01  00  00  00
2018-12-30 00:19:59,073 - INFO # 000000A0  FF  FF  FF  FF  C0  E9  3C  71  80  9B  FB  3F  60  9D  FB  3F
2018-12-30 00:19:59,081 - INFO # 000000B0  F5  00  00  00  01  00  00  00  01  00  00  00  00  00  00  00
2018-12-30 00:19:59,085 - INFO # ~ unused: 0x3ffb8e68 (next: 0x3ffb8e88, size:    8) ~
2018-12-30 00:19:59,091 - INFO # =========== chunk   1 (0x3ffb8e70 size:   24) ===========
2018-12-30 00:19:59,097 - INFO # 00000000  06  06  0A  00  00  00  00  00  30  AE  A4  1B  C0  E9  3C  71
2018-12-30 00:19:59,101 - INFO # 00000010  BF  83  D5  19  10  00  00  00
2018-12-30 00:19:59,105 - INFO # ~ unused: 0x3ffb8e88 (next: 0x3ffb8ec0, size:    8) ~
2018-12-30 00:19:59,109 - INFO # =========== chunk   2 (0x3ffb8e90 size:   48) ===========
2018-12-30 00:19:59,117 - INFO # 00000000  A8  8F  FB  3F  C8  8F  FB  3F  F6  00  00  00  01  00  00  00
2018-12-30 00:19:59,123 - INFO # 00000010  00  00  00  00  00  32  AE  A4  F8  94  FB  3F  A0  94  FB  3F
2018-12-30 00:19:59,129 - INFO # 00000020  55  00  00  00  01  00  00  00  01  00  00  00  FE  83  D5  19
2018-12-30 00:19:59,133 - INFO # ~ unused: 0x3ffb8ec0 (next: 0x3ffb8fc0, size:   16) ~
2018-12-30 00:19:59,139 - INFO # =========== chunk   3 (0x3ffb8ed0 size:  240) ===========
2018-12-30 00:19:59,145 - INFO # 00000000  00  00  00  00  E8  8E  FB  3F  14  00  00  00  01  00  00  00
2018-12-30 00:19:59,151 - INFO # 00000010  FF  FF  FF  FF  00  00  32  AE  06  06  0A  00  00  00  00  00
2018-12-30 00:19:59,157 - INFO # 00000020  30  AE  A4  1B  C0  E9  3C  71  BF  83  D5  19  D5  19  80  00
2018-12-30 00:19:59,165 - INFO # 00000030  00  00  00  00  18  8F  FB  3F  14  00  00  00  01  00  00  00
2018-12-30 00:19:59,171 - INFO # 00000040  FF  FF  FF  FF  18  00  00  00  06  06  0A  00  00  00  00  00
2018-12-30 00:19:59,177 - INFO # 00000050  30  AE  A4  1B  C0  E9  3C  71  BF  83  D5  19  A0  00  00  00
2018-12-30 00:19:59,183 - INFO # 00000060  00  00  00  00  48  8F  FB  3F  14  00  00  00  01  00  00  00
2018-12-30 00:19:59,189 - INFO # 00000070  FF  FF  FF  FF  53  53  53  53  06  06  0A  00  00  00  00  00
2018-12-30 00:19:59,195 - INFO # 00000080  30  AE  A4  1B  C0  E9  3C  71  BF  83  D5  19  53  53  53  53
2018-12-30 00:19:59,203 - INFO # 00000090  40  95  FB  3F  A8  96  FB  3F  F5  00  00  00  01  00  00  00
2018-12-30 00:19:59,209 - INFO # 000000A0  01  00  00  00  53  53  53  53  00  00  00  00  90  8F  FB  3F
2018-12-30 00:19:59,215 - INFO # 000000B0  14  00  00  00  01  00  00  00  FF  FF  FF  FF  40  00  00  00
2018-12-30 00:19:59,221 - INFO # 000000C0  06  06  0A  00  00  00  00  00  30  AE  A4  1B  C0  E9  3C  71
2018-12-30 00:19:59,227 - INFO # 000000D0  BF  83  D5  19  53  53  53  53  88  95  FB  3F  A0  97  FB  3F
2018-12-30 00:19:59,233 - INFO # 000000E0  F5  00  00  00  01  00  00  00  01  00  00  00  53  53  53  53
2018-12-30 00:19:59,239 - INFO # ~ unused: 0x3ffb8fc0 (next: 0x3ffb95a0, size:    8) ~
2018-12-30 00:19:59,243 - INFO # =========== chunk   4 (0x3ffb8fc8 size: 1496) ===========
2018-12-30 00:19:59,251 - INFO # 00000000  01  E5  00  00  54  1E  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,257 - INFO # 00000010  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,263 - INFO # 00000020  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,269 - INFO # 00000030  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,275 - INFO # 00000040  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,281 - INFO # 00000050  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,289 - INFO # 00000060  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,295 - INFO # 00000070  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,301 - INFO # 00000080  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,307 - INFO # 00000090  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,313 - INFO # 000000A0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,319 - INFO # 000000B0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,327 - INFO # 000000C0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,333 - INFO # 000000D0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,339 - INFO # 000000E0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,345 - INFO # 000000F0  53  53  53  53  53  53  53  53  E5  00  00  59  1E  53  53  53
2018-12-30 00:19:59,351 - INFO # 00000100  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,357 - INFO # 00000110  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,364 - INFO # 00000120  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,370 - INFO # 00000130  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,377 - INFO # 00000140  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,384 - INFO # 00000150  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,390 - INFO # 00000160  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,395 - INFO # 00000170  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,403 - INFO # 00000180  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,409 - INFO # 00000190  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,415 - INFO # 000001A0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,421 - INFO # 000001B0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,427 - INFO # 000001C0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,433 - INFO # 000001D0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,441 - INFO # 000001E0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,447 - INFO # 000001F0  E5  00  00  59  3C  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,453 - INFO # 00000200  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,459 - INFO # 00000210  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,465 - INFO # 00000220  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,471 - INFO # 00000230  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,479 - INFO # 00000240  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,485 - INFO # 00000250  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,491 - INFO # 00000260  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,497 - INFO # 00000270  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,503 - INFO # 00000280  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,509 - INFO # 00000290  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,517 - INFO # 000002A0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,523 - INFO # 000002B0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,529 - INFO # 000002C0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,535 - INFO # 000002D0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,541 - INFO # 000002E0  53  53  53  53  53  53  53  53  E5  00  00  59  5A  53  53  53
2018-12-30 00:19:59,547 - INFO # 000002F0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,554 - INFO # 00000300  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,561 - INFO # 00000310  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,567 - INFO # 00000320  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,573 - INFO # 00000330  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,579 - INFO # 00000340  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,585 - INFO # 00000350  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,592 - INFO # 00000360  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,599 - INFO # 00000370  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,605 - INFO # 00000380  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,611 - INFO # 00000390  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,617 - INFO # 000003A0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,623 - INFO # 000003B0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,630 - INFO # 000003C0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,636 - INFO # 000003D0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,643 - INFO # 000003E0  E5  00  00  59  78  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,649 - INFO # 000003F0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,655 - INFO # 00000400  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,661 - INFO # 00000410  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,668 - INFO # 00000420  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,674 - INFO # 00000430  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,680 - INFO # 00000440  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,687 - INFO # 00000450  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,693 - INFO # 00000460  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,700 - INFO # 00000470  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,706 - INFO # 00000480  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,712 - INFO # 00000490  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,719 - INFO # 000004A0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,725 - INFO # 000004B0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,731 - INFO # 000004C0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,738 - INFO # 000004D0  53  53  53  53  53  53  53  53  E5  00  00  59  96  53  53  53
2018-12-30 00:19:59,744 - INFO # 000004E0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,750 - INFO # 000004F0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,757 - INFO # 00000500  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,763 - INFO # 00000510  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,769 - INFO # 00000520  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,776 - INFO # 00000530  00  00  00  00  10  95  FB  3F  14  00  00  00  01  00  00  00
2018-12-30 00:19:59,782 - INFO # 00000540  FF  FF  FF  FF  53  53  53  53  06  06  0A  00  00  00  00  00
2018-12-30 00:19:59,788 - INFO # 00000550  30  AE  A4  1B  C0  E9  3C  71  BF  83  D5  19  53  53  53  53
2018-12-30 00:19:59,795 - INFO # 00000560  70  95  FB  3F  B0  99  FB  3F  F6  00  00  00  01  00  00  00
2018-12-30 00:19:59,801 - INFO # 00000570  00  00  00  00  53  53  53  53  00  00  00  00  58  95  FB  3F
2018-12-30 00:19:59,807 - INFO # 00000580  14  00  00  00  01  00  00  00  FF  FF  FF  FF  53  53  53  53
2018-12-30 00:19:59,814 - INFO # 00000590  06  06  0A  00  00  00  00  00  30  AE  A4  1B  C0  E9  3C  71
2018-12-30 00:19:59,821 - INFO # 000005A0  BF  83  D5  19  53  53  53  53  C8  98  FB  3F  E8  A4  FB  3F
2018-12-30 00:19:59,827 - INFO # 000005B0  55  00  00  00  01  00  00  00  01  00  00  00  53  53  53  53
2018-12-30 00:19:59,834 - INFO # 000005C0  00  00  00  00  98  98  FB  3F  14  00  00  00  01  00  00  00
2018-12-30 00:19:59,837 - INFO # 000005D0  FF  FF  FF  FF  53  53  00  00
2018-12-30 00:19:59,842 - INFO # ~ unused: 0x3ffb95a0 (next: 0x3ffb99a0, size:   16) ~
2018-12-30 00:19:59,846 - INFO # =========== chunk   5 (0x3ffb95b0 size: 1008) ===========
2018-12-30 00:19:59,852 - INFO # 00000000  C5  00  00  59  41  60  00  00  00  04  D8  3A  40  FD  19  FF
2018-12-30 00:19:59,860 - INFO # 00000010  FF  00  00  00  00  32  AE  A4  FF  FE  1B  C0  E9  FD  19  FF
2018-12-30 00:19:59,866 - INFO # 00000020  FF  00  00  00  00  3E  71  BF  FF  FE  83  D5  19  80  00  96
2018-12-30 00:19:59,872 - INFO # 00000030  FD  00  53  00  26  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,879 - INFO # 00000040  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,885 - INFO # 00000050  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,891 - INFO # 00000060  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,897 - INFO # 00000070  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,903 - INFO # 00000080  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,909 - INFO # 00000090  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,917 - INFO # 000000A0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,923 - INFO # 000000B0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,929 - INFO # 000000C0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,936 - INFO # 000000D0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,942 - INFO # 000000E0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,948 - INFO # 000000F0  53  53  53  53  53  53  53  53  C5  00  00  5A  41  60  00  00
2018-12-30 00:19:59,954 - INFO # 00000100  00  04  D8  3A  40  FD  19  FF  FF  00  00  00  00  32  AE  A4
2018-12-30 00:19:59,960 - INFO # 00000110  FF  FE  1B  C0  E9  FD  19  FF  FF  00  00  00  00  3E  71  BF
2018-12-30 00:19:59,966 - INFO # 00000120  FF  FE  83  D5  19  80  00  96  FC  00  53  00  27  53  53  53
2018-12-30 00:19:59,974 - INFO # 00000130  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,980 - INFO # 00000140  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,986 - INFO # 00000150  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,993 - INFO # 00000160  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:19:59,999 - INFO # 00000170  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,005 - INFO # 00000180  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,011 - INFO # 00000190  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,018 - INFO # 000001A0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,024 - INFO # 000001B0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,030 - INFO # 000001C0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,036 - INFO # 000001D0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,042 - INFO # 000001E0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,050 - INFO # 000001F0  C5  00  00  5B  41  60  00  00  00  04  D8  3A  40  FD  19  FF
2018-12-30 00:20:00,056 - INFO # 00000200  FF  00  00  00  00  32  AE  A4  FF  FE  1B  C0  E9  FD  19  FF
2018-12-30 00:20:00,062 - INFO # 00000210  FF  00  00  00  00  3E  71  BF  FF  FE  83  D5  19  80  00  96
2018-12-30 00:20:00,069 - INFO # 00000220  FB  00  53  00  28  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,075 - INFO # 00000230  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,081 - INFO # 00000240  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,087 - INFO # 00000250  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,093 - INFO # 00000260  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,099 - INFO # 00000270  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,107 - INFO # 00000280  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,113 - INFO # 00000290  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,119 - INFO # 000002A0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,126 - INFO # 000002B0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,131 - INFO # 000002C0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,138 - INFO # 000002D0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,144 - INFO # 000002E0  53  53  53  53  53  53  53  53  06  06  0A  00  00  00  00  00
2018-12-30 00:20:00,150 - INFO # 000002F0  30  AE  A4  1B  C0  E9  3C  71  BF  83  D5  19  3A  40  FD  19
2018-12-30 00:20:00,156 - INFO # 00000300  58  99  FB  3F  40  A5  FB  3F  56  00  00  00  01  00  00  00
2018-12-30 00:20:00,164 - INFO # 00000310  00  00  00  00  53  53  53  53  00  00  00  00  E0  98  FB  3F
2018-12-30 00:20:00,170 - INFO # 00000320  14  00  00  00  01  00  00  00  FF  FF  FF  FF  53  53  53  53
2018-12-30 00:20:00,176 - INFO # 00000330  06  06  0A  00  00  00  00  00  30  AE  A4  1B  C0  E9  3C  71
2018-12-30 00:20:00,182 - INFO # 00000340  BF  83  D5  19  53  53  53  53  70  99  FB  3F  98  A1  FB  3F
2018-12-30 00:20:00,188 - INFO # 00000350  F5  00  00  00  01  00  00  00  01  00  00  00  53  53  53  53
2018-12-30 00:20:00,194 - INFO # 00000360  A8  9A  FB  3F  A8  A2  FB  3F  F5  00  00  00  01  00  00  00
2018-12-30 00:20:00,201 - INFO # 00000370  01  00  00  00  53  53  53  53  00  00  00  00  40  99  FB  3F
2018-12-30 00:20:00,206 - INFO # 00000380  14  00  00  00  01  00  00  00  FF  FF  FF  FF  53  53  53  53
2018-12-30 00:20:00,214 - INFO # 00000390  06  06  0A  00  00  00  00  00  30  AE  A4  1B  C0  E9  3C  71
2018-12-30 00:20:00,220 - INFO # 000003A0  BF  83  D5  19  60  00  00  00  F0  9A  FB  3F  F8  A3  FB  3F
2018-12-30 00:20:00,226 - INFO # 000003B0  55  00  00  00  01  00  00  00  01  00  00  00  18  00  00  00
2018-12-30 00:20:00,232 - INFO # 000003C0  00  00  00  00  88  99  FB  3F  14  00  00  00  01  00  00  00
2018-12-30 00:20:00,239 - INFO # 000003D0  FF  FF  FF  FF  30  00  00  00  06  06  0A  00  00  00  00  00
2018-12-30 00:20:00,244 - INFO # 000003E0  30  AE  A4  1B  C0  E9  3C  71  BF  83  D5  19  53  53  53  53
2018-12-30 00:20:00,250 - INFO # ~ unused: 0x3ffb99a0 (next: 0x3ffb9d38, size:   16) ~
2018-12-30 00:20:00,254 - INFO # =========== chunk   6 (0x3ffb99b0 size:  904) ===========
2018-12-30 00:20:00,260 - INFO # 00000000  01  E5  00  00  5B  1E  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,268 - INFO # 00000010  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,273 - INFO # 00000020  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,281 - INFO # 00000030  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,286 - INFO # 00000040  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,292 - INFO # 00000050  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,299 - INFO # 00000060  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,306 - INFO # 00000070  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,312 - INFO # 00000080  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,317 - INFO # 00000090  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,325 - INFO # 000000A0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,331 - INFO # 000000B0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,337 - INFO # 000000C0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,344 - INFO # 000000D0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,350 - INFO # 000000E0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,356 - INFO # 000000F0  53  53  53  53  53  53  53  53  00  00  00  00  C0  9A  FB  3F
2018-12-30 00:20:00,362 - INFO # 00000100  14  00  00  00  01  00  00  00  FF  FF  FF  FF  53  53  53  53
2018-12-30 00:20:00,368 - INFO # 00000110  06  06  0A  00  00  00  00  00  30  AE  A4  1B  C0  E9  3C  71
2018-12-30 00:20:00,374 - INFO # 00000120  BF  83  D5  19  53  53  53  53  38  9B  FB  3F  50  A4  FB  3F
2018-12-30 00:20:00,382 - INFO # 00000130  55  00  00  00  01  00  00  00  01  00  00  00  53  53  53  53
2018-12-30 00:20:00,388 - INFO # 00000140  00  00  00  00  08  9B  FB  3F  14  00  00  00  01  00  00  00
2018-12-30 00:20:00,394 - INFO # 00000150  FF  FF  FF  FF  53  53  53  53  06  06  0A  00  00  00  00  00
2018-12-30 00:20:00,401 - INFO # 00000160  30  AE  A4  1B  C0  E9  3C  71  BF  83  D5  19  53  53  53  53
2018-12-30 00:20:00,407 - INFO # 00000170  C0  9C  FB  3F  C8  9B  FB  3F  F5  00  00  00  01  00  00  00
2018-12-30 00:20:00,413 - INFO # 00000180  01  00  00  00  53  53  53  53  00  00  00  00  50  9B  FB  3F
2018-12-30 00:20:00,419 - INFO # 00000190  14  00  00  00  01  00  00  00  FF  FF  FF  FF  53  53  53  53
2018-12-30 00:20:00,425 - INFO # 000001A0  06  06  0A  00  00  00  00  00  30  AE  A4  1B  C0  E9  3C  71
2018-12-30 00:20:00,431 - INFO # 000001B0  BF  83  D5  19  53  53  53  53  08  9D  FB  3F  58  9E  FB  3F
2018-12-30 00:20:00,439 - INFO # 000001C0  F5  00  00  00  01  00  00  00  01  00  00  00  53  53  53  53
2018-12-30 00:20:00,445 - INFO # 000001D0  00  00  00  00  98  9B  FB  3F  14  00  00  00  01  00  00  00
2018-12-30 00:20:00,452 - INFO # 000001E0  FF  FF  FF  FF  53  53  53  53  06  06  0A  00  00  00  00  00
2018-12-30 00:20:00,458 - INFO # 000001F0  30  AE  A4  1B  C0  E9  3C  71  BF  83  D5  19  53  53  53  53
2018-12-30 00:20:00,464 - INFO # 00000200  A8  9F  FB  3F  50  9F  FB  3F  55  00  00  00  01  00  00  00
2018-12-30 00:20:00,470 - INFO # 00000210  01  00  00  00  53  53  53  53  E5  00  00  61  3C  53  53  53
2018-12-30 00:20:00,476 - INFO # 00000220  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,482 - INFO # 00000230  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,488 - INFO # 00000240  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,496 - INFO # 00000250  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,502 - INFO # 00000260  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,509 - INFO # 00000270  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,515 - INFO # 00000280  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,521 - INFO # 00000290  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,527 - INFO # 000002A0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,533 - INFO # 000002B0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,539 - INFO # 000002C0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,547 - INFO # 000002D0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,553 - INFO # 000002E0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,559 - INFO # 000002F0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,566 - INFO # 00000300  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,572 - INFO # 00000310  00  00  00  00  D8  9C  FB  3F  14  00  00  00  01  00  00  00
2018-12-30 00:20:00,578 - INFO # 00000320  FF  FF  FF  FF  53  53  53  53  06  06  0A  00  00  00  00  00
2018-12-30 00:20:00,584 - INFO # 00000330  30  AE  A4  1B  C0  E9  3C  71  BF  83  D5  19  53  53  53  53
2018-12-30 00:20:00,590 - INFO # 00000340  F0  9F  FB  3F  A0  A3  FB  3F  55  00  00  00  01  00  00  00
2018-12-30 00:20:00,596 - INFO # 00000350  01  00  00  00  53  53  53  53  00  00  00  00  20  9D  FB  3F
2018-12-30 00:20:00,604 - INFO # 00000360  14  00  00  00  01  00  00  00  FF  FF  FF  FF  53  53  53  53
2018-12-30 00:20:00,610 - INFO # 00000370  06  06  0A  00  00  00  00  00  30  AE  A4  1B  C0  E9  3C  71
2018-12-30 00:20:00,613 - INFO # 00000380  BF  83  D5  19  53  53  53  53
2018-12-30 00:20:00,617 - INFO # ~ unused: 0x3ffb9d38 (next: 0x3ffb9fd8, size:   40) ~
2018-12-30 00:20:00,623 - INFO # =========== chunk   7 (0x3ffb9d60 size:  632) ===========
2018-12-30 00:20:00,629 - INFO # 00000000  E5  00  00  61  1E  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,635 - INFO # 00000010  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,641 - INFO # 00000020  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,649 - INFO # 00000030  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,656 - INFO # 00000040  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,661 - INFO # 00000050  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,667 - INFO # 00000060  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,673 - INFO # 00000070  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,680 - INFO # 00000080  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,686 - INFO # 00000090  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,692 - INFO # 000000A0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,699 - INFO # 000000B0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,705 - INFO # 000000C0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,711 - INFO # 000000D0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,717 - INFO # 000000E0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,725 - INFO # 000000F0  53  53  53  53  53  53  53  53  E5  00  00  61  5A  53  53  53
2018-12-30 00:20:00,731 - INFO # 00000100  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,737 - INFO # 00000110  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,744 - INFO # 00000120  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,750 - INFO # 00000130  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,756 - INFO # 00000140  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,762 - INFO # 00000150  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,768 - INFO # 00000160  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,774 - INFO # 00000170  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,782 - INFO # 00000180  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,788 - INFO # 00000190  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,794 - INFO # 000001A0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,801 - INFO # 000001B0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,807 - INFO # 000001C0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,813 - INFO # 000001D0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,819 - INFO # 000001E0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,825 - INFO # 000001F0  E5  00  00  61  96  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,831 - INFO # 00000200  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,839 - INFO # 00000210  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,845 - INFO # 00000220  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,851 - INFO # 00000230  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,858 - INFO # 00000240  53  53  53  53  53  53  53  53  00  00  00  00  C0  9F  FB  3F
2018-12-30 00:20:00,864 - INFO # 00000250  14  00  00  00  01  00  00  00  FF  FF  FF  FF  53  53  53  53
2018-12-30 00:20:00,870 - INFO # 00000260  06  06  0A  00  00  00  00  00  30  AE  A4  1B  C0  E9  3C  71
2018-12-30 00:20:00,873 - INFO # 00000270  BF  83  D5  19  53  53  53  53
2018-12-30 00:20:00,879 - INFO # ~ unused: 0x3ffb9fd8 (next: 0x3ffba020, size:   24) ~
2018-12-30 00:20:00,884 - INFO # =========== chunk   8 (0x3ffb9ff0 size:   48) ===========
2018-12-30 00:20:00,890 - INFO # 00000000  00  00  00  00  08  A0  FB  3F  14  00  00  00  01  00  00  00
2018-12-30 00:20:00,897 - INFO # 00000010  FF  FF  FF  FF  53  53  53  53  06  06  0A  00  00  00  00  00
2018-12-30 00:20:00,903 - INFO # 00000020  30  AE  A4  1B  C0  E9  3C  71  BF  83  D5  19  53  53  53  53
2018-12-30 00:20:00,908 - INFO # ~ unused: 0x3ffba020 (next: 0x3ffba290, size:  128) ~
2018-12-30 00:20:00,912 - INFO # =========== chunk   9 (0x3ffba0a0 size:  496) ===========
2018-12-30 00:20:00,918 - INFO # 00000000  C5  00  00  5F  41  60  00  00  00  04  D8  3A  40  FD  19  FF
2018-12-30 00:20:00,924 - INFO # 00000010  FF  00  00  00  00  32  AE  A4  FF  FE  1B  C0  E9  FD  19  FF
2018-12-30 00:20:00,932 - INFO # 00000020  FF  00  00  00  00  3E  71  BF  FF  FE  83  D5  19  80  00  96
2018-12-30 00:20:00,938 - INFO # 00000030  F7  00  53  00  2C  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,944 - INFO # 00000040  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,951 - INFO # 00000050  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,957 - INFO # 00000060  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,963 - INFO # 00000070  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,969 - INFO # 00000080  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,975 - INFO # 00000090  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,981 - INFO # 000000A0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,989 - INFO # 000000B0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:00,995 - INFO # 000000C0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,002 - INFO # 000000D0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,008 - INFO # 000000E0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,014 - INFO # 000000F0  53  53  53  53  53  53  53  53  E5  00  00  5F  1E  53  53  53
2018-12-30 00:20:01,020 - INFO # 00000100  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,026 - INFO # 00000110  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,032 - INFO # 00000120  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,040 - INFO # 00000130  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,046 - INFO # 00000140  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,052 - INFO # 00000150  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,059 - INFO # 00000160  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,065 - INFO # 00000170  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,071 - INFO # 00000180  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,077 - INFO # 00000190  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,083 - INFO # 000001A0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,089 - INFO # 000001B0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,097 - INFO # 000001C0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,103 - INFO # 000001D0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,109 - INFO # 000001E0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,113 - INFO # ~ unused: 0x3ffba290 (next: 0x3ffba4a8, size:   24) ~
2018-12-30 00:20:01,119 - INFO # =========== chunk  10 (0x3ffba2a8 size:  512) ===========
2018-12-30 00:20:01,125 - INFO # 00000000  E5  00  00  5F  3C  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,131 - INFO # 00000010  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,137 - INFO # 00000020  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,143 - INFO # 00000030  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,150 - INFO # 00000040  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,156 - INFO # 00000050  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,163 - INFO # 00000060  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,170 - INFO # 00000070  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,176 - INFO # 00000080  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,182 - INFO # 00000090  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,188 - INFO # 000000A0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,194 - INFO # 000000B0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,200 - INFO # 000000C0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,207 - INFO # 000000D0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,213 - INFO # 000000E0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,219 - INFO # 000000F0  53  53  53  53  53  53  53  53  E5  00  00  62  96  53  53  53
2018-12-30 00:20:01,226 - INFO # 00000100  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,232 - INFO # 00000110  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,238 - INFO # 00000120  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,246 - INFO # 00000130  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,252 - INFO # 00000140  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,258 - INFO # 00000150  E5  00  00  5F  96  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,264 - INFO # 00000160  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,270 - INFO # 00000170  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,276 - INFO # 00000180  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,283 - INFO # 00000190  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,289 - INFO # 000001A0  53  53  53  53  53  53  53  53  E5  00  00  60  96  53  53  53
2018-12-30 00:20:01,296 - INFO # 000001B0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,302 - INFO # 000001C0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,308 - INFO # 000001D0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,314 - INFO # 000001E0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,320 - INFO # 000001F0  53  53  53  53  53  53  53  53  53  53  53  53  53  00  00  00
2018-12-30 00:20:01,326 - INFO # ~ unused: 0x3ffba4a8 (next: 0x3ffba598, size:   64) ~
2018-12-30 00:20:01,331 - INFO # =========== chunk  11 (0x3ffba4e8 size:  176) ===========
2018-12-30 00:20:01,337 - INFO # 00000000  E5  00  00  5C  96  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,343 - INFO # 00000010  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,350 - INFO # 00000020  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,356 - INFO # 00000030  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,362 - INFO # 00000040  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,368 - INFO # 00000050  53  53  53  53  53  53  53  53  01  E5  00  00  5D  96  53  53
2018-12-30 00:20:01,375 - INFO # 00000060  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,382 - INFO # 00000070  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,387 - INFO # 00000080  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,393 - INFO # 00000090  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,399 - INFO # 000000A0  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53  53
2018-12-30 00:20:01,405 - INFO # ~ unused: 0x3ffba598 (next: 0x0, size:   16) ~

miri64 · 2018-12-29T23:34:45Z

(next time as a paste bin / gist please)

From the patterns I'm seeing this looks very similar to what I am getting on native.

miri64 · 2018-12-29T23:35:18Z

(But I have to analyze it further to be sure, but I'm not even done with my analysis of the native results...)

miri64 · 2018-12-29T23:41:40Z

Those are however, that I am pretty sure of mostly received 6Lo fragments, so independent of the error fixed here. Hints why I think so, the snips are in receive order and the first snip points to something that most definitely looks like a 6Lo fragment. I'll post a picture later to illustrate this.

miri64 · 2018-12-29T23:56:26Z

I have something better than an illustration: a fix! 💃 Will prepare a PR.

gschorcht · 2018-12-30T10:44:34Z

pktbuf output

Chunks with ESP-NOW or 6Lo packets below. 6Lo packet with tag 0059 is completely in the buffer. For all other 6Lo packets (tags 005a, 005b, 005c, 005d, 005f, 0060, 0061, 0062`) there only some fragments in the buffer. The question is whether these are fragments which are sent or received.

Chunk 4 contains
- @00000000: ESP-NOW packet 6Lo fragment (tag 0054, fragment 2 / offset 1e)
- @000000f8: 6Lo fragment (tag 0059, fragment 2 / offset 1e)
- @000001f0: 6Lo fragment (tag 0059, fragment 3 / offset 3c)
- @000002e8: 6Lo fragment (tag 0059, fragment 4 / offset 5a)
- @000003e0: 6Lo fragment (tag 0059, fragment 5 / offset 78)
- @000004d0: 6Lo fragment (tag 0059, fragment 6 / offset 96)
- @00000530: something else
Chunk 5 contains
- @00000000: 6Lo fragment (tag 0059, fragment 1)
- @000000f8: 6Lo fragment (tag 005a, fragment 1)
- @000001f0: 6Lo fragment (tag 005b, fragment 1)
- @000002e8: something else
Chunk 6 contains
- @00000000: 6Lo fragment (tag 005b, fragment 2, offset 1e)
- @000000f8: something else
- @00000218: 6Lo fragment (tag 0061, fragment 3 / offset 3c)
- @00000310: something else
Chunk 7 contains
- @00000000: 6Lo fragment (tag 0061, fragment 2 / offset 1e)
- @000000f8: 6Lo fragment (tag 0061, fragment 4 / offset 5a)
- @000001f0: 6Lo fragment (tag 0061, fragment 6 / offset 96)
- @00000248: something else
Chunk 9 contains
- @00000000: 6Lo fragment (tag 005f, fragment 1)
- @000000f8: 6Lo fragment (tag 005f, fragment 2 / offset 1e)
Chunk 10 contains
- @00000000: 6Lo fragment (tag 005f, fragment 3 / offset 3c)
- @000000f8: 6Lo fragment (tag 0062, fragment 6 / offset 96)
- @00000150: 6Lo fragment (tag 005f, fragment 6 / offset 96)
- @000001a8: 6Lo fragment (tag 0060, fragment 6 / offset 96)
Chunk 11 contains
- @00000000: 6Lo fragment (tag 005c, fragment 6 / offset 96)
- @000000f8: 6Lo fragment (tag 005d, fragment 6 / offset 96)

gschorcht · 2018-12-30T11:00:30Z

sys/net/gnrc/network_layer/sixlowpan/frag/gnrc_sixlowpan_frag.c

-            gnrc_pktbuf_release(fragment_msg->pkt);
-            fragment_msg->pkt = NULL;
-            return;
+            goto error;


When I learned programming C over 30 years ago, it was an absolute nogo to use goto statements. Our lecturer said, goto breaks the execution structure and if you need the goto statement, there is something wrong with your structure. He said also goto is very bad and something like BASIC. It must not be used.

Has this theory changed?

Even it seems sometimes easier to have a goto, especially for exits on error, I never used it all the years. I know, your intention is to avoid code duplication.

I can remove them. I believe not using goto is a little bit evangelical, since especially in this one case (handle error case and exit) it is very useful and does not really breaks the execution structure. There are far greater since that can be done with goto where I agree it should not be used ;-).

It is ok to me to leave the goto statement here. I think it is very comfortable to have a single exit point to avoid code duplication. The alternative would be to have very deep if () ... else if ... structures which doesn't improve the readability of source code.

Removed the gotos.

Ups. Sorry, it should be just a question no change request.

Sorry if it sounded like a change request.

Welp, now I do the same, just without goto ;-)

miri64 · 2018-12-30T11:30:14Z

pktbuf output

Chunks with ESP-NOW or 6Lo packets below. 6Lo packet with tag 0059 is completely in the buffer. For all other 6Lo packets (tags 005a, 005b, 005c, 005d, 005f, 0060, 0061, 0062`) there only some fragments in the buffer. The question is whether these are fragments which are sent or received.

Chunk 4 contains

@00000000: ESP-NOW packet 6Lo fragment (tag 0054, fragment 2 / offset 1e)

@000000f8: 6Lo fragment (tag 0059, fragment 2 / offset 1e)

@000001f0: 6Lo fragment (tag 0059, fragment 3 / offset 3c)

@000002e8: 6Lo fragment (tag 0059, fragment 4 / offset 5a)

@000003e0: 6Lo fragment (tag 0059, fragment 5 / offset 78)

@000004d0: 6Lo fragment (tag 0059, fragment 6 / offset 96)

@00000530: something else

Chunk 5 contains

@00000000: 6Lo fragment (tag 0059, fragment 1)

@000000f8: 6Lo fragment (tag 005a, fragment 1)

@000001f0: 6Lo fragment (tag 005b, fragment 1)

@000002e8: something else

Chunk 6 contains

@00000000: 6Lo fragment (tag 005b, fragment 2, offset 1e)

@000000f8: something else

@00000218: 6Lo fragment (tag 0061, fragment 3 / offset 3c)

@00000310: something else

Chunk 7 contains

@00000000: 6Lo fragment (tag 0061, fragment 2 / offset 1e)

@000000f8: 6Lo fragment (tag 0061, fragment 4 / offset 5a)

@000001f0: 6Lo fragment (tag 0061, fragment 6 / offset 96)

@00000248: something else

Chunk 9 contains

@00000000: 6Lo fragment (tag 005f, fragment 1)

@000000f8: 6Lo fragment (tag 005f, fragment 2 / offset 1e)

Chunk 10 contains

@00000000: 6Lo fragment (tag 005f, fragment 3 / offset 3c)

@000000f8: 6Lo fragment (tag 0062, fragment 6 / offset 96)

@00000150: 6Lo fragment (tag 005f, fragment 6 / offset 96)

@000001a8: 6Lo fragment (tag 0060, fragment 6 / offset 96)

Chunk 11 contains

@00000000: 6Lo fragment (tag 005c, fragment 6 / offset 96)

@000000f8: 6Lo fragment (tag 005d, fragment 6 / offset 96)

They are in receive order so they are received. E.g. this part (@00000000 of chunk 0) is a packet snip descriptor of a 6Lo fragment

2018-12-30 00:19:59,011 - INFO # 00000000  38  8E  FB  3F  C0  90  FB  3F  F5  00  00  00  01  00  00  00
2018-12-30 00:19:59,017 - INFO # 00000010  01  00  00  00

and it points to a netif_hdr struct starting @00000090 of chunk 0:

2018-12-30 00:19:59,067 - INFO # 00000090  00  00  00  00  70  8E  FB  3F  14  00  00  00  01  00  00  00
2018-12-30 00:19:59,073 - INFO # 000000A0  FF  FF  FF  FF

I fixed that bug (and also provided a graphical analysis of my dump) in #10680.

gschorcht · 2018-12-30T11:38:45Z

Yes, I saw it already and I'm still testing it together with #10680, I will report the results there.

miri64 added 2 commits December 29, 2018 22:54

gnrc_sixlowpan_frag: reduce code duplication in send

d5bbf45

miri64 added Type: bug The issue reports a bug / The PR fixes a bug (including spelling errors) Area: network Area: Networking labels Dec 29, 2018

miri64 requested a review from PeterKietzmann December 29, 2018 22:00

miri64 mentioned this pull request Dec 29, 2018

gnrc: runs full on very heavy load #10672

Closed

miri64 added the CI: ready for build If set, CI server will compile all applications for all available boards for the labeled PR label Dec 29, 2018

miri64 mentioned this pull request Dec 30, 2018

gnrc_sixlowpan_frag: release packet rbuf_add error cases #10680

Merged

gschorcht reviewed Dec 30, 2018

View reviewed changes

miri64 mentioned this pull request Dec 30, 2018

gnrc_sixlowpan_frag: unroll recursion #10681

Merged

gschorcht approved these changes Dec 30, 2018

View reviewed changes

gschorcht merged commit d3f78a5 into RIOT-OS:master Dec 30, 2018

miri64 deleted the gnrc_sixlowpan_frag/fix/send-check-msg-queue branch December 30, 2018 15:02

This was referenced Jan 3, 2019

cpu/esp: esp_now_netdev fixes and optimizations #10700

Merged

gnrc: packet space in gnrc packet buffer is not released on very heavy load #10701

Closed

aabadie added this to the Release 2019.01 milestone Jan 4, 2019

miri64 mentioned this pull request Mar 7, 2019

gnrc_sixlowpan_frag: replace printf with DEBUG #11135

Merged

Conversation

miri64 commented Dec 29, 2018

Contribution description

Testing procedure

Issues/PRs references

Uh oh!

miri64 commented Dec 29, 2018

Uh oh!

miri64 commented Dec 29, 2018

Uh oh!

TimoRoth commented Dec 29, 2018 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

miri64 commented Dec 29, 2018

Uh oh!

TimoRoth commented Dec 29, 2018 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

miri64 commented Dec 29, 2018

Uh oh!

miri64 commented Dec 29, 2018

Uh oh!

miri64 commented Dec 29, 2018

Uh oh!

miri64 commented Dec 29, 2018

Uh oh!

gschorcht commented Dec 30, 2018

Uh oh!

gschorcht Dec 30, 2018 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

miri64 Dec 30, 2018

Choose a reason for hiding this comment

Uh oh!

gschorcht Dec 30, 2018

Choose a reason for hiding this comment

Uh oh!

miri64 Dec 30, 2018

Choose a reason for hiding this comment

Uh oh!

gschorcht Dec 30, 2018

Choose a reason for hiding this comment

Uh oh!

gschorcht Dec 30, 2018

Choose a reason for hiding this comment

Uh oh!

miri64 Dec 30, 2018

Choose a reason for hiding this comment

Uh oh!

miri64 commented Dec 30, 2018

Uh oh!

gschorcht commented Dec 30, 2018

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

TimoRoth commented Dec 29, 2018 •

edited

Loading

TimoRoth commented Dec 29, 2018 •

edited

Loading

gschorcht Dec 30, 2018 •

edited

Loading