Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

gnrc_netif_pktq leaks memory #17924

Open
benpicco opened this issue Apr 12, 2022 · 25 comments · Fixed by #18153
Open

gnrc_netif_pktq leaks memory #17924

benpicco opened this issue Apr 12, 2022 · 25 comments · Fixed by #18153
Assignees
Labels
Area: network Area: Networking Type: bug The issue reports a bug / The PR fixes a bug (including spelling errors)

Comments

@benpicco
Copy link
Contributor

benpicco commented Apr 12, 2022

Description

Steps to reproduce the issue

Use gnrc_netif_pktq on a board with two interfaces (e.g. nrf802154 & slipdev) e.g. by running

make -C examples/gnrc_border_router BOARD=nrf52840dk UPLINK=slip -j flash term

Expected results

The node can send and receive packets.

Actual results

After a few minutes the node can no longer send any packets

2022-04-13 00:57:06,058 # > ping ff02::1
2022-04-13 00:57:06,060 # error: packet buffer full
2022-04-13 00:57:07,060 # error: packet buffer full
2022-04-13 00:57:08,060 # error: packet buffer full
2022-04-13 00:57:09,058 # 
2022-04-13 00:57:09,061 # --- ff02::1 PING statistics ---
2022-04-13 00:57:09,066 # 3 packets transmitted, 0 packets received, 100% packet loss

The node never recovers until it is rebooted.

Versions

RIOT master

@benpicco benpicco changed the title leaks memory gnrc_pktqueue leaks memory Apr 12, 2022
@benpicco benpicco added Type: bug The issue reports a bug / The PR fixes a bug (including spelling errors) Area: network Area: Networking labels Apr 12, 2022
@jia200x
Copy link
Member

jia200x commented Apr 21, 2022

I have seen these issues in the past with the gnrc_netif/submac integration.. With the last commits that should have been fixed.
Does this also occur if you don't use slipdev? If not, it could point to some leftovers on that direction...

@miri64
Copy link
Member

miri64 commented Apr 21, 2022

Which "last commits" are you referring to?

@benpicco
Copy link
Contributor Author

It also happens with DOSE, but I think a second interface was required to trigger this (will try to reproduce this with a single one)

@jia200x
Copy link
Member

jia200x commented Apr 21, 2022

Which "last commits" are you referring to?

z.B #16964

@jia200x
Copy link
Member

jia200x commented Apr 21, 2022

make -C examples/gnrc_border_router BOARD=nrf52840dk UPLINK=slip -j flash term

I think this could be an effect of having two interfaces running with the same priority. Considering that slip is order of magnitude slower than ieee802154, there are high chances the IEEE 802.15.4 are not met. This is probably triggering a corner case we haven't seen under normal operation...
I think the problem is either in netdev_ieee802154_submac (not to confuse with ieee802154_submac) or in the gnrc_netif pktqueue integration.
Last but not least, I've seen "lost" events as a result of #16899. This could also be the source

@miri64
Copy link
Member

miri64 commented Apr 21, 2022

make -C examples/gnrc_border_router BOARD=nrf52840dk UPLINK=slip -j flash term

Mh, I don't have that board and trying to reproduce with samr21-xpro yields the expected results. Trying on a similar particle-xenon I face the problem, that it uses cdc_acm_stdio. That reminded me: slipdev is only working with UART and IIRC the nrf52840dk used segger-rtt for the stdio (or is was changed?) If you give me a more detailed setup, maybe I manage to reproduce with the Xenon as well.

@miri64
Copy link
Member

miri64 commented Apr 21, 2022

I think this could be an effect of having two interfaces running with the same priority.

@benpicco could you try if running the interfaces at different PIDs priorities solves the problem?

@benpicco
Copy link
Contributor Author

Mh, I don't have that board and trying to reproduce with samr21-xpro yields the expected results.

at86rf2xx does not use gnrc_pktqueue

Trying on a similar particle-xenon I face the problem, that it uses cdc_acm_stdio.

Can you use it together with usbus_cdc_ecm?

IIRC the nrf52840dk used segger-rtt for the stdio

Why would it, the debugger exposes a /dev/ttyACM0 that is connected to the UART pins of the board.

@miri64
Copy link
Member

miri64 commented Apr 21, 2022

IIRC the nrf52840dk used segger-rtt for the stdio

Why would it, the debugger exposes a /dev/ttyACM0 that is connected to the UART pins of the board.

Then IARW (I apparently remembered wrong) ;-)

@miri64
Copy link
Member

miri64 commented Apr 21, 2022

Can you use it together with usbus_cdc_ecm?

I don't get an immediate error: packet buffer full, but I can see when using the gnrc_pktbuf_cmd module, that there is a leak in the packet buffer.

@benpicco
Copy link
Contributor Author

It's not immediate, it takes several minutes, I don't have found a quick way yet to trigger the condition.

@miri64
Copy link
Member

miri64 commented Apr 21, 2022

Can you confirm, that after the first execution of ping there is garbage in the packet buffer? This is what I see

pktbuf
2022-04-21 16:07:36,384 # pktbuf
2022-04-21 16:07:36,387 # packet buffer: first byte: 0x200038b4, last byte: 0x200050b4 (size: 6144)
2022-04-21 16:07:36,388 #   position of last byte used: 1016
2022-04-21 16:07:36,388 # =========== chunk   0 (0x200038b4 size:  120) ===========
2022-04-21 16:07:36,389 # 00000000  14  39  00  20  B4  39  00  20  51  00  00  00  01  00  00  00
2022-04-21 16:07:36,390 # 00000010  00  00  00  00  00  00  00  00  00  00  00  00  E4  38  00  20
2022-04-21 16:07:36,391 # 00000020  14  00  00  00  01  00  00  00  FF  52  00  59  11  40  FE  80
2022-04-21 16:07:36,391 # 00000030  06  06  06  00  00  00  00  80  EE  5D  DA  A4  A4  E9  EE  5D
2022-04-21 16:07:36,392 # 00000040  DA  A4  A4  EB  00  00  EC  5D  CC  38  00  20  84  39  00  20
2022-04-21 16:07:36,393 # 00000050  28  00  00  00  01  00  00  00  02  61  00  01  00  0A  00  03
2022-04-21 16:07:36,394 # 00000060  FC  38  00  20  AC  39  00  20  08  00  00  00  01  00  00  00
2022-04-21 16:07:36,394 # 00000070  04  A4  3E  C4  8C  16  45  6E
2022-04-21 16:07:36,395 # ~ unused: 0x2000392c (next: 0x20003a0c, size:   88) ~
2022-04-21 16:07:36,395 # =========== chunk   1 (0x20003984 size:  136) ===========
2022-04-21 16:07:36,396 # 00000000  60  0E  91  52  00  59  11  40  FE  80  00  00  00  00  00  00
2022-04-21 16:07:36,397 # 00000010  72  CD  6F  2F  0C  4C  35  40  FE  80  00  00  00  00  00  00
2022-04-21 16:07:36,398 # 00000020  EC  5D  DA  FF  FE  A4  A4  EB  02  23  02  22  00  59  D6  C0
2022-04-21 16:07:36,399 # 00000030  07  DC  EE  61  00  01  00  0A  00  03  00  01  EE  5D  DA  A4
2022-04-21 16:07:36,399 # 00000040  A4  EB  00  02  00  0E  00  01  00  01  27  A4  3E  C4  8C  16
2022-04-21 16:07:36,400 # 00000050  45  6E  7A  1E  00  19  00  29  00  19  00  07  00  00  27  10
2022-04-21 16:07:36,401 # 00000060  00  00  4E  20  00  1A  00  19  00  00  75  30  00  00  9C  40
2022-04-21 16:07:36,401 # 00000070  40  20  01  0D  B8  00  00  00  02  00  00  00  00  00  00  00
2022-04-21 16:07:36,402 # 00000080  00  00  00  00  B0  16  00  00
2022-04-21 16:07:36,402 # ~ unused: 0x20003a0c (next: (nil), size: 5800) ~

From just a quick scan, I think that's at least one response from the host: the start of chunk1 looks like an IPv6 header with two link local unicast addresses. Since I pinged multicast, it can't be the echo request, and the source and destination addresses confirm that this comes from the host. If this is indeed the case for you as well, I don't believe, its gnrc_pktqueue (since the NIB also uses gnrc_pktqueue that could have been a hint as well, as we do not have any known issues there in that regard, but maybe the gnrc_netif_pktq user, however....), as the packet queue should handle outgoing packets...

@benpicco benpicco changed the title gnrc_pktqueue leaks memory gnrc_netif_pktq leaks memory Apr 21, 2022
@benpicco
Copy link
Contributor Author

I'm afraid this might not be related to gnrc_netif_pktq but to pktbuf in general with concurrent allocation and freeing:

I have a board with a SLIP and an atwinc15x0 interface. Data is received on the SLIP interface and stored on SD card, when a WiFi network is available data is read from the SD card and send over the WiFi interface.

There is no gnrc_netif_pktq involved here, but after a few minutes of both interfaces sending and receiving data at the same time, no more pktsnips can be allocated and data ingress stops because of that.

My suspicion is with a fragmentation issue, as small snips can still be allocated (the data that is received / sent makes use of large (~1k) frames).

@miri64
Copy link
Member

miri64 commented May 23, 2022

My suspicion is with a fragmentation issue, as small snips can still be allocated (the data that is received / sent makes use of large (~1k) frames).

Is it possible to provide a dump of gnrc_pktbuf_cmd when the error condition occurs?

@benpicco
Copy link
Contributor Author

benpicco commented May 28, 2022

I now have a quite reliable way to trigger the condition, requires sending on one interface while also receiving data on a another interface. pktbuf remains full after I stop the sending board .

I've added #18102 for dual-entry bookkeeping, result is pktbuf stats.txt, pktbuf leases.txt

I'm not quite sure what to make out of that though.

@benpicco
Copy link
Contributor Author

benpicco commented May 28, 2022

I've added some more tracing to also log the place where the pktbuf allocation was made pktbuf.log:

  • 10b63: sys/net/gnrc/netif/ethernet/gnrc_netif_ethernet.c:182
  • 10ba3: sys/net/gnrc/netif/ethernet/gnrc_netif_ethernet.c:217 (discriminator 8)
  • 10bcf: sys/net/gnrc/netif/ethernet/gnrc_netif_ethernet.c:240
  • 13473: sys/net/gnrc/transport_layer/udp/gnrc_udp.c:124
  • d78d: sys/net/gnrc/network_layer/ipv6/gnrc_ipv6.c:781

(I switched from atwinc15x0 to sam0_eth for the uplink to rule out an issue with the WiFi driver)

@benpicco
Copy link
Contributor Author

Ok, this turns out to be an unrelated issue. The sending thread did not call sock_udp_recv() even though it was getting replies to the local port, filling up the mbox.

This can be solved by calling

while (sock_udp_recv(&sock, buf, sizeof(buf), 0, NULL) > 0) {}

after every sock_udp_send().
Since gnrc_sock is the only user of mbox, this is not related to the leak in gnrc_netif_pktq.

@fjmolinas
Copy link
Contributor

Ok, this turns out to be an unrelated issue. The sending thread did not call sock_udp_recv() even though it was getting replies to the local port, filling up the mbox.

This can be solved by calling

while (sock_udp_recv(&sock, buf, sizeof(buf), 0, NULL) > 0) {}

after every sock_udp_send(). Since gnrc_sock is the only user of mbox, this is not related to the leak in gnrc_netif_pktq.

So the test application is no longer relevant?

@benpicco
Copy link
Contributor Author

benpicco commented May 31, 2022

Yes the (unrelated to this issue) issue triggered is now resolved by #18143 and #18147 - but gnrc_netif_pktq is still leaky.

@fabian18
Copy link
Contributor

In case of slip it has to do with this packet hold:

    /* hold in case device was busy to not having to rewrite *all* the link
     * layer implementations in case `gnrc_netif_pktq` is included */
    gnrc_pktbuf_hold(pkt, 1);

It holds the full packet (gnrc netif header + icmp + ipv6 header + ...)

Then we pass the packet to the netif send operation

int res = netif->ops->send(netif, pkt);

which in case of slipdev is raw_ops::send(), where we remove the gnrc netif header

    if (pkt->type == GNRC_NETTYPE_NETIF) {
        /* we don't need the netif snip: remove it */
        pkt = gnrc_pktbuf_remove_snip(pkt, pkt);
    }

In gnrc_pktbuf_remove_snip we free the gnrc_netif header and also set its next pointer to NULL.

gnrc_pktsnip_t *gnrc_pktbuf_remove_snip(gnrc_pktsnip_t *pkt,
                                        gnrc_pktsnip_t *snip)
{
    pkt = gnrc_pkt_delete(pkt, snip);
    snip->next = NULL;
    gnrc_pktbuf_release(snip);

    return pkt;
}

The netif driver deletes the remaining packet snips after the netif header, after sending

    res = dev->driver->send(dev, (iolist_t *)pkt);
    if (gnrc_netif_netdev_legacy_api(netif)) {
        /* only for legacy drivers we need to release pkt here */
        gnrc_pktbuf_release(pkt);
    }

Back in gnrc_netif.c::_send() we go into _tx_done()
and try to delete the previously held packet

    if (gnrc_netif_netdev_new_api(netif)) {
        /* with new netdev (with confirm_send), the netif remains owner of the
         * pkt and is in charge of releasing it once TX is completed */
        gnrc_pktbuf_release_error(pkt, err);
    }

But here pkt is the gnrc_netif header where we set the next pointer to NULL.
So the held packets after the gnrc netif header are not deleted. Their reference counter has just been decreased once by the netif driver.

@fabian18
Copy link
Contributor

We could maybe prohibit to remove a packet snip which is not the first snip in the chain.

@benpicco
Copy link
Contributor Author

Hm but gnrc_netif_netdev_legacy_api() and gnrc_netif_netdev_new_api() can't both be true for the same interface.
AFAIK slipdev does not implement the confirm send API yet, so the condition in the last paragraph should not occur.

@fabian18
Copy link
Contributor

Sorry, then it was in the else above

@benpicco
Copy link
Contributor Author

This still happens with the border router app.
Only traffic are some pings between a 6lo node (fd35:ea7:b70b:2200:ac8d:fee1:60ed:99c4) and the linux host (fdea:dbee:f::1)

The packet buffer keeps filling up and after a short while the border router is no longer able to send any packets.

> ping ff02::1
error: packet buffer full
error: packet buffer full
error: packet buffer full

--- ff02::1 PING statistics ---
3 packets transmitted, 0 packets received, 100% packet loss
gnrc_pktbuf_stats()
packet buffer: first byte: 0x20008fe8, last byte: 0x2000a7e8 (size: 6144)
  position of last byte used: 6144
=========== chunk   0 (0x20008fe8 size: 6128) ===========
00000000  00  00  00  00  00  90  00  20  18  00  00  00  02  00  00  00
00000010  03  00  00  00  00  00  00  00  87  00  E4  09  00  00  00  00
00000020  FE  80  00  00  00  00  00  00  A4  3F  C6  D7  92  A0  CC  E2
00000030  E8  8F  00  20  30  90  00  20  28  00  00  00  02  00  00  00
00000040  02  00  00  00  00  00  00  00  60  00  00  00  00  18  3A  FF
00000050  00  00  00  00  00  00  00  00  00  00  00  00  00  00  00  00
00000060  FF  02  00  00  00  00  00  00  00  00  00  01  FF  A0  CC  E2
00000070  00  00  00  00  70  90  00  20  06  00  00  00  02  00  00  00
00000080  00  00  00  00  00  00  00  00  55  48  43  50  00  40  00  00
00000090  58  90  00  20  90  90  00  20  08  00  00  00  02  00  00  00
000000A0  04  00  00  00  00  00  00  00  30  39  30  39  00  0E  5D  21
000000B0  78  90  00  20  B0  90  00  20  28  00  00  00  02  00  00  00
000000C0  02  00  00  00  00  00  00  00  60  00  00  00  00  0E  11  40
000000D0  FE  80  00  00  00  00  00  00  00  00  00  00  00  00  00  02
000000E0  FF  15  00  00  00  00  00  00  00  00  00  00  00  00  AB  CD
000000F0  00  00  00  00  F0  90  00  20  10  00  00  00  02  00  00  00
00000100  00  00  00  00  00  00  00  00  01  02  A6  3F  C6  D7  92  A0
00000110  CC  E2  00  00  00  00  00  00  D8  90  00  20  18  91  00  20
00000120  08  00  00  00  02  00  00  00  03  00  00  00  00  00  00  00
00000130  85  00  AF  88  00  00  00  00  00  91  00  20  38  91  00  20
00000140  28  00  00  00  02  00  00  00  02  00  00  00  00  00  00  00
00000150  60  00  00  00  00  18  3A  FF  FE  80  00  00  00  00  00  00
00000160  00  00  00  00  00  00  00  02  FF  02  00  00  00  00  00  00
00000170  00  00  00  00  00  00  00  02  00  00  00  00  78  91  00  20
00000180  10  00  00  00  02  00  00  00  00  00  00  00  00  00  00  00
00000190  01  02  A6  3F  C6  D7  92  A0  CC  E2  00  00  00  00  00  00
000001A0  60  91  00  20  A0  91  00  20  08  00  00  00  02  00  00  00
000001B0  03  00  00  00  00  00  00  00  85  00  E4  EF  00  00  00  00
000001C0  88  91  00  20  C0  91  00  20  28  00  00  00  02  00  00  00
000001D0  02  00  00  00  00  00  00  00  60  00  00  00  00  18  3A  FF
000001E0  FE  80  00  00  00  00  00  00  A4  3F  C6  D7  92  A0  CC  E2
000001F0  FF  02  00  00  00  00  00  00  00  00  00  00  00  00  00  02
00000200  00  00  00  00  00  92  00  20  10  00  00  00  02  00  00  00
00000210  00  00  00  00  00  00  00  00  01  02  A6  3F  C6  D7  92  A0
00000220  CC  E2  00  00  00  00  00  00  E8  91  00  20  28  92  00  20
00000230  08  00  00  00  02  00  00  00  03  00  00  00  00  00  00  00
00000240  85  00  E4  EF  00  00  00  00  10  92  00  20  48  92  00  20
00000250  28  00  00  00  02  00  00  00  02  00  00  00  00  00  00  00
00000260  60  00  00  00  00  18  3A  FF  FE  80  00  00  00  00  00  00
00000270  A4  3F  C6  D7  92  A0  CC  E2  FF  02  00  00  00  00  00  00
00000280  00  00  00  00  00  00  00  02  00  00  00  00  88  92  00  20
00000290  06  00  00  00  02  00  00  00  00  00  00  00  00  00  00  00
000002A0  55  48  43  50  00  40  00  00  70  92  00  20  A8  92  00  20
000002B0  08  00  00  00  02  00  00  00  04  02  00  00  00  00  00  00
000002C0  30  39  30  39  00  0E  92  88  90  92  00  20  C8  92  00  20
000002D0  28  00  00  00  02  00  00  00  02  00  00  00  FF  15  00  00
000002E0  60  00  00  00  00  0E  11  40  FE  80  00  00  00  00  00  00
000002F0  A4  3F  C6  D7  92  A0  CC  E2  FF  15  00  00  00  00  00  00
00000300  00  00  00  00  00  00  AB  CD  00  00  00  00  08  93  00  20
00000310  06  00  00  00  02  00  00  00  00  93  00  20  18  00  00  00
00000320  55  48  43  50  00  40  00  00  F0  92  00  20  28  93  00  20
00000330  08  00  00  00  02  00  00  00  04  02  00  00  00  00  00  00
00000340  30  39  30  39  00  0E  92  88  10  93  00  20  48  93  00  20
00000350  28  00  00  00  02  00  00  00  02  00  00  00  00  00  00  00
00000360  60  00  00  00  00  0E  11  40  FE  80  00  00  00  00  00  00
00000370  A4  3F  C6  D7  92  A0  CC  E2  FF  15  00  00  00  00  00  00
00000380  00  00  00  00  00  00  AB  CD  00  00  00  00  88  93  00  20
00000390  06  00  00  00  02  00  00  00  00  00  00  00  68  14  00  00
000003A0  55  48  43  50  00  40  00  00  70  93  00  20  A8  93  00  20
000003B0  08  00  00  00  02  00  00  00  04  02  00  00  00  00  00  00
000003C0  30  39  30  39  00  0E  92  88  90  93  00  20  C8  93  00  20
000003D0  28  00  00  00  02  00  00  00  02  00  00  00  00  00  00  00
000003E0  60  00  00  00  00  0E  11  40  FE  80  00  00  00  00  00  00
000003F0  A4  3F  C6  D7  92  A0  CC  E2  FF  15  00  00  00  00  00  00
00000400  00  00  00  00  00  00  AB  CD  40  98  00  20  08  94  00  20
00000410  10  00  00  00  01  00  00  00  FF  00  00  00  E8  13  00  00
00000420  00  08  05  00  00  00  00  80  AE  8D  FE  E1  60  ED  99  C4
00000430  41  98  00  20  08  00  00  00  00  00  00  00  38  94  00  20
00000440  08  04  00  00  01  00  00  00  03  02  00  00  00  00  00  00
00000450  81  00  57  14  3C  56  00  00  3F  85  28  0E  00  01  02  03
00000460  04  05  06  07  08  09  0A  0B  0C  0D  0E  0F  10  11  12  13
00000470  14  15  16  17  18  19  1A  1B  1C  1D  1E  1F  20  21  22  23
00000480  24  25  26  27  28  29  2A  2B  2C  2D  2E  2F  30  31  32  33
00000490  34  35  36  37  38  39  3A  3B  3C  3D  3E  3F  40  41  42  43
000004A0  44  45  46  47  48  49  4A  4B  4C  4D  4E  4F  50  51  52  53
000004B0  54  55  56  57  58  59  5A  5B  5C  5D  5E  5F  60  61  62  63
000004C0  64  65  66  67  68  69  6A  6B  6C  6D  6E  6F  70  71  72  73
000004D0  74  75  76  77  78  79  7A  7B  7C  7D  7E  7F  80  81  82  83
000004E0  84  85  86  87  88  89  8A  8B  8C  8D  8E  8F  90  91  92  93
000004F0  94  95  96  97  98  99  9A  9B  9C  9D  9E  9F  A0  A1  A2  A3
00000500  A4  A5  A6  A7  A8  A9  AA  AB  AC  AD  AE  AF  B0  B1  B2  B3
00000510  B4  B5  B6  B7  B8  B9  BA  BB  BC  BD  BE  BF  C0  C1  C2  C3
00000520  C4  C5  C6  C7  C8  C9  CA  CB  CC  CD  CE  CF  D0  D1  D2  D3
00000530  D4  D5  D6  D7  D8  D9  DA  DB  DC  DD  DE  DF  E0  E1  E2  E3
00000540  E4  E5  E6  E7  E8  E9  EA  EB  EC  ED  EE  EF  F0  F1  F2  F3
00000550  F4  F5  F6  F7  F8  F9  FA  FB  FC  FD  FE  FF  00  01  02  03
00000560  04  05  06  07  08  09  0A  0B  0C  0D  0E  0F  10  11  12  13
00000570  14  15  16  17  18  19  1A  1B  1C  1D  1E  1F  20  21  22  23
00000580  24  25  26  27  28  29  2A  2B  2C  2D  2E  2F  30  31  32  33
00000590  34  35  36  37  38  39  3A  3B  3C  3D  3E  3F  40  41  42  43
000005A0  44  45  46  47  48  49  4A  4B  4C  4D  4E  4F  50  51  52  53
000005B0  54  55  56  57  58  59  5A  5B  5C  5D  5E  5F  60  61  62  63
000005C0  64  65  66  67  68  69  6A  6B  6C  6D  6E  6F  70  71  72  73
000005D0  74  75  76  77  78  79  7A  7B  7C  7D  7E  7F  80  81  82  83
000005E0  84  85  86  87  88  89  8A  8B  8C  8D  8E  8F  90  91  92  93
000005F0  94  95  96  97  98  99  9A  9B  9C  9D  9E  9F  A0  A1  A2  A3
00000600  A4  A5  A6  A7  A8  A9  AA  AB  AC  AD  AE  AF  B0  B1  B2  B3
00000610  B4  B5  B6  B7  B8  B9  BA  BB  BC  BD  BE  BF  C0  C1  C2  C3
00000620  C4  C5  C6  C7  C8  C9  CA  CB  CC  CD  CE  CF  D0  D1  D2  D3
00000630  D4  D5  D6  D7  D8  D9  DA  DB  DC  DD  DE  DF  E0  E1  E2  E3
00000640  E4  E5  E6  E7  E8  E9  EA  EB  EC  ED  EE  EF  F0  F1  F2  F3
00000650  F4  F5  F6  F7  F8  F9  FA  FB  FC  FD  FE  FF  00  01  02  03
00000660  04  05  06  07  08  09  0A  0B  0C  0D  0E  0F  10  11  12  13
00000670  14  15  16  17  18  19  1A  1B  1C  1D  1E  1F  20  21  22  23
00000680  24  25  26  27  28  29  2A  2B  2C  2D  2E  2F  30  31  32  33
00000690  34  35  36  37  38  39  3A  3B  3C  3D  3E  3F  40  41  42  43
000006A0  44  45  46  47  48  49  4A  4B  4C  4D  4E  4F  50  51  52  53
000006B0  54  55  56  57  58  59  5A  5B  5C  5D  5E  5F  60  61  62  63
000006C0  64  65  66  67  68  69  6A  6B  6C  6D  6E  6F  70  71  72  73
000006D0  74  75  76  77  78  79  7A  7B  7C  7D  7E  7F  80  81  82  83
000006E0  84  85  86  87  88  89  8A  8B  8C  8D  8E  8F  90  91  92  93
000006F0  94  95  96  97  98  99  9A  9B  9C  9D  9E  9F  A0  A1  A2  A3
00000700  A4  A5  A6  A7  A8  A9  AA  AB  AC  AD  AE  AF  B0  B1  B2  B3
00000710  B4  B5  B6  B7  B8  B9  BA  BB  BC  BD  BE  BF  C0  C1  C2  C3
00000720  C4  C5  C6  C7  C8  C9  CA  CB  CC  CD  CE  CF  D0  D1  D2  D3
00000730  D4  D5  D6  D7  D8  D9  DA  DB  DC  DD  DE  DF  E0  E1  E2  E3
00000740  E4  E5  E6  E7  E8  E9  EA  EB  EC  ED  EE  EF  F0  F1  F2  F3
00000750  F4  F5  F6  F7  F8  F9  FA  FB  FC  FD  FE  FF  00  01  02  03
00000760  04  05  06  07  08  09  0A  0B  0C  0D  0E  0F  10  11  12  13
00000770  14  15  16  17  18  19  1A  1B  1C  1D  1E  1F  20  21  22  23
00000780  24  25  26  27  28  29  2A  2B  2C  2D  2E  2F  30  31  32  33
00000790  34  35  36  37  38  39  3A  3B  3C  3D  3E  3F  40  41  42  43
000007A0  44  45  46  47  48  49  4A  4B  4C  4D  4E  4F  50  51  52  53
000007B0  54  55  56  57  58  59  5A  5B  5C  5D  5E  5F  60  61  62  63
000007C0  64  65  66  67  68  69  6A  6B  6C  6D  6E  6F  70  71  72  73
000007D0  74  75  76  77  78  79  7A  7B  7C  7D  7E  7F  80  81  82  83
000007E0  84  85  86  87  88  89  8A  8B  8C  8D  8E  8F  90  91  92  93
000007F0  94  95  96  97  98  99  9A  9B  9C  9D  9E  9F  A0  A1  A2  A3
00000800  A4  A5  A6  A7  A8  A9  AA  AB  AC  AD  AE  AF  B0  B1  B2  B3
00000810  B4  B5  B6  B7  B8  B9  BA  BB  BC  BD  BE  BF  C0  C1  C2  C3
00000820  C4  C5  C6  C7  C8  C9  CA  CB  CC  CD  CE  CF  D0  D1  D2  D3
00000830  D4  D5  D6  D7  D8  D9  DA  DB  DC  DD  DE  DF  E0  E1  E2  E3
00000840  E4  E5  E6  E7  E8  E9  EA  EB  EC  ED  EE  EF  F0  F1  F2  F3
00000850  F4  F5  F6  F7  F8  F9  FA  FB  20  94  00  20  B8  98  00  20
00000860  03  00  00  00  01  00  00  00  01  00  00  00  00  00  00  00
00000870  80  98  00  20  70  98  00  20  10  00  00  00  01  00  00  00
00000880  FF  8D  FE  E1  60  ED  99  C4  00  08  05  00  00  00  00  80
00000890  AE  8D  FE  E1  60  ED  99  C4  10  A1  00  20  18  94  00  20
000008A0  01  00  00  00  01  00  00  00  01  8D  FE  E1  60  ED  99  C4
000008B0  00  00  00  00  B0  98  00  20  06  00  00  00  02  00  00  00
000008C0  00  00  00  00  00  00  00  00  55  48  43  50  00  40  00  00
000008D0  7A  33  3A  00  30  0F  00  00  98  98  00  20  D8  98  00  20
000008E0  08  00  00  00  02  00  00  00  04  8D  FE  E1  60  ED  99  C4
000008F0  30  39  30  39  00  0E  92  88  C0  98  00  20  F8  98  00  20
00000900  28  00  00  00  02  00  00  00  02  A1  00  20  00  04  00  00
00000910  60  00  00  00  00  0E  11  40  FE  80  00  00  00  00  00  00
00000920  A4  3F  C6  D7  92  A0  CC  E2  FF  15  00  00  00  00  00  00
00000930  00  00  00  00  00  00  AB  CD  68  99  00  20  38  99  00  20
00000940  10  00  00  00  01  00  00  00  FF  3D  3E  3F  40  41  42  43
00000950  00  08  05  00  00  00  00  80  A6  D7  16  91  98  6A  C9  85
00000960  41  99  00  20  08  00  00  00  00  00  00  00  98  99  00  20
00000970  10  00  00  00  01  00  00  00  00  00  00  20  18  00  00  00
00000980  A0  9A  00  20  48  99  00  20  01  00  00  00  01  00  00  00
00000990  01  99  00  20  18  00  00  00  E0  9A  00  20  E0  99  00  20
000009A0  10  00  00  00  01  00  00  00  FF  FF  00  20  60  03  00  00
000009B0  22  02  40  10  00  00  04  44  FD  35  0E  A7  B7  0B  22  00
000009C0  50  99  00  20  C0  99  00  20  20  00  00  00  01  00  00  00
000009D0  00  00  00  00  00  00  00  02  03  04  40  40  00  00  FF  DC
000009E0  00  00  FF  DC  00  00  00  00  FD  35  0E  A7  B7  0B  22  00
000009F0  00  00  00  00  00  00  00  00  00  08  05  00  00  00  00  80
00000A00  A6  D7  16  91  98  6A  C9  85  41  9A  00  20  08  00  00  00
00000A10  00  00  00  00  10  9A  00  20  10  00  00  00  01  00  00  00
00000A20  00  D7  16  91  98  6A  C9  85  22  02  40  10  00  00  04  44
00000A30  FD  35  0E  A7  B7  0B  22  00  A8  99  00  20  38  9A  00  20
00000A40  18  00  00  00  01  00  00  00  00  3D  3E  3F  40  41  42  43
00000A50  23  03  00  03  00  00  00  00  FD  35  0E  A7  B7  0B  22  00
00000A60  A4  3F  C6  D7  92  A0  D9  E2  20  9A  00  20  68  9A  00  20
00000A70  10  00  00  00  01  00  00  00  00  6D  6E  6F  70  71  72  73
00000A80  01  02  A6  3F  C6  D7  92  A0  D9  E2  00  00  00  00  00  00
00000A90  50  9A  00  20  90  9A  00  20  10  00  00  00  01  00  00  00
00000AA0  03  95  96  97  98  99  9A  9B  86  00  53  12  00  00  07  08
00000AB0  00  00  00  00  00  00  00  00  78  9A  00  20  B8  9A  00  20
00000AC0  28  00  00  00  01  00  00  00  02  BD  BE  BF  C0  C1  C2  C3
00000AD0  60  00  00  00  00  68  3A  FF  FE  80  00  00  00  00  00  00
00000AE0  A4  3F  C6  D7  92  A0  D9  E2  FE  80  00  00  00  00  00  00
00000AF0  A4  D7  16  91  98  6A  C9  85  08  9C  00  20  F0  99  00  20
00000B00  01  00  00  00  01  00  00  00  01  FD  FE  FF  00  01  02  03
00000B10  00  00  00  00  48  9B  00  20  06  00  00  00  02  00  00  00
00000B20  00  FF  16  17  18  19  1A  1B  F8  99  00  20  28  9B  00  20
00000B30  20  00  00  00  01  00  00  00  00  2D  2E  2F  30  31  32  33
00000B40  03  04  40  40  00  00  FF  D2  00  00  FF  D2  00  00  00  00
00000B50  FD  35  0E  A7  B7  0B  22  00  00  00  00  00  00  00  00  00
00000B60  55  48  43  50  00  40  00  00  F8  9A  00  20  68  9B  00  20
00000B70  08  00  00  00  02  00  00  00  04  02  00  00  00  00  00  00
00000B80  30  39  30  39  00  0E  92  88  50  9B  00  20  48  9C  00  20
00000B90  28  00  00  00  02  00  00  00  02  85  00  00  00  00  00  00
00000BA0  10  9B  00  20  A0  9B  00  20  18  00  00  00  01  00  00  00
00000BB0  00  A5  A6  A7  A8  A9  AA  AB  23  03  00  03  00  00  00  00
00000BC0  FD  35  0E  A7  B7  0B  22  00  A4  3F  C6  D7  92  A0  D9  E2
00000BD0  88  9B  00  20  D0  9B  00  20  10  00  00  00  01  00  00  00
00000BE0  00  D5  D6  D7  D8  D9  DA  DB  01  02  A6  3F  C6  D7  92  A0
00000BF0  D9  E2  00  00  00  00  00  00  B8  9B  00  20  F8  9B  00  20
00000C00  10  00  00  00  01  00  00  00  03  FD  FE  FF  00  01  02  03
00000C10  86  00  53  26  00  00  07  08  00  00  00  00  00  00  00  00
00000C20  E0  9B  00  20  20  9C  00  20  28  00  00  00  01  00  00  00
00000C30  02  25  26  27  28  29  2A  2B  60  00  00  00  00  68  3A  FF
00000C40  FE  80  00  00  00  00  00  00  A4  3F  C6  D7  92  A0  D9  E2
00000C50  FE  80  00  00  00  00  00  00  A4  D7  16  91  98  6A  C9  85
00000C60  60  00  00  00  00  0E  11  40  FE  80  00  00  00  00  00  00
00000C70  A4  3F  C6  D7  92  A0  CC  E2  FF  15  00  00  00  00  00  00
00000C80  00  00  00  00  00  00  AB  CD  00  00  00  00  88  9C  00  20
00000C90  28  00  00  00  02  00  00  00  00  8D  8E  8F  90  91  92  93
00000CA0  44  01  7E  D7  F6  12  AF  51  B2  66  77  01  31  01  6D  03
00000CB0  5A  43  67  46  68  77  72  3D  35  31  05  66  77  74  3D  32
00000CC0  05  66  77  72  3D  30  81  02  70  9C  00  20  C8  9C  00  20
00000CD0  08  00  00  00  02  00  00  00  04  00  00  00  00  00  00  00
00000CE0  FD  49  16  33  00  30  52  DA  B0  9C  00  20  50  A1  00  20
00000CF0  28  00  00  00  02  00  00  00  02  00  00  00  00  00  00  00
00000D00  FD  49  16  33  00  30  52  DA  00  00  00  00  08  9D  00  20
00000D10  08  04  00  00  01  00  00  00  03  A1  00  20  10  00  00  00
00000D20  81  00  D2  D0  3C  56  00  01  B4  C7  37  0E  00  01  02  03
00000D30  04  05  06  07  08  09  0A  0B  0C  0D  0E  0F  10  11  12  13
00000D40  14  15  16  17  18  19  1A  1B  1C  1D  1E  1F  20  21  22  23
00000D50  24  25  26  27  28  29  2A  2B  2C  2D  2E  2F  30  31  32  33
00000D60  34  35  36  37  38  39  3A  3B  3C  3D  3E  3F  40  41  42  43
00000D70  44  45  46  47  48  49  4A  4B  4C  4D  4E  4F  50  51  52  53
00000D80  54  55  56  57  58  59  5A  5B  5C  5D  5E  5F  60  61  62  63
00000D90  64  65  66  67  68  69  6A  6B  6C  6D  6E  6F  70  71  72  73
00000DA0  74  75  76  77  78  79  7A  7B  7C  7D  7E  7F  80  81  82  83
00000DB0  84  85  86  87  88  89  8A  8B  8C  8D  8E  8F  90  91  92  93
00000DC0  94  95  96  97  98  99  9A  9B  9C  9D  9E  9F  A0  A1  A2  A3
00000DD0  A4  A5  A6  A7  A8  A9  AA  AB  AC  AD  AE  AF  B0  B1  B2  B3
00000DE0  B4  B5  B6  B7  B8  B9  BA  BB  BC  BD  BE  BF  C0  C1  C2  C3
00000DF0  C4  C5  C6  C7  C8  C9  CA  CB  CC  CD  CE  CF  D0  D1  D2  D3
00000E00  D4  D5  D6  D7  D8  D9  DA  DB  DC  DD  DE  DF  E0  E1  E2  E3
00000E10  E4  E5  E6  E7  E8  E9  EA  EB  EC  ED  EE  EF  F0  F1  F2  F3
00000E20  F4  F5  F6  F7  F8  F9  FA  FB  FC  FD  FE  FF  00  01  02  03
00000E30  04  05  06  07  08  09  0A  0B  0C  0D  0E  0F  10  11  12  13
00000E40  14  15  16  17  18  19  1A  1B  1C  1D  1E  1F  20  21  22  23
00000E50  24  25  26  27  28  29  2A  2B  2C  2D  2E  2F  30  31  32  33
00000E60  34  35  36  37  38  39  3A  3B  3C  3D  3E  3F  40  41  42  43
00000E70  44  45  46  47  48  49  4A  4B  4C  4D  4E  4F  50  51  52  53
00000E80  54  55  56  57  58  59  5A  5B  5C  5D  5E  5F  60  61  62  63
00000E90  64  65  66  67  68  69  6A  6B  6C  6D  6E  6F  70  71  72  73
00000EA0  74  75  76  77  78  79  7A  7B  7C  7D  7E  7F  80  81  82  83
00000EB0  84  85  86  87  88  89  8A  8B  8C  8D  8E  8F  90  91  92  93
00000EC0  94  95  96  97  98  99  9A  9B  9C  9D  9E  9F  A0  A1  A2  A3
00000ED0  A4  A5  A6  A7  A8  A9  AA  AB  AC  AD  AE  AF  B0  B1  B2  B3
00000EE0  B4  B5  B6  B7  B8  B9  BA  BB  BC  BD  BE  BF  C0  C1  C2  C3
00000EF0  C4  C5  C6  C7  C8  C9  CA  CB  CC  CD  CE  CF  D0  D1  D2  D3
00000F00  D4  D5  D6  D7  D8  D9  DA  DB  DC  DD  DE  DF  E0  E1  E2  E3
00000F10  E4  E5  E6  E7  E8  E9  EA  EB  EC  ED  EE  EF  F0  F1  F2  F3
00000F20  F4  F5  F6  F7  F8  F9  FA  FB  FC  FD  FE  FF  00  01  02  03
00000F30  04  05  06  07  08  09  0A  0B  0C  0D  0E  0F  10  11  12  13
00000F40  14  15  16  17  18  19  1A  1B  1C  1D  1E  1F  20  21  22  23
00000F50  24  25  26  27  28  29  2A  2B  2C  2D  2E  2F  30  31  32  33
00000F60  34  35  36  37  38  39  3A  3B  3C  3D  3E  3F  40  41  42  43
00000F70  44  45  46  47  48  49  4A  4B  4C  4D  4E  4F  50  51  52  53
00000F80  54  55  56  57  58  59  5A  5B  5C  5D  5E  5F  60  61  62  63
00000F90  64  65  66  67  68  69  6A  6B  6C  6D  6E  6F  70  71  72  73
00000FA0  74  75  76  77  78  79  7A  7B  7C  7D  7E  7F  80  81  82  83
00000FB0  84  85  86  87  88  89  8A  8B  8C  8D  8E  8F  90  91  92  93
00000FC0  94  95  96  97  98  99  9A  9B  9C  9D  9E  9F  A0  A1  A2  A3
00000FD0  A4  A5  A6  A7  A8  A9  AA  AB  AC  AD  AE  AF  B0  B1  B2  B3
00000FE0  B4  B5  B6  B7  B8  B9  BA  BB  BC  BD  BE  BF  C0  C1  C2  C3
00000FF0  C4  C5  C6  C7  C8  C9  CA  CB  CC  CD  CE  CF  D0  D1  D2  D3
00001000  D4  D5  D6  D7  D8  D9  DA  DB  DC  DD  DE  DF  E0  E1  E2  E3
00001010  E4  E5  E6  E7  E8  E9  EA  EB  EC  ED  EE  EF  F0  F1  F2  F3
00001020  F4  F5  F6  F7  F8  F9  FA  FB  FC  FD  FE  FF  00  01  02  03
00001030  04  05  06  07  08  09  0A  0B  0C  0D  0E  0F  10  11  12  13
00001040  14  15  16  17  18  19  1A  1B  1C  1D  1E  1F  20  21  22  23
00001050  24  25  26  27  28  29  2A  2B  2C  2D  2E  2F  30  31  32  33
00001060  34  35  36  37  38  39  3A  3B  3C  3D  3E  3F  40  41  42  43
00001070  44  45  46  47  48  49  4A  4B  4C  4D  4E  4F  50  51  52  53
00001080  54  55  56  57  58  59  5A  5B  5C  5D  5E  5F  60  61  62  63
00001090  64  65  66  67  68  69  6A  6B  6C  6D  6E  6F  70  71  72  73
000010A0  74  75  76  77  78  79  7A  7B  7C  7D  7E  7F  80  81  82  83
000010B0  84  85  86  87  88  89  8A  8B  8C  8D  8E  8F  90  91  92  93
000010C0  94  95  96  97  98  99  9A  9B  9C  9D  9E  9F  A0  A1  A2  A3
000010D0  A4  A5  A6  A7  A8  A9  AA  AB  AC  AD  AE  AF  B0  B1  B2  B3
000010E0  B4  B5  B6  B7  B8  B9  BA  BB  BC  BD  BE  BF  C0  C1  C2  C3
000010F0  C4  C5  C6  C7  C8  C9  CA  CB  CC  CD  CE  CF  D0  D1  D2  D3
00001100  D4  D5  D6  D7  D8  D9  DA  DB  DC  DD  DE  DF  E0  E1  E2  E3
00001110  E4  E5  E6  E7  E8  E9  EA  EB  EC  ED  EE  EF  F0  F1  F2  F3
00001120  F4  F5  F6  F7  F8  F9  FA  FB  F0  9C  00  20  28  A1  00  20
00001130  28  00  00  00  01  00  00  00  02  DC  DD  DE  DF  E0  E1  E2
00001140  60  00  00  00  04  08  3A  40  FE  80  00  00  00  00  00  00
00001150  A4  3F  C6  D7  92  A0  D9  E2  FE  80  00  00  00  00  00  00
00001160  AC  8D  FE  E1  60  ED  99  C4  60  00  00  00  00  30  11  40
00001170  FE  80  00  00  00  00  00  00  A4  3F  C6  D7  92  A0  CC  E2
00001180  FD  EA  DB  EE  00  0F  00  00  00  00  00  00  00  00  00  01
00001190  00  00  00  00  90  A1  00  20  28  00  00  00  02  00  00  00
000011A0  00  00  26  A5  3C  56  00  02  44  01  7E  D7  F6  12  AF  51
000011B0  B2  66  77  01  31  01  6D  03  5A  43  67  46  68  77  72  3D
000011C0  35  31  05  66  77  74  3D  32  05  66  77  72  3D  30  81  02
000011D0  78  A1  00  20  E8  9C  00  20  08  00  00  00  02  00  00  00
000011E0  04  80  00  00  00  00  00  00  B8  A1  00  20  E8  A1  00  20
000011F0  28  00  00  00  02  00  00  00  02  00  00  00  00  00  00  01
00001200  60  00  00  00  00  30  11  40  FE  80  00  00  00  00  00  00
00001210  A4  3F  C6  D7  92  A0  CC  E2  FD  EA  DB  EE  00  0F  00  00
00001220  00  00  00  00  00  00  00  01  00  00  00  00  28  A2  00  20
00001230  28  00  00  00  02  00  00  00  00  00  00  00  00  00  00  00
00001240  44  01  7E  D7  F6  12  AF  51  B2  66  77  01  31  01  6D  03
00001250  5A  43  67  46  68  77  72  3D  35  31  05  66  77  74  3D  32
00001260  05  66  77  72  3D  30  81  02  10  A2  00  20  68  A2  00  20
00001270  08  00  00  00  02  00  00  00  04  80  00  00  00  00  00  00
00001280  FD  49  16  33  00  30  52  DA  50  A2  00  20  88  A2  00  20
00001290  28  00  00  00  02  00  00  00  02  49  16  33  00  30  52  DA
000012A0  60  00  00  00  00  30  11  40  FE  80  00  00  00  00  00  00
000012B0  A4  3F  C6  D7  92  A0  CC  E2  FD  EA  DB  EE  00  0F  00  00
000012C0  00  00  00  00  00  00  00  01  00  00  00  00  C8  A2  00  20
000012D0  06  00  00  00  02  00  00  00  00  2D  2E  2F  30  31  32  33
000012E0  55  48  43  50  00  40  00  00  B0  A2  00  20  E8  A2  00  20
000012F0  08  00  00  00  02  00  00  00  04  80  00  00  00  00  00  00
00001300  30  39  30  39  00  0E  92  88  D0  A2  00  20  08  A3  00  20
00001310  28  00  00  00  02  00  00  00  02  80  00  00  00  00  00  00
00001320  60  00  00  00  00  0E  11  40  FE  80  00  00  00  00  00  00
00001330  A4  3F  C6  D7  92  A0  CC  E2  FF  15  00  00  00  00  00  00
00001340  00  00  00  00  00  00  AB  CD  00  00  00  00  48  A3  00  20
00001350  28  00  00  00  02  00  00  00  00  31  05  66  77  74  3D  32
00001360  44  01  7E  D7  F6  12  AF  51  B2  66  77  01  31  01  6D  03
00001370  5A  43  67  46  68  77  72  3D  35  31  05  66  77  74  3D  32
00001380  05  66  77  72  3D  30  81  02  30  A3  00  20  88  A3  00  20
00001390  08  00  00  00  02  00  00  00  04  A7  B7  0B  22  00  F2  F3
000013A0  FD  49  16  33  00  30  52  DA  70  A3  00  20  A8  A3  00  20
000013B0  28  00  00  00  02  00  00  00  02  00  00  00  48  04  00  00
000013C0  60  00  00  00  00  30  11  40  FE  80  00  00  00  00  00  00
000013D0  A4  3F  C6  D7  92  A0  CC  E2  FD  EA  DB  EE  00  0F  00  00
000013E0  00  00  00  00  00  00  00  01  00  00  00  00  E8  A3  00  20
000013F0  28  00  00  00  02  00  00  00  00  4D  4E  4F  50  51  52  53
00001400  44  01  7E  D7  F6  12  AF  51  B2  66  77  01  31  01  6D  03
00001410  5A  43  67  46  68  77  72  3D  35  31  05  66  77  74  3D  32
00001420  05  66  77  72  3D  30  81  02  D0  A3  00  20  28  A4  00  20
00001430  08  00  00  00  02  00  00  00  04  80  00  00  00  00  00  00
00001440  FD  49  16  33  00  30  52  DA  10  A4  00  20  48  A4  00  20
00001450  28  00  00  00  02  00  00  00  02  49  16  33  00  30  52  DA
00001460  60  00  00  00  00  30  11  40  FE  80  00  00  00  00  00  00
00001470  A4  3F  C6  D7  92  A0  CC  E2  FD  EA  DB  EE  00  0F  00  00
00001480  00  00  00  00  00  00  00  01  00  00  00  00  88  A4  00  20
00001490  06  00  00  00  02  00  00  00  00  ED  EE  EF  F0  F1  F2  F3
000014A0  55  48  43  50  00  40  00  00  70  A4  00  20  A8  A4  00  20
000014B0  08  00  00  00  02  00  00  00  04  80  00  00  00  00  00  00
000014C0  30  39  30  39  00  0E  92  88  90  A4  00  20  C8  A4  00  20
000014D0  28  00  00  00  02  00  00  00  02  80  00  00  00  00  00  00
000014E0  60  00  00  00  00  0E  11  40  FE  80  00  00  00  00  00  00
000014F0  A4  3F  C6  D7  92  A0  CC  E2  FF  15  00  00  00  00  00  00
00001500  00  00  00  00  00  00  AB  CD  00  00  00  00  08  A5  00  20
00001510  06  00  00  00  02  00  00  00  00  31  05  66  77  74  3D  32
00001520  55  48  43  50  00  40  00  00  F0  A4  00  20  28  A5  00  20
00001530  08  00  00  00  02  00  00  00  04  80  00  00  00  00  00  00
00001540  30  39  30  39  00  0E  92  88  10  A5  00  20  48  A5  00  20
00001550  28  00  00  00  02  00  00  00  02  A7  B7  0B  22  00  B2  B3
00001560  60  00  00  00  00  0E  11  40  FE  80  00  00  00  00  00  00
00001570  A4  3F  C6  D7  92  A0  CC  E2  FF  15  00  00  00  00  00  00
00001580  00  00  00  00  00  00  AB  CD  00  00  00  00  88  A5  00  20
00001590  06  00  00  00  02  00  00  00  00  00  00  00  68  02  00  00
000015A0  55  48  43  50  00  40  00  00  70  A5  00  20  A8  A5  00  20
000015B0  08  00  00  00  02  00  00  00  04  00  00  00  00  00  00  00
000015C0  30  39  30  39  00  0E  92  88  90  A5  00  20  C8  A5  00  20
000015D0  28  00  00  00  02  00  00  00  02  00  00  00  00  00  00  00
000015E0  60  00  00  00  00  0E  11  40  FE  80  00  00  00  00  00  00
000015F0  A4  3F  C6  D7  92  A0  CC  E2  FF  15  00  00  00  00  00  00
00001600  00  00  00  00  00  00  AB  CD  00  00  00  00  08  A6  00  20
00001610  06  00  00  00  02  00  00  00  00  00  00  00  00  00  00  00
00001620  55  48  43  50  00  40  00  00  F0  A5  00  20  28  A6  00  20
00001630  08  00  00  00  02  00  00  00  04  00  00  00  00  00  00  00
00001640  30  39  30  39  00  0E  92  88  10  A6  00  20  48  A6  00  20
00001650  28  00  00  00  02  00  00  00  02  00  00  00  00  00  00  00
00001660  60  00  00  00  00  0E  11  40  FE  80  00  00  00  00  00  00
00001670  A4  3F  C6  D7  92  A0  CC  E2  FF  15  00  00  00  00  00  00
00001680  00  00  00  00  00  00  AB  CD  00  00  00  00  88  A6  00  20
00001690  06  00  00  00  02  00  00  00  00  00  00  00  00  00  00  00
000016A0  55  48  43  50  00  40  00  00  70  A6  00  20  A8  A6  00  20
000016B0  08  00  00  00  02  00  00  00  04  00  00  00  00  00  00  00
000016C0  30  39  30  39  00  0E  92  88  90  A6  00  20  C8  A6  00  20
000016D0  28  00  00  00  02  00  00  00  02  00  00  00  00  00  00  00
000016E0  60  00  00  00  00  0E  11  40  FE  80  00  00  00  00  00  00
000016F0  A4  3F  C6  D7  92  A0  CC  E2  FF  15  00  00  00  00  00  00
00001700  00  00  00  00  00  00  AB  CD  00  00  00  00  08  A7  00  20
00001710  06  00  00  00  02  00  00  00  00  00  00  00  00  00  00  00
00001720  55  48  43  50  00  40  00  00  F0  A6  00  20  28  A7  00  20
00001730  08  00  00  00  02  00  00  00  04  00  00  00  00  00  00  00
00001740  30  39  30  39  00  0E  92  88  10  A7  00  20  48  A7  00  20
00001750  28  00  00  00  02  00  00  00  02  00  00  00  00  00  00  00
00001760  60  00  00  00  00  0E  11  40  FE  80  00  00  00  00  00  00
00001770  A4  3F  C6  D7  92  A0  CC  E2  FF  15  00  00  00  00  00  00
00001780  00  00  00  00  00  00  AB  CD  00  00  00  00  88  A7  00  20
00001790  06  00  00  00  01  00  00  00  00  00  00  00  00  00  00  00
000017A0  55  48  43  50  00  40  00  00  70  A7  00  20  A8  A7  00  20
000017B0  08  00  00  00  01  00  00  00  04  00  00  00  00  00  00  00
000017C0  30  39  30  39  40  00  00  00  00  00  00  00  C8  A7  00  20
000017D0  0C  00  00  00  01  00  00  00  03  00  00  00  00  00  00  00
000017E0  80  00  00  00  D1  1A  00  00  00  00  00  00  18  00  00  00
~ unused: 0x2000a7d8 (next: (nil), size:   16) ~

@benpicco
Copy link
Contributor Author

benpicco commented Nov 27, 2024

This is now fixed at least for devices that implement netdev_new_api as of #20983

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Area: network Area: Networking Type: bug The issue reports a bug / The PR fixes a bug (including spelling errors)
Projects
None yet
Development

Successfully merging a pull request may close this issue.

5 participants