Invalid port oid messages in orchagent on VOQ chassis

[kartik-arista]

Description

orchagent is reporting Invalid port ID messages related to

pfcFrameCounterCheck, mcCounterCheck: Invalid port oid 0x5d000000000026

These are seen repeatedly on a running VOQ chassis device.

Likely suspect is sonic-net/sonic-swss#2606

Workaround is proposed in PR

sonic-net/sonic-mgmt#7315

Steps to reproduce the issue:

No steps needed.

Describe the results you received:

ERR swss1#orchagent: :- pfcFrameCounterCheck: Invalid port oid 0x15d00000000007b
ERR swss0#orchagent: :- mcCounterCheck: Invalid port oid 0x5d000000000026

Results in various sonic-mgmt tests failing due to unexpected Logs during test.

Describe the results you expected:

Output of show version:

(paste your output here)

Output of show techsupport:

(paste your output here or download and attach the file here )

Additional information you deem important (e.g. issue happens only occasionally):

[kartik-arista]

https://github.com/sanmalho-git

for visibility

[judyjoseph]

@kartik-arista, reaching to check on this if you have any PR available to fix this ?-- as I see the CPU utilization goes very high due to very high rate of these messages send to log.

Feb  2 17:16:58.372916 svcstr--lc1-1 WARNING swss1#orchagent: :- pfcFrameCounterCheck: Could not retreive PFC frame count on queue 5 port Ethernet-IB1
Feb  2 17:16:58.372916 svcstr--lc1-1 WARNING swss1#orchagent: :- pfcFrameCounterCheck: Could not retreive PFC frame count on queue 6 port Ethernet-IB1
Feb  2 17:16:58.372932 svcstr--lc1-1 WARNING swss1#orchagent: :- pfcFrameCounterCheck: Could not retreive PFC frame count on queue 7 port Ethernet-IB1
Feb  2 17:16:58.372932 svcstr--lc1-1 WARNING swss1#orchagent: :- pfcFrameCounterCheck: Could not retreive PFC frame count on queue 0 port Ethernet-Rec1
Feb  2 17:16:58.372946 svcstr--lc1-1 WARNING swss1#orchagent: :- pfcFrameCounterCheck: Could not retreive PFC frame count on queue 1 port Ethernet-Rec1
Feb  2 17:16:58.372946 svcstr--lc1-1 WARNING swss1#orchagent: :- pfcFrameCounterCheck: Could not retreive PFC frame count on queue 2 port Ethernet-Rec1
Feb  2 17:16:58.372967 svcstr--lc1-1 WARNING swss1#orchagent: :- pfcFrameCounterCheck: Could not retreive PFC frame count on queue 3 port Ethernet-Rec1
Feb  2 17:16:58.372967 svcstr--lc1-1 WARNING swss1#orchagent: :- pfcFrameCounterCheck: Could not retreive PFC frame count on queue 4 port Ethernet-Rec1
Feb  2 17:16:58.372977 svcstr--lc1-1 WARNING swss1#orchagent: :- pfcFrameCounterCheck: Could not retreive PFC frame count on queue 5 port Ethernet-Rec1
Feb  2 17:16:58.372988 svcstr--lc1-1 WARNING swss1#orchagent: :- pfcFrameCounterCheck: Could not retreive PFC frame count on queue 6 port Ethernet-Rec1
Feb  2 17:16:58.372988 svcstr--lc1-1 WARNING swss1#orchagent: :- pfcFrameCounterCheck: Could not retreive PFC frame count on queue 7 port Ethernet-Rec1
Feb  2 17:16:58.373010 svcstr--lc1-1 ERR swss1#orchagent: :- pfcFrameCounterCheck: Invalid port oid 0x15d000000000026
Feb  2 17:16:58.373010 svcstr--lc1-1 ERR swss1#orchagent: :- pfcFrameCounterCheck: Invalid port oid 0x15d00000000003d
Feb  2 17:16:58.373020 svcstr--lc1-1 ERR swss1#orchagent: :- pfcFrameCounterCheck: Invalid port oid 0x15d00000000003e
Feb  2 17:16:58.373026 svcstr--lc1-1 ERR swss1#orchagent: :- pfcFrameCounterCheck: Invalid port oid 0x15d00000000003f
Feb  2 17:16:58.373040 svcstr--lc1-1 ERR swss1#orchagent: :- pfcFrameCounterCheck: Invalid port oid 0x15d000000000040
Feb  2 17:16:58.373058 svcstr--lc1-1 ERR swss1#orchagent: :- pfcFrameCounterCheck: Invalid port oid 0x15d000000000041
Feb  2 17:16:58.373091 svcstr--lc1-1 ERR swss1#orchagent: :- pfcFrameCounterCheck: Invalid port oid 0x15d000000000042
Feb  2 17:16:58.373125 svcstr--lc1-1 ERR swss1#orchagent: :- pfcFrameCounterCheck: Invalid port oid 0x15d000000000043
Feb  2 17:16:58.373153 svcstr--lc1-1 ERR swss1#orchagent: :- pfcFrameCounterCheck: Invalid port oid 0x15d000000000044
Feb  2 17:16:58.373180 svcstr--lc1-1 ERR swss1#orchagent: :- pfcFrameCounterCheck: Invalid port oid 0x15d000000000045
Feb  2 17:16:58.373204 svcstr--lc1-1 ERR swss1#orchagent: :- pfcFrameCounterCheck: Invalid port oid 0x15d000000000046

[kartik-arista]

This is addressed by PR
sonic-net/sonic-swss#2632

which is waiting to merge.

[skbarista]

This is addressed by sonic-net/sonic-swss#2653 which merged.