Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Orchagent crashes when PFCWD delay restoration timer expires #3087

Open
nazeerhussainf opened this issue Jun 26, 2019 · 3 comments
Open

Orchagent crashes when PFCWD delay restoration timer expires #3087

nazeerhussainf opened this issue Jun 26, 2019 · 3 comments
Assignees

Comments

@nazeerhussainf
Copy link

Description
Orchagent crashes when Pause Frame Control Watchdog's(PFCWD) delay restoration timer expires.

Topology:
Ixia Port 1 ----- Z9264 ----- Ixia Port 2

Steps to reproduce the issue:

  1. Configure PFCWD on switch's interface connecting to Ixia port 2 where pause frames will be sent. Command : "pfcwd start --action drop ports Ethernet0 detection-time 400"
  2. Send traffic from port 1 at 100% line rate with DSCP value as 000011(3) to port 2.
  3. Enable PFC queue on Ixia port 2 and enable queue 3. Set Pause Quanta as 255 for Priority queue 3 on Port 2's stream.
  4. Send pause control frames at 10000 packets/sec from port 2.
  5. Stop pause control frames traffic on port 2.

Describe the results you received:
After step 4 traffic was dropped as expected.
After step 5 and delay restoration timer expired, Orchagent crashes. Traffic didn't resume.

Describe the results you expected:
After step 5 and delay restoration timer expired, traffic should resume.
orchagent.1561142120.38.core.gz
pfcwd_logs.txt

@liat-grozovik
Copy link
Collaborator

Can you provide information about the system you are using to run it? I wonder if this is a SONiC issue or SAI/SDK level.

I suggest you provide the output of the show techsupport for logs and more info on the configuraiton

@wendani
Copy link
Contributor

wendani commented Jul 18, 2019

Can you show the syslog message error? What drop actions are you using, zero buffer or ACL? Has your SAI implemented the remove/disqualify logic?

@nazeerhussainf
Copy link
Author

Recreated the same issue using Dell Z9264 platform with 100G links on build 30.
SONiC Software Version: SONiC.HEAD.30-97645896
Distribution: Debian 9.9
Kernel: 4.9.0-9-2-amd64
Build commit: 9764589
Build date: Wed Jul 10 06:09:55 UTC 2019
Built by: johnar@jenkins-worker-4

Attached show-tech, syslog, core file and config_db.json file. Please refer PFCWD_100G.zip file.
PFCWD_100G.zip

mssonicbld added a commit that referenced this issue Apr 19, 2024
…lly (#18334)

#### Why I did it
src/sonic-swss
```
* 9e183a65 - (HEAD -> master, origin/master, origin/HEAD) Add bookworm build to the PR checkers (#3114) (2 days ago) [Saikrishna Arcot]
* ec463953 - [twamporch] Explicitly initialize local variable (#3115) (2 days ago) [xiaodong hu]
* 19410232 - Add force option for fabric port unisolate command (#3089) (7 days ago) [jfeng-arista]
* 774973d9 - [dash] fix ENI admin state update (#3081) (8 days ago) [Yakiv Huryk]
* 56ba6de3 - [p4orch] Clang format change. (#3096) (10 days ago) [mint570]
* f6dd9caa - Introduce a new role for DPU-NPU Interconnect (10 days ago) [Vivek]
* 0f707757 - [portsorch] Handle TRANSCEIVER_INFO table on warm boot (#3087) (10 days ago) [Stepan Blyshchak]
* cbc263a1 - [EVPN]Fix fpmsyncd crash when EVPN type5 is received with bgp fib suppression enabled (#3101) (13 days ago) [Sudharsan Dhamal Gopalarathnam]
* 4af61167 - Fix oper FEC retrieval after warmboot (#3100) (13 days ago) [Sudharsan Dhamal Gopalarathnam]
* 2a586154 - [Fdbsyncd] Adding extern_learn flag with fdb entry so Kernel doesn't age out (#2985) (2 weeks ago) [KISHORE KUNAL]
* 465399e9 - T2-VOQ-VS: Fix iBGP bringup issue (#3053) (2 weeks ago) [Deepak Singhal]
* dc9eae87 - Clang format change. (#3080) (2 weeks ago) [mint570]
* 95a74750 - [orchagent] TWAMP Light orchagent implementation (#2927) (2 weeks ago) [xiaodong hu]
```
#### How I did it
#### How to verify it
#### Description for the changelog
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants