-
Notifications
You must be signed in to change notification settings - Fork 1.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
S6100-T0-64/T1-LAG-64/ Restart of syncd doesnt stop the syncd process #4127
Comments
@mini-nair-dell, is this issue still seen in latest image? Thanks. |
Yes, we still see this in the latest Nov-2018 branch |
This issue is seen in 11-2019 images as well. The last tested one is, root@sonic-s6100-10:/var/log# show ver SONiC Software Version: SONiC.HEAD.37-cf1dd5ba Platform: x86_64-dell_s6100_c2538-r0 Docker images: Thanks |
@mini-nair-dell this should get fix when below PR gets merged Please re-verify |
The issue is seen with the latest 201911 branc h. Build - 83 Thanks |
@abdosi, @mini-nair-dell , thanks for info. the mentioned PR as fix is not yet in 201911 branch. |
@mini-nair-dell: sonic-mgmt PR is merged now. Manually please use this command pgrep syncd -a -x Steps: Assigning back to you. |
PLs find the test o/p below: root@sonic-s6100-07:/var/core# show ip bgp summary IPv4 Unicast Summary: Neighbor V AS MsgRcvd MsgSent TblVer InQ OutQ Up/Down State/PfxRcd NeighborName Total number of neighbors 4 SONiC Software Version: SONiC.HEAD.83-a693f023 Platform: x86_64-dell_s6100_c2538-r0 Docker images: root@sonic-s6100-07:/var/core# docker exec -i syncd /usr/bin/syncd_request_shutdown --cold |
root@sonic-s6100-07:/var/core# tail -f /var/log/syslog |
@mini-nair-dell can we close this |
@abdosi the issue is still seen in the recent images, and the script still fails |
Sync restart request doesnt get triggered in November images. Hence the script 'restart_syncd.yml' fails in regression in November
HEAD.238-a24e040
Steps to Repro:
+++++++++++++++
root@sonic-s6100-07:~# docker exec -i syncd /usr/bin/syncd_request_shutdown --cold
requested COLD shutdown
root@sonic-s6100-07:
# pgrep syncd -a# pgrep syncd -a3652 fpmsyncd
4358 /bin/bash /usr/local/bin/syncd.sh wait
4362 /bin/bash /usr/bin/syncd.sh wait
4502 /usr/bin/portsyncd -p /usr/share/sonic/hwsku/port_config.ini
4529 /usr/bin/teamsyncd
4638 /usr/bin/neighsyncd
root@sonic-s6100-07:
3652 fpmsyncd
4358 /bin/bash /usr/local/bin/syncd.sh wait
4362 /bin/bash /usr/bin/syncd.sh wait
4502 /usr/bin/portsyncd -p /usr/share/sonic/hwsku/port_config.ini
4529 /usr/bin/teamsyncd
4638 /usr/bin/neighsyncd
This doesnt happen in teh master images
I checked in both the boxes. I don’t see syncd rebooting, and the process is running. Pls find the logs below:
Logs
+++++
root@sonic-s6100-07:/home/admin# cd
root@sonic-s6100-07:
# docker exec -i syncd /usr/bin/syncd_request_shutdown --cold# pgrep syncd -arequested COLD shutdown
root@sonic-s6100-07:
3652 fpmsyncd
4358 /bin/bash /usr/local/bin/syncd.sh wait
4362 /bin/bash /usr/bin/syncd.sh wait
4502 /usr/bin/portsyncd -p /usr/share/sonic/hwsku/port_config.ini
4529 /usr/bin/teamsyncd
4638 /usr/bin/neighsyncd
root@sonic-s6100-07:
# pgrep syncd -a# pgrep syncd -a3652 fpmsyncd
4358 /bin/bash /usr/local/bin/syncd.sh wait
4362 /bin/bash /usr/bin/syncd.sh wait
4502 /usr/bin/portsyncd -p /usr/share/sonic/hwsku/port_config.ini
4529 /usr/bin/teamsyncd
4638 /usr/bin/neighsyncd
root@sonic-s6100-07:
3652 fpmsyncd
4358 /bin/bash /usr/local/bin/syncd.sh wait
4362 /bin/bash /usr/bin/syncd.sh wait
4502 /usr/bin/portsyncd -p /usr/share/sonic/hwsku/port_config.ini
4529 /usr/bin/teamsyncd
4638 /usr/bin/neighsyncd
root@sonic-s6100-07:
# docker ps# cd /var/coreCONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
5bd62a1fa22e docker-syncd-brcm:latest "/usr/bin/supervisord" 40 minutes ago Up 40 minutes syncd
9128da19a975 docker-router-advertiser:latest "/usr/bin/supervisord" 40 minutes ago Up 40 minutes radv
a9b25bec9878 docker-snmp-sv2:latest "/usr/bin/supervisord" 40 minutes ago Up 40 minutes snmp
e0aaea66b071 docker-teamd:latest "/usr/bin/supervisord" 40 minutes ago Up 40 minutes teamd
72df31c3d315 docker-orchagent-brcm:latest "/usr/bin/supervisord" 40 minutes ago Up 40 minutes swss
dda70b75d631 docker-fpm-quagga:latest "/usr/bin/supervisord" 40 minutes ago Up 40 minutes bgp
2bb401a5d8a6 docker-lldp-sv2:latest "/usr/bin/supervisord" 40 minutes ago Up 40 minutes lldp
fca718c60559 docker-platform-monitor:latest "/usr/bin/supervisord" 40 minutes ago Up 40 minutes pmon
850c23fd1f92 docker-database:latest "/usr/bin/supervisord" 40 minutes ago Up 40 minutes database
root@sonic-s6100-07:
root@sonic-s6100-07:/var/core# ls
root@sonic-s6100-07:/var/core# ls
root@sonic-s6100-07:/var/core# docker ps
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
5bd62a1fa22e docker-syncd-brcm:latest "/usr/bin/supervisord" 40 minutes ago Up 40 minutes syncd
9128da19a975 docker-router-advertiser:latest "/usr/bin/supervisord" 40 minutes ago Up 40 minutes radv
a9b25bec9878 docker-snmp-sv2:latest "/usr/bin/supervisord" 40 minutes ago Up 40 minutes snmp
e0aaea66b071 docker-teamd:latest "/usr/bin/supervisord" 40 minutes ago Up 40 minutes teamd
72df31c3d315 docker-orchagent-brcm:latest "/usr/bin/supervisord" 40 minutes ago Up 40 minutes swss
dda70b75d631 docker-fpm-quagga:latest "/usr/bin/supervisord" 40 minutes ago Up 40 minutes bgp
2bb401a5d8a6 docker-lldp-sv2:latest "/usr/bin/supervisord" 40 minutes ago Up 40 minutes lldp
fca718c60559 docker-platform-monitor:latest "/usr/bin/supervisord" 40 minutes ago Up 40 minutes pmon
850c23fd1f92 docker-database:latest "/usr/bin/supervisord" 41 minutes ago Up 41 minutes database
root@sonic-s6100-07:/var/core# ls
root@sonic-s6100-07:/var/core# pgrep syncd -a
3652 fpmsyncd
4358 /bin/bash /usr/local/bin/syncd.sh wait
4362 /bin/bash /usr/bin/syncd.sh wait
4502 /usr/bin/portsyncd -p /usr/share/sonic/hwsku/port_config.ini
4529 /usr/bin/teamsyncd
4638 /usr/bin/neighsyncd
root@sonic-s6100-07:/var/core# docker ps
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
5bd62a1fa22e docker-syncd-brcm:latest "/usr/bin/supervisord" 41 minutes ago Up 41 minutes syncd
9128da19a975 docker-router-advertiser:latest "/usr/bin/supervisord" 41 minutes ago Up 41 minutes radv
a9b25bec9878 docker-snmp-sv2:latest "/usr/bin/supervisord" 41 minutes ago Up 41 minutes snmp
e0aaea66b071 docker-teamd:latest "/usr/bin/supervisord" 41 minutes ago Up 41 minutes teamd
72df31c3d315 docker-orchagent-brcm:latest "/usr/bin/supervisord" 41 minutes ago Up 41 minutes swss
dda70b75d631 docker-fpm-quagga:latest "/usr/bin/supervisord" 41 minutes ago Up 41 minutes bgp
2bb401a5d8a6 docker-lldp-sv2:latest "/usr/bin/supervisord" 41 minutes ago Up 41 minutes lldp
fca718c60559 docker-platform-monitor:latest "/usr/bin/supervisord" 41 minutes ago Up 41 minutes pmon
850c23fd1f92 docker-database:latest "/usr/bin/supervisord" 41 minutes ago Up 41 minutes database
root@sonic-s6100-07:/var/core# docker ps
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
5bd62a1fa22e docker-syncd-brcm:latest "/usr/bin/supervisord" 41 minutes ago Up 41 minutes syncd
9128da19a975 docker-router-advertiser:latest "/usr/bin/supervisord" 41 minutes ago Up 41 minutes radv
a9b25bec9878 docker-snmp-sv2:latest "/usr/bin/supervisord" 41 minutes ago Up 41 minutes snmp
e0aaea66b071 docker-teamd:latest "/usr/bin/supervisord" 41 minutes ago Up 41 minutes teamd
72df31c3d315 docker-orchagent-brcm:latest "/usr/bin/supervisord" 41 minutes ago Up 41 minutes swss
dda70b75d631 docker-fpm-quagga:latest "/usr/bin/supervisord" 41 minutes ago Up 41 minutes bgp
2bb401a5d8a6 docker-lldp-sv2:latest "/usr/bin/supervisord" 41 minutes ago Up 41 minutes lldp
fca718c60559 docker-platform-monitor:latest "/usr/bin/supervisord" 41 minutes ago Up 41 minutes pmon
850c23fd1f92 docker-database:latest "/usr/bin/supervisord" 41 minutes ago Up 41 minutes database
root@sonic-s6100-07:/var/core# docker ps
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
5bd62a1fa22e docker-syncd-brcm:latest "/usr/bin/supervisord" 41 minutes ago Up 41 minutes syncd
9128da19a975 docker-router-advertiser:latest "/usr/bin/supervisord" 41 minutes ago Up 41 minutes radv
a9b25bec9878 docker-snmp-sv2:latest "/usr/bin/supervisord" 41 minutes ago Up 41 minutes snmp
e0aaea66b071 docker-teamd:latest "/usr/bin/supervisord" 41 minutes ago Up 41 minutes teamd
72df31c3d315 docker-orchagent-brcm:latest "/usr/bin/supervisord" 41 minutes ago Up 41 minutes swss
dda70b75d631 docker-fpm-quagga:latest "/usr/bin/supervisord" 41 minutes ago Up 41 minutes bgp
2bb401a5d8a6 docker-lldp-sv2:latest "/usr/bin/supervisord" 41 minutes ago Up 41 minutes lldp
fca718c60559 docker-platform-monitor:latest "/usr/bin/supervisord" 41 minutes ago Up 41 minutes pmon
850c23fd1f92 docker-database:latest "/usr/bin/supervisord" 42 minutes ago Up 41 minutes database
root@sonic-s6100-07:/var/core# docker ps
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
5bd62a1fa22e docker-syncd-brcm:latest "/usr/bin/supervisord" 42 minutes ago Up 42 minutes syncd
9128da19a975 docker-router-advertiser:latest "/usr/bin/supervisord" 42 minutes ago Up 42 minutes radv
a9b25bec9878 docker-snmp-sv2:latest "/usr/bin/supervisord" 42 minutes ago Up 42 minutes snmp
e0aaea66b071 docker-teamd:latest "/usr/bin/supervisord" 42 minutes ago Up 42 minutes teamd
72df31c3d315 docker-orchagent-brcm:latest "/usr/bin/supervisord" 42 minutes ago Up 42 minutes swss
dda70b75d631 docker-fpm-quagga:latest "/usr/bin/supervisord" 42 minutes ago Up 42 minutes bgp
2bb401a5d8a6 docker-lldp-sv2:latest "/usr/bin/supervisord" 42 minutes ago Up 42 minutes lldp
fca718c60559 docker-platform-monitor:latest "/usr/bin/supervisord" 42 minutes ago Up 42 minutes pmon
850c23fd1f92 docker-database:latest "/usr/bin/supervisord" 43 minutes ago Up 43 minutes database
root@sonic-s6100-07:/var/core# pgrep syncd -a
3652 fpmsyncd
4358 /bin/bash /usr/local/bin/syncd.sh wait
4362 /bin/bash /usr/bin/syncd.sh wait
4502 /usr/bin/portsyncd -p /usr/share/sonic/hwsku/port_config.ini
4529 /usr/bin/teamsyncd
4638 /usr/bin/neighsyncd
root@sonic-s6100-07:/var/core#
Thanks
Mini
The text was updated successfully, but these errors were encountered: