Skip to content

[Services] Restart Router-advertiser service upon unexpected critical process exit.#3681

Merged
jleveque merged 5 commits intosonic-net:masterfrom
yozhao101:Restart_Radv
Oct 30, 2019
Merged

[Services] Restart Router-advertiser service upon unexpected critical process exit.#3681
jleveque merged 5 commits intosonic-net:masterfrom
yozhao101:Restart_Radv

Conversation

@yozhao101
Copy link
Copy Markdown
Contributor

  • What I did
    Restart Router-advertiser service if one of critical processes running in Router-advertiser container exited or crashed abnormally.
  • How I did it
    Generally I follow the framework created by Joe to implement this feature in Router-advertiser container.
    First, add supervisor-proc-exit-listener event listener option in Supervisord configuration file in Router-advertiser docker container. Supervisord will read a list of critical processes for which to monitor the unexpected crashed and exited.
    Second, configure router-advertiser.service to always auto-restart the service if it stops, with a delay of 30 seconds. Also set a rate limit of 3 restarts within 20 minutes (1200 seconds).
  • How to verify it
    On your switch device, please use docker ps command to list all running docker containers.
    Then use docker exec -it container_id /bin/bash to login target container. Typing top command
    on the shell will display all the processes dynamically and you will spot the process id of one
    of the critical processes. Finally type the command kill -9 process_id to terminate one process.
    After exiting the container, you can use watch -n 1 docker ps to dynamically see the restart
    of Router-advertiser container.

critical processes file into Dockerfile.j2.

Signed-off-by: Yong Zhao <[email protected]>
option in supervisord conf file.

Signed-off-by: Yong Zhao <[email protected]>
router-advertiser if it attempts to restart this container more than 3
times in 20 minutes.

Signed-off-by: Yong Zhao <[email protected]>
…SCRIPT) into shared Makefile docker-router-advertiser.mk.

Signed-off-by: Yong Zhao <[email protected]>
@jleveque jleveque merged commit cff30c5 into sonic-net:master Oct 30, 2019
mssonicbld added a commit that referenced this pull request Dec 26, 2024
…atically (#21257)

#### Why I did it
src/sonic-utilities
```
* 579454b7 - (HEAD -> 202405, origin/202405) Fixed the issues with sonic-clear queuecounter for egress queue and voq (#3671) (31 hours ago) [saksarav-nokia]
* 566174af - [show_tech] Filter out a list of commands in generate_dump script which are not applicable to Supervisor (#3646) (34 hours ago) [Marty Y. Lok]
* 0d4e5d03 - [202405] Fix Backtrace in route-check during config reload/minigraph. (#3681) (5 days ago) [abdosi]
```
#### How I did it
#### How to verify it
#### Description for the changelog
mssonicbld added a commit that referenced this pull request Jul 16, 2025
…lly (#23068)

#### Why I did it
src/sonic-swss
```
* 9d74a49 - (HEAD -> master, origin/master, origin/HEAD) [orchagent] CoPP neighbor miss trap and enhancements (#3624) (8 hours ago) [Ravi Minnikanti(Marvell)]
* 41dc0cb - Improve route performance 20% by changing NextHopGroupTable from std::map to std::unordered_map. (#3742) (8 hours ago) [Hua Liu]
* 27391fc - Publish oper_status time to STATE_DB (#3756) (29 hours ago) [Bobby McGonigle]
* ad80fa5 - [trim]: Add Packet Trimming Asym DSCP to OA (#3705) (29 hours ago) [Nazarii Hnydyn]
* dc520a7 - [ssw][ha] fix dpu_state_db connection issue and zmq not supporting dpu_appl_db (31 hours ago) [Jing Zhang]
* 035e1c7 - Added MAX pre-FEC BER for link health monitoring (#3757) (33 hours ago) [Prince George]
* 0c5a6e4 - Skip ref counting standby mux neighbor NHs when added to NH group (#3753) (33 hours ago) [manamand2020]
* f53cc8c - [DASH] Implement PL Redirect Map (#3731) (35 hours ago) [Lawrence Lee]
* c5c360e - Fix counter issue #22775 and #22478 (#3681) (4 days ago) [Stephen Sun]
* bd73705 - [DASH] Support trusted VNIs for appliance and ENI objects (#3728) (4 days ago) [Lawrence Lee]
* cea81b2 - stpd crashes due to wrong no.of stp instance passed from stpmgrd (#3752) (5 days ago) [Divya Kumaran Chandralekha]
* af56a61 - Fix fpmsyncd crash during pfcwd/test_pfcwd_warm_reboot.py worm reboot issue (#3746) (5 days ago) [Hua Liu]
* 80932db - use the exact strings from hld (#3735) (13 days ago) [Jing Zhang]
* f44f6ab - [vs][mirror]: Update test to use the max TC number provided by VS lib (#3712) (2 weeks ago) [Nazarii Hnydyn]
* 55e9bba - remove the logic that skip system neigh task for ASICs that share common hostname (#3718) (2 weeks ago) [Changrong Wu]
* 3356753 - LC buffer errors for local port (#3719) (2 weeks ago) [Vineet Mittal]
* bad2141 - Update INIT_VIEW timeout for marvell-prestera platforms (#3729) (2 weeks ago) [Pavan Prakash]
* eebaf97 - [routeorch] Wait for the VRF to be created (#3652) (2 weeks ago) [Manoharan Sundaramoorthy]
* 7dd3be9 - [fpmsyncd]Fixing the blackhole route removal during warmboot (#3726) (2 weeks ago) [Sudharsan Dhamal Gopalarathnam]
* 575c342 - [routeorch] Handle SAI_STATUS_ITEM_NOT_FOUND when setting route entries (#3713) (3 weeks ago) [Nikola Dancejic]
* 1ae6787 - [portsorch] postpone non-critical port init part in warm/fast-reboot (#3562) (3 weeks ago) [Stepan Blyshchak]
* 889aff6 - add support for local endpoints in vnet_route_tunnel (#3651) (3 weeks ago) [Jing Zhang]
* 1f97afb - [trim]: Add Packet Trimming to OA (#3594) (3 weeks ago) [Nazarii Hnydyn]
* 8c2b337 - Gracefully handle errors when accessing dpu app_state DB on NPU from DPU (#3716) (3 weeks ago) [prabhataravind]
* a0e1953 - Harden module build script by specifying the source version to get (#3723) (3 weeks ago) [Saikrishna Arcot]
* 0081e3a - Improve route orch performance by enable ZMQ (#3632) (3 weeks ago) [Hua Liu]
```
#### How I did it
#### How to verify it
#### Description for the changelog
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants