Apr 9 22:01:55 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:01:56 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:01:56 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:01:57 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:01:57 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:01:57 [jsrpd_pfe_rx_ipc_msg_handler]: Received fabric monitor status Apr 9 22:01:57 [jsrpd_pfe_fabmon_status_update]: Received fabric monitor link status from node1 PFE Apr 9 22:01:57 [jsrpd_pfe_fabmon_status_update]: lnk_idx:0 name(ge-2/0/1) ifd_state(curr:1, new:1), pfe_state(curr:1, new:1) Apr 9 22:01:57 [jsrpd_pfe_fabmon_status_update]: lnk_idx:1 name() ifd_state(curr:0, new:0), pfe_state(curr:0, new:0) Apr 9 22:01:57 [jsrpd_pfe_fabmon_status_update]: Fabric link current state: UP link up count:1 Apr 9 22:01:57 [jsrpd_fabric_info_dump]: HA Fabric Info: After fabric status is updated Apr 9 22:01:57 [jsrpd_fabric_info_dump]: node0: fab0 is Active with 1 child (AggId: 130) Apr 9 22:01:57 [jsrpd_fabric_info_dump]: fab0: ge-0/0/1 (0/0/1) is Active : ifd_state: Up pfe_state: Up Apr 9 22:01:57 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:01:57 [jsrpd_fabric_info_dump]: node1: fab1 is Active with 1 child (AggId: 150) Apr 9 22:01:57 [jsrpd_fabric_info_dump]: fab0: ge-2/0/1 (2/0/1) is Active : ifd_state: Up pfe_state: Up Apr 9 22:01:57 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:01:58 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:01:58 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:01:59 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:01:59 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:00 [jsrpd_tcp_client_msg_handler]: TCP-C: received a TCP msg (len:-1) Apr 9 22:02:00 [jsrpd_tcp_client_msg_handler]: TCP-C: TCP read error (Connection reset by peer) Apr 9 22:02:00 [jsrpd_tcp_close_client]: TCP-C: Closing TCP Client (Connection Error) Apr 9 22:02:00 [jsrpd_tcp_client_start_retry_timer]: TCP-C: Started retry timer Apr 9 22:02:00 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:00 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:03 [jsrpd_tcp_start_client]: Initiating TCP Client Apr 9 22:02:03 [jsrpd_tcp_start_client]: Opened TCP Client client socket (13) Apr 9 22:02:03 [jsrpd_tcp_start_client]: client src ip address is 130.16.0.1/0 Apr 9 22:02:03 [jsrpd_tcp_start_client]: TCP Client init complete. Connecting to server: 129.16.0.1/62845 Apr 9 22:02:03 [check_is_schedule_slip]: JSRPD scheduling delay for (2689 ms) Apr 9 22:02:03 [fsm_device_timer_callback]: Ignoring fsm device timer expiration newer version of JSRPD Apr 9 22:02:03 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:03 [jsrpd_start_or_reset_ctrl_link_timer]: Ctrl-link (0) timer started Apr 9 22:02:03 [update_ctrl_hb_counter]: JSRPD noticed jitter on control heartbeat Apr 9 22:02:03 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:03 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:03 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:03 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:03 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:03 [get_fpc_frm_intf]: printing fpc_num Apr 9 22:02:03 [fabric_reth_and_ae_process_intf]: Processing interface state change for:pp0 Apr 9 22:02:03 [jsrpd_ifd_msg_handler]: Interface pp0 is getting deleted Apr 9 22:02:03 [get_fpc_frm_intf]: printing fpc_num Apr 9 22:02:03 last message repeated 2 times Apr 9 22:02:03 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:03 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-0/0/2 Apr 9 22:02:03 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface fe-0/0/2 is up Apr 9 22:02:03 [jsrpd_aggr_db_find_child_and_delete]: ifd fe-0/0/2 is found on aggr_type 1 db delete it from the db Apr 9 22:02:03 [jsrpd_get_aggr_ifd_other_node_status]: aggr interface ???H peer new state 1 peer_active_link 0 mimimum_active_link 0 Apr 9 22:02:03 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:03 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/2 Apr 9 22:02:03 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface fe-2/0/2 is up Apr 9 22:02:03 [jsrpd_aggr_db_find_child_and_delete]: ifd fe-2/0/2 is found on aggr_type 1 db delete it from the db Apr 9 22:02:03 [jsrpd_get_aggr_ifd_other_node_status]: aggr interface ???H peer new state 1 peer_active_link 0 mimimum_active_link 0 Apr 9 22:02:03 [jsrpd_delete_reth_ifl_entry]: successfully deleted the reth0.0 ifl entry Apr 9 22:02:03 [get_fpc_frm_intf]: printing fpc_num h0 Apr 9 22:02:03 [fabric_reth_and_ae_process_intf]: Processing interface state change for:reth0 Apr 9 22:02:03 [jsrpd_ifd_msg_handler]: Interface reth0 is getting deleted Apr 9 22:02:03 [jsrpd_ifd_msg_handler]: Unable to update the reth0 ifd state (32) Apr 9 22:02:03 [jsrpd_delete_reth_ifl_entry]: successfully deleted the reth1.10 ifl entry Apr 9 22:02:03 [jsrpd_delete_reth_ifl_entry]: successfully deleted the reth1.40 ifl entry Apr 9 22:02:03 [jsrpd_delete_reth_ifl_entry]: successfully deleted the reth1.50 ifl entry Apr 9 22:02:03 [jsrpd_delete_reth_ifl_entry]: successfully deleted the reth1.60 ifl entry Apr 9 22:02:03 [jsrpd_tcp_client_connected]: TCP-C: client connected. Apr 9 22:02:03 [jsrpd_tcp_client_connected]: TCP-C: client connection setup complete Apr 9 22:02:03 [jsrpd_delete_reth_ifl_entry]: successfully deleted the reth1.70 ifl entry Apr 9 22:02:03 [jsrpd_delete_reth_ifl_entry]: successfully deleted the reth1.80 ifl entry Apr 9 22:02:04 [jsrpd_delete_reth_ifl_entry]: successfully deleted the reth1.90 ifl entry Apr 9 22:02:04 [jsrpd_delete_reth_ifl_entry]: successfully deleted the reth1.91 ifl entry Apr 9 22:02:04 [jsrpd_delete_reth_ifl_entry]: successfully deleted the reth1.92 ifl entry Apr 9 22:02:04 [get_fpc_frm_intf]: printing fpc_num h1 Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: Processing interface state change for:reth1 Apr 9 22:02:04 [jsrpd_ifd_msg_handler]: Interface reth1 is going down Apr 9 22:02:04 [jsrpd_get_aggr_ifd_status]: local child name ge-2/0/0 Apr 9 22:02:04 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 1 local_active_link 1 minimum_active_link 1 Apr 9 22:02:04 [jsrpd_ifd_msg_handler]: reth1 jsrpd not ready Apr 9 22:02:04 [jsrpd_update_interface_mon_info]: ifd reth1 is aggr intf idx 1 aggr type 1 Apr 9 22:02:04 [jsrpd_get_aggr_ifd_status]: local child name ge-2/0/0 Apr 9 22:02:04 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 1 local_active_link 1 minimum_active_link 1 Apr 9 22:02:04 [jsrpd_update_interface_mon_info]: ifd reth1 is aggr intf idx 1 aggr type 1 Apr 9 22:02:04 [jsrpd_get_aggr_ifd_status]: local child name ge-2/0/0 Apr 9 22:02:04 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 1 local_active_link 1 minimum_active_link 1 Apr 9 22:02:04 [jsrpd_update_interface_mon_info]: ifd reth1 is aggr intf idx 1 aggr type 1 Apr 9 22:02:04 [jsrpd_get_aggr_ifd_status]: local child name ge-2/0/0 Apr 9 22:02:04 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 1 local_active_link 1 minimum_active_link 1 Apr 9 22:02:04 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ge-0/0/0 Apr 9 22:02:04 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface ge-0/0/0 is up Apr 9 22:02:04 [jsrpd_aggr_db_find_child_and_delete]: ifd ge-0/0/0 is found on aggr_type 1 db delete it from the db Apr 9 22:02:04 [jsrpd_get_aggr_ifd_other_node_status]: aggr interface ???H peer new state 1 peer_active_link 0 mimimum_active_link 0 Apr 9 22:02:04 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ge-2/0/0 Apr 9 22:02:04 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface ge-2/0/0 is up Apr 9 22:02:04 [jsrpd_aggr_db_find_child_and_delete]: ifd ge-2/0/0 is found on aggr_type 1 db delete it from the db Apr 9 22:02:04 [jsrpd_get_aggr_ifd_other_node_status]: aggr interface ???H peer new state 1 peer_active_link 0 mimimum_active_link 0 Apr 9 22:02:04 [jsrpd_delete_reth_ifl_entry]: successfully deleted the reth1.32767 ifl entry Apr 9 22:02:04 [get_fpc_frm_intf]: printing fpc_num h1 Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: Processing interface state change for:reth1 Apr 9 22:02:04 [jsrpd_ifd_msg_handler]: Interface reth1 is getting deleted Apr 9 22:02:04 [jsrpd_ifd_msg_handler]: Unable to update the reth1 ifd state (32) Apr 9 22:02:04 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:04 [jsrpd_actions_for_fab_chld_del]: Deleting fabric child ge-0/0/1 from fab0 Apr 9 22:02:04 [jsrpd_actions_for_fab_chld_del]: All child interfaces are deleted from fab0 Suspending fabric monitoring Apr 9 22:02:04 [jsrpd_clear_fabric_dead_timer]: fabric timer never started dead timer not stopped Apr 9 22:02:04 [jsrpd_fabric_info_dump]: HA Fabric Info: After child is deleted Apr 9 22:02:04 [jsrpd_fabric_info_dump]: node0: fab0 is Active with 0 child (AggId: 130) Apr 9 22:02:04 [jsrpd_fabric_info_dump]: fab0: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:02:04 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:02:04 [jsrpd_fabric_info_dump]: node1: fab1 is Active with 1 child (AggId: 150) Apr 9 22:02:04 [jsrpd_fabric_info_dump]: fab0: ge-2/0/1 (2/0/1) is Active : ifd_state: Up pfe_state: Up Apr 9 22:02:04 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ge-0/0/1 Apr 9 22:02:04 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface ge-0/0/1 is up Apr 9 22:02:04 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: fab0 deleted Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fab0 Apr 9 22:02:04 [jsrpd_ifd_msg_handler]: Interface fab0 is getting deleted Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: swfab0 marked down, parent id 131 Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: swfab0 deleted Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: Processing interface state change for:swfab0 Apr 9 22:02:04 [jsrpd_ifd_msg_handler]: Interface swfab0 is getting deleted Apr 9 22:02:04 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:04 last message repeated 10 times Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ge-0/0/0 Apr 9 22:02:04 [jsrpd_ifd_msg_handler]: Interface ge-0/0/0 is getting deleted Apr 9 22:02:04 [jsrpd_update_interface_mon_info]: ge-0/0/0 interface monitored by RG-2 changed state from Up to Down Apr 9 22:02:04 [jsrpd_set_led_status]: old LED color is Green, new LED color is Amber Apr 9 22:02:04 [jsrpd_set_led_status]: LED changed from Green to Amber, reason is Monitored objects are down Apr 9 22:02:04 [jsrpd_set_led_status]: setting sysctl for ha led color(Amber) Apr 9 22:02:04 [jsrpd_calculate_and_update_rg_priority]: Node1-RG2's weight is 255 Apr 9 22:02:04 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-2 is 255. Failures: none Apr 9 22:02:04 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ge-0/0/1 Apr 9 22:02:04 [jsrpd_ifd_msg_handler]: Interface ge-0/0/1 is getting deleted Apr 9 22:02:04 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-0/0/2 Apr 9 22:02:04 [jsrpd_ifd_msg_handler]: Interface fe-0/0/2 is getting deleted Apr 9 22:02:04 [jsrpd_update_interface_mon_info]: fe-0/0/2 interface monitored by RG-1 changed state from Up to Down Apr 9 22:02:04 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:02:04 [jsrpd_calculate_and_update_rg_priority]: Node1-RG1's weight is 255 Apr 9 22:02:04 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-1 is 255. Failures: none Apr 9 22:02:04 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-0/0/3 Apr 9 22:02:04 [jsrpd_ifd_msg_handler]: Interface fe-0/0/3 is getting deleted Apr 9 22:02:04 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-0/0/4 Apr 9 22:02:04 [jsrpd_ifd_msg_handler]: Interface fe-0/0/4 is getting deleted Apr 9 22:02:04 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-0/0/5 Apr 9 22:02:04 [jsrpd_ifd_msg_handler]: Interface fe-0/0/5 is getting deleted Apr 9 22:02:04 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-0/0/6 Apr 9 22:02:04 [jsrpd_ifd_msg_handler]: Interface fe-0/0/6 is getting deleted Apr 9 22:02:04 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-0/0/7 Apr 9 22:02:04 [jsrpd_ifd_msg_handler]: Interface fe-0/0/7 is getting deleted Apr 9 22:02:04 [get_fpc_frm_intf]: printing fpc_num Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: Processing interface state change for:irb Apr 9 22:02:04 [jsrpd_ifd_msg_handler]: Interface irb is getting deleted Apr 9 22:02:04 [get_fpc_frm_intf]: printing fpc_num Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: Processing interface state change for:st0 Apr 9 22:02:04 [jsrpd_ifd_msg_handler]: Interface st0 is getting deleted Apr 9 22:02:04 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ppd0 Apr 9 22:02:04 [jsrpd_ifd_msg_handler]: Interface ppd0 is getting deleted Apr 9 22:02:04 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ppe0 Apr 9 22:02:04 [jsrpd_ifd_msg_handler]: Interface ppe0 is getting deleted Apr 9 22:02:04 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ip-0/0/0 Apr 9 22:02:04 [jsrpd_ifd_msg_handler]: Interface ip-0/0/0 is getting deleted Apr 9 22:02:04 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: Processing interface state change for:gr-0/0/0 Apr 9 22:02:04 [jsrpd_ifd_msg_handler]: Interface gr-0/0/0 is getting deleted Apr 9 22:02:04 [get_fpc_frm_intf]: printing fpc_num n Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: Processing interface state change for:vlan Apr 9 22:02:04 [jsrpd_ifd_msg_handler]: Interface vlan is getting deleted Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: swfab1 marked down, parent id 149 Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: swfab1 deleted Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: Processing interface state change for:swfab1 Apr 9 22:02:04 [jsrpd_ifd_msg_handler]: Interface swfab1 is getting deleted Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: fab1 marked down Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fab1 Apr 9 22:02:04 [jsrpd_ifd_msg_handler]: Interface fab1 is going down Apr 9 22:02:04 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:04 [jsrpd_actions_for_fab_chld_del]: Deleting fabric child ge-2/0/1 from fab1 Apr 9 22:02:04 [jsrpd_actions_for_fab_chld_del]: All child interfaces are deleted from fab1 Suspending fabric monitoring Apr 9 22:02:04 [jsrpd_clear_fabric_dead_timer]: fabric timer never started dead timer not stopped Apr 9 22:02:04 [jsrpd_fabric_info_dump]: HA Fabric Info: After child is deleted Apr 9 22:02:04 [jsrpd_fabric_info_dump]: node0: fab0 is Inactive with 0 child (AggId: 0) Apr 9 22:02:04 [jsrpd_fabric_info_dump]: fab0: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:02:04 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:02:04 [jsrpd_fabric_info_dump]: node1: fab1 is Active with 0 child (AggId: 150) Apr 9 22:02:04 [jsrpd_fabric_info_dump]: fab0: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:02:04 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ge-2/0/1 Apr 9 22:02:04 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface ge-2/0/1 is up Apr 9 22:02:04 [get_fpc_frm_intf]: printing fpc_num 1 Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: fab1 deleted Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fab1 Apr 9 22:02:04 [jsrpd_ifd_msg_handler]: Interface fab1 is getting deleted Apr 9 22:02:04 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:04 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:04 [jsrpd_set_remote_node_suspend_fabmon_flag]: Remote node suspended fabric monitoring Apr 9 22:02:04 [jsrpd_clear_fabric_dead_timer]: fabric timer never started dead timer not stopped Apr 9 22:02:04 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:04 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:04 last message repeated 9 times Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ge-2/0/0 Apr 9 22:02:04 [jsrpd_ifd_msg_handler]: Interface ge-2/0/0 is getting deleted Apr 9 22:02:04 [jsrpd_update_interface_mon_info]: ge-2/0/0 interface monitored by RG-2 changed state from Up to Down Apr 9 22:02:04 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:02:04 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:02:04 [jsrpd_snmp_health_weight_trap]: Successfully sent an snmp-trap due to change of weight.cluster1-node1-RG2: Unhealthy(0) Apr 9 22:02:04 [jsrpd_calculate_and_update_rg_priority]: Node1-RG2's weight is 0 Apr 9 22:02:04 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-2 is 0. Setting priority to 0. Failures: interface-monitoring Apr 9 22:02:04 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ge-2/0/1 Apr 9 22:02:04 [jsrpd_ifd_msg_handler]: Interface ge-2/0/1 is getting deleted Apr 9 22:02:04 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/2 Apr 9 22:02:04 [jsrpd_ifd_msg_handler]: Interface fe-2/0/2 is getting deleted Apr 9 22:02:04 [jsrpd_update_interface_mon_info]: fe-2/0/2 interface monitored by RG-1 changed state from Up to Down Apr 9 22:02:04 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:02:04 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:02:04 [jsrpd_snmp_health_weight_trap]: Successfully sent an snmp-trap due to change of weight.cluster1-node1-RG1: Unhealthy(0) Apr 9 22:02:04 [jsrpd_calculate_and_update_rg_priority]: Node1-RG1's weight is 0 Apr 9 22:02:04 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-1 is 0. Setting priority to 0. Failures: interface-monitoring Apr 9 22:02:04 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/3 Apr 9 22:02:04 [jsrpd_ifd_msg_handler]: Interface fe-2/0/3 is getting deleted Apr 9 22:02:04 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/4 Apr 9 22:02:04 [jsrpd_ifd_msg_handler]: Interface fe-2/0/4 is getting deleted Apr 9 22:02:04 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/5 Apr 9 22:02:04 [jsrpd_ifd_msg_handler]: Interface fe-2/0/5 is getting deleted Apr 9 22:02:04 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/6 Apr 9 22:02:04 [jsrpd_ifd_msg_handler]: Interface fe-2/0/6 is getting deleted Apr 9 22:02:04 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:04 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/7 Apr 9 22:02:04 [jsrpd_ifd_msg_handler]: Interface fe-2/0/7 is getting deleted Apr 9 22:02:05 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:05 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:06 [jsrpd_fabric_info_dump]: HA Fabric Info: Before populated from blob Apr 9 22:02:06 [jsrpd_fabric_info_dump]: node0: fab0 is Inactive with 0 child (AggId: 0) Apr 9 22:02:06 [jsrpd_fabric_info_dump]: fab0: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:02:06 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:02:06 [jsrpd_fabric_info_dump]: node1: fab1 is Inactive with 0 child (AggId: 0) Apr 9 22:02:06 [jsrpd_fabric_info_dump]: fab0: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:02:06 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:02:06 [jsrpd_fabric_info_dump]: HA Fabric Info: After populated from blob Apr 9 22:02:06 [jsrpd_fabric_info_dump]: node0: fab0 is Inactive with 0 child (AggId: 130) Apr 9 22:02:06 [jsrpd_fabric_info_dump]: fab0: (0/0/0) is Inactive : ifd_state: Up pfe_state: Up Apr 9 22:02:06 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:02:06 [jsrpd_fabric_info_dump]: node1: fab1 is Inactive with 0 child (AggId: 0) Apr 9 22:02:06 [jsrpd_fabric_info_dump]: fab0: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:02:06 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:02:06 [jsrpd_gencfg_msg_handler]: blob major_type:2 minor_type: 76 Apr 9 22:02:06 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:06 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:07 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:07 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:08 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:08 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:09 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:09 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:10 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:10 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:11 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:11 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:12 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:12 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:13 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:13 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:14 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:14 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:15 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:15 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:16 [get_fpc_frm_intf]: printing fpc_num Apr 9 22:02:16 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:16 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:16 [get_fpc_frm_intf]: printing fpc_num h0 Apr 9 22:02:16 [fabric_reth_and_ae_process_intf]: Processing interface state change for:reth0 Apr 9 22:02:16 [jsrpd_ifd_msg_handler]: Interface reth0 is going down Apr 9 22:02:16 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:16 [jsrpd_ifd_msg_handler]: reth0 jsrpd not ready Apr 9 22:02:16 [jsrpd_update_interface_mon_info]: ifd reth0 is aggr intf idx 0 aggr type 1 Apr 9 22:02:16 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:16 [jsrpd_update_interface_mon_info]: ifd reth0 is aggr intf idx 0 aggr type 1 Apr 9 22:02:16 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:16 [jsrpd_update_interface_mon_info]: ifd reth0 is aggr intf idx 0 aggr type 1 Apr 9 22:02:16 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:16 [jsrpd_update_reth_ifl_entry]: RG-1 reth0.0, state primary added to reth database Apr 9 22:02:16 [get_fpc_frm_intf]: printing fpc_num h1 Apr 9 22:02:16 [fabric_reth_and_ae_process_intf]: Processing interface state change for:reth1 Apr 9 22:02:16 [jsrpd_ifd_msg_handler]: Interface reth1 is going down Apr 9 22:02:16 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:16 [jsrpd_ifd_msg_handler]: reth1 jsrpd not ready Apr 9 22:02:16 [jsrpd_update_interface_mon_info]: ifd reth1 is aggr intf idx 1 aggr type 1 Apr 9 22:02:16 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:16 [jsrpd_update_interface_mon_info]: ifd reth1 is aggr intf idx 1 aggr type 1 Apr 9 22:02:16 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:16 [jsrpd_update_interface_mon_info]: ifd reth1 is aggr intf idx 1 aggr type 1 Apr 9 22:02:16 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:16 [jsrpd_update_reth_ifl_entry]: RG-2 reth1.92, state primary added to reth database Apr 9 22:02:16 [jsrpd_update_reth_ifl_entry]: RG-2 reth1.91, state primary appended to reth database Apr 9 22:02:16 [jsrpd_update_reth_ifl_entry]: RG-2 reth1.90, state primary appended to reth database Apr 9 22:02:16 [jsrpd_update_reth_ifl_entry]: RG-2 reth1.80, state primary appended to reth database Apr 9 22:02:16 [jsrpd_update_reth_ifl_entry]: RG-2 reth1.70, state primary appended to reth database Apr 9 22:02:16 [jsrpd_update_reth_ifl_entry]: RG-2 reth1.60, state primary appended to reth database Apr 9 22:02:16 [jsrpd_update_reth_ifl_entry]: RG-2 reth1.50, state primary appended to reth database Apr 9 22:02:16 [jsrpd_update_reth_ifl_entry]: RG-2 reth1.40, state primary appended to reth database Apr 9 22:02:17 [jsrpd_update_reth_ifl_entry]: RG-2 reth1.10, state primary appended to reth database Apr 9 22:02:17 [fabric_reth_and_ae_process_intf]: fab0 marked up Apr 9 22:02:17 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fab0 Apr 9 22:02:17 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface fab0 is up Apr 9 22:02:17 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:17 [fabric_reth_and_ae_process_intf]: swfab0 marked down, parent id 131 Apr 9 22:02:17 [fabric_reth_and_ae_process_intf]: Processing interface state change for:swfab0 Apr 9 22:02:17 [jsrpd_ifd_msg_handler]: Interface swfab0 is going down Apr 9 22:02:17 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:17 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ge-0/0/1 Apr 9 22:02:17 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface ge-0/0/1 is up Apr 9 22:02:17 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:17 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ge-0/0/0 Apr 9 22:02:17 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface ge-0/0/0 is up Apr 9 22:02:17 [jsrpd_update_interface_mon_info]: ge-0/0/0 interface monitored by RG-2 changed state from Down to Up Apr 9 22:02:17 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:02:17 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:02:17 [jsrpd_calculate_and_update_rg_priority]: Node1-RG2's weight is 0 Apr 9 22:02:17 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-2 is 0. Setting priority to 0. Failures: interface-monitoring Apr 9 22:02:17 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:17 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-0/0/3 Apr 9 22:02:17 [jsrpd_ifd_msg_handler]: Interface fe-0/0/3 is going down Apr 9 22:02:17 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:17 last message repeated 2 times Apr 9 22:02:17 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:17 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:17 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:17 last message repeated 6 times Apr 9 22:02:17 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-0/0/2 Apr 9 22:02:17 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface fe-0/0/2 is up Apr 9 22:02:17 [jsrpd_update_interface_mon_info]: fe-0/0/2 interface monitored by RG-1 changed state from Down to Up Apr 9 22:02:17 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:02:17 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:02:17 [jsrpd_calculate_and_update_rg_priority]: Node1-RG1's weight is 0 Apr 9 22:02:17 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-1 is 0. Setting priority to 0. Failures: interface-monitoring Apr 9 22:02:17 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:17 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-0/0/4 Apr 9 22:02:17 [jsrpd_ifd_msg_handler]: Interface fe-0/0/4 is going down Apr 9 22:02:17 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:17 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-0/0/5 Apr 9 22:02:17 [jsrpd_ifd_msg_handler]: Interface fe-0/0/5 is going down Apr 9 22:02:17 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:17 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-0/0/6 Apr 9 22:02:17 [jsrpd_ifd_msg_handler]: Interface fe-0/0/6 is going down Apr 9 22:02:17 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:17 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-0/0/7 Apr 9 22:02:17 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface fe-0/0/7 is up Apr 9 22:02:17 [get_fpc_frm_intf]: printing fpc_num Apr 9 22:02:17 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:17 [get_fpc_frm_intf]: printing fpc_num h1 Apr 9 22:02:17 [fabric_reth_and_ae_process_intf]: Processing interface state change for:reth1 Apr 9 22:02:17 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface reth1 is up Apr 9 22:02:17 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:17 [jsrpd_ifd_msg_handler]: reth1 jsrpd not ready Apr 9 22:02:17 [jsrpd_update_interface_mon_info]: ifd reth1 is aggr intf idx 1 aggr type 1 Apr 9 22:02:17 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:17 [jsrpd_update_interface_mon_info]: ifd reth1 is aggr intf idx 1 aggr type 1 Apr 9 22:02:17 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:17 [jsrpd_update_interface_mon_info]: ifd reth1 is aggr intf idx 1 aggr type 1 Apr 9 22:02:17 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:17 [fabric_reth_and_ae_process_intf]: ifd ge-0/0/0 state change may let reth or ae 1 1 state change Apr 9 22:02:17 [jsrpd_add_aggr_child]: Found empty entry; adding child ge-0/0/0 at index 0 mac: 28:8a:1c:d8:5e:58:, prefix: ge fpc: 0 pic: 0, port: 0, child count: 1 Apr 9 22:02:17 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:17 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface ge-0/0/0 is up Apr 9 22:02:17 [jsrpd_update_interface_mon_info]: ifd ge-0/0/0 has parent aggr id 1 aggr type 1 Apr 9 22:02:17 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:17 [jsrpd_update_interface_mon_info]: ifd ge-0/0/0 has parent aggr id 1 aggr type 1 Apr 9 22:02:17 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:17 [jsrpd_update_interface_mon_info]: ifd ge-0/0/0 has parent aggr id 1 aggr type 1 Apr 9 22:02:17 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:17 [jsrpd_get_aggr_ifd_other_node_status]: peer child name ge-0/0/0 Apr 9 22:02:17 [jsrpd_get_aggr_ifd_other_node_status]: aggr interface reth1 peer new state 1 peer_active_link 1 mimimum_active_link 1 Apr 9 22:02:17 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:02:17 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:02:17 [jsrpd_calculate_and_update_rg_priority]: Node1-RG2's weight is 0 Apr 9 22:02:17 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-2 is 0. Setting priority to 0. Failures: interface-monitoring Apr 9 22:02:17 [jsrpd_find_and_update_ifl]: RG-2 reth1.91, state primary updated in reth database Apr 9 22:02:17 [jsrpd_find_and_update_ifl]: RG-2 reth1.92, state primary updated in reth database Apr 9 22:02:17 [jsrpd_find_and_update_ifl]: RG-2 reth1.90, state primary updated in reth database Apr 9 22:02:17 [get_fpc_frm_intf]: printing fpc_num h0 Apr 9 22:02:17 [fabric_reth_and_ae_process_intf]: Processing interface state change for:reth0 Apr 9 22:02:17 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface reth0 is up Apr 9 22:02:17 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:17 [jsrpd_ifd_msg_handler]: reth0 jsrpd not ready Apr 9 22:02:17 [jsrpd_update_interface_mon_info]: ifd reth0 is aggr intf idx 0 aggr type 1 Apr 9 22:02:17 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:17 [jsrpd_update_interface_mon_info]: ifd reth0 is aggr intf idx 0 aggr type 1 Apr 9 22:02:17 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:17 [jsrpd_update_interface_mon_info]: ifd reth0 is aggr intf idx 0 aggr type 1 Apr 9 22:02:17 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:17 [fabric_reth_and_ae_process_intf]: ifd fe-0/0/2 state change may let reth or ae 1 0 state change Apr 9 22:02:17 [jsrpd_add_aggr_child]: Found empty entry; adding child fe-0/0/2 at index 0 mac: 28:8a:1c:d8:5e:5a:, prefix: fe fpc: 0 pic: 0, port: 2, child count: 1 Apr 9 22:02:17 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:17 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface fe-0/0/2 is up Apr 9 22:02:17 [jsrpd_update_interface_mon_info]: ifd fe-0/0/2 has parent aggr id 0 aggr type 1 Apr 9 22:02:17 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:17 [jsrpd_update_interface_mon_info]: ifd fe-0/0/2 has parent aggr id 0 aggr type 1 Apr 9 22:02:17 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:17 [jsrpd_get_aggr_ifd_other_node_status]: peer child name fe-0/0/2 Apr 9 22:02:17 [jsrpd_get_aggr_ifd_other_node_status]: aggr interface reth0 peer new state 1 peer_active_link 1 mimimum_active_link 1 Apr 9 22:02:17 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:02:17 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:02:17 [jsrpd_calculate_and_update_rg_priority]: Node1-RG1's weight is 0 Apr 9 22:02:17 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-1 is 0. Setting priority to 0. Failures: interface-monitoring Apr 9 22:02:17 [jsrpd_update_interface_mon_info]: ifd fe-0/0/2 has parent aggr id 0 aggr type 1 Apr 9 22:02:17 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:17 [jsrpd_find_and_update_ifl]: RG-1 reth0.0, state primary updated in reth database Apr 9 22:02:18 [jsrpd_find_and_update_ifl]: RG-2 reth1.50, state primary updated in reth database Apr 9 22:02:18 [jsrpd_find_and_update_ifl]: RG-2 reth1.80, state primary updated in reth database Apr 9 22:02:18 [jsrpd_find_and_update_ifl]: RG-2 reth1.70, state primary updated in reth database Apr 9 22:02:18 [jsrpd_find_and_update_ifl]: RG-2 reth1.10, state primary updated in reth database Apr 9 22:02:18 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:18 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ge-2/0/0 Apr 9 22:02:18 [jsrpd_ifd_msg_handler]: Interface ge-2/0/0 is going down Apr 9 22:02:18 [jsrpd_get_aggr_ifd_other_node_status]: aggr interface peer new state 1 peer_active_link 0 mimimum_active_link 0 Apr 9 22:02:18 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:02:18 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:02:18 [jsrpd_calculate_and_update_rg_priority]: Node1-RG2's weight is 0 Apr 9 22:02:18 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-2 is 0. Setting priority to 0. Failures: interface-monitoring Apr 9 22:02:18 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:18 [jsrpd_find_and_update_ifl]: RG-2 reth1.10, state primary updated in reth database Apr 9 22:02:18 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:18 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:18 [jsrpd_find_and_update_ifl]: RG-2 reth1.40, state primary updated in reth database Apr 9 22:02:18 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:18 [jsrpd_find_and_update_ifl]: RG-2 reth1.40, state primary updated in reth database Apr 9 22:02:18 [get_fpc_frm_intf]: printing fpc_num Apr 9 22:02:18 [fabric_reth_and_ae_process_intf]: Processing interface state change for:pp0 Apr 9 22:02:18 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface pp0 is up Apr 9 22:02:19 [get_fpc_frm_intf]: printing fpc_num Apr 9 22:02:19 [fabric_reth_and_ae_process_intf]: Processing interface state change for:irb Apr 9 22:02:19 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface irb is up Apr 9 22:02:19 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:19 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ip-0/0/0 Apr 9 22:02:19 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface ip-0/0/0 is up Apr 9 22:02:19 [get_fpc_frm_intf]: printing fpc_num n Apr 9 22:02:19 [fabric_reth_and_ae_process_intf]: Processing interface state change for:vlan Apr 9 22:02:19 [jsrpd_ifd_msg_handler]: Interface vlan is going down Apr 9 22:02:19 [jsrpd_find_and_update_ifl]: RG-2 reth1.60, state primary updated in reth database Apr 9 22:02:19 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:19 [jsrpd_find_and_update_ifl]: RG-2 reth1.70, state primary updated in reth database Apr 9 22:02:19 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:19 [jsrpd_find_and_update_ifl]: RG-2 reth1.50, state primary updated in reth database Apr 9 22:02:19 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:19 [fabric_reth_and_ae_process_intf]: swfab1 marked down, parent id 149 Apr 9 22:02:19 [fabric_reth_and_ae_process_intf]: Processing interface state change for:swfab1 Apr 9 22:02:19 [jsrpd_ifd_msg_handler]: Interface swfab1 is going down Apr 9 22:02:19 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:19 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:20 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:20 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:21 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:21 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:21 [jsrpd_uspipc_event_handler]: uspipc client pfe channel is shutdown due to idle timeout or error in receiving msg or pfe going down.Reconnecting to pfe.. Apr 9 22:02:21 [jsrpd_uspipc_event_handler]: usp ipc connection shutdown, suspending fabric monitoring Apr 9 22:02:21 [jsrpd_clear_fabric_dead_timer]: fabric timer never started dead timer not stopped Apr 9 22:02:21 [jsrpd_uspipc_open]: tnp address from PIC entry for pfe: 0x2100001 Apr 9 22:02:21 [jsrpd_pfe_rx_ipc_event_handler]: PFE Rx client is shutdown (socket id: 12, session 59d780) Apr 9 22:02:21 [jsrpd_dump_session_list]: session list is empty Apr 9 22:02:21 [get_fpc_frm_intf]: printing fpc_num 1 Apr 9 22:02:21 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fxp1 Apr 9 22:02:21 [jsrpd_ctrl_ifd_state_changed]: Interface fxp1 is down. devflags: 0x3, ifdm_flags: 0x8 Apr 9 22:02:21 [jsrpd_jsrxnle_handle_ctrl_ifd_state_change]: Ctrl-link state change: UP->DOWN Apr 9 22:02:21 [jsrpd_jsrxnle_handle_ctrl_ifd_state_change]: Flowd down, RG-0 state: secondary Apr 9 22:02:21 [jsrpd_jsrxnle_handle_ctrl_ifd_state_change]: Flowd down, set control link status DOWN Apr 9 22:02:21 [jsrpd_jsrxnle_handle_ctrl_ifd_state_change]: Flowd down, set fabric link status DOWN Apr 9 22:02:21 [jsrpd_set_pfe_ifstate_download_status]: PFE ifstate download status set to 0 Apr 9 22:02:21 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:02:21 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:02:21 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:02:21 [jsrpd_calculate_and_update_rg_priority]: Node1-RG1's weight is -255 Apr 9 22:02:21 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-1 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:02:21 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:02:21 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:02:21 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:02:21 [jsrpd_calculate_and_update_rg_priority]: Node1-RG2's weight is -255 Apr 9 22:02:21 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-2 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:02:21 [jsrpd_jsrxnle_handle_ctrl_ifd_state_change]: Starting Flowd DOWN timer. Apr 9 22:02:21 [jsrpd_jsrxnle_start_flowd_down_timer]: Starting FLOWD down timer: 2 Apr 9 22:02:21 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:21 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fxp0 Apr 9 22:02:21 [jsrpd_ifd_msg_handler]: Interface fxp0 is going down Apr 9 22:02:22 [jsrpd_send_hb]: Failed to send ctrl heartbeat packet on ctrl link(0) with ifl_idx 4, error: Network is down (50) Apr 9 22:02:23 [jsrpd_jsrxnle_flowd_down_timer_callback]: FLOWD down handler. RG-0, state (secondary) Apr 9 22:02:23 [jsrpd_jsrxnle_flowd_down_timer_callback]: FLOWD down handler. RG-1, state (secondary) Apr 9 22:02:23 [jsrpd_jsrxnle_flowd_down_timer_callback]: FLOWD down handler. RG-2, state (secondary) Apr 9 22:02:23 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:23 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fxp2 Apr 9 22:02:23 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface fxp2 is up Apr 9 22:02:24 [jsrpd_send_hb]: Failed to send ctrl heartbeat packet on ctrl link(0) with ifl_idx 4, error: Network is down (50) Apr 9 22:02:25 [jsrpd_tcp_client_msg_handler]: TCP-C: received a TCP msg (len:-1) Apr 9 22:02:25 [jsrpd_tcp_client_msg_handler]: TCP-C: TCP read error (Operation timed out) Apr 9 22:02:25 [jsrpd_tcp_close_client]: TCP-C: Closing TCP Client (Timeout Close) Apr 9 22:02:25 [jsrpd_tcp_client_start_retry_timer]: TCP-C: Started retry timer Apr 9 22:02:25 [jsrpd_send_hb]: Failed to send ctrl heartbeat packet on ctrl link(0) with ifl_idx 4, error: Network is down (50) Apr 9 22:02:26 [jsrpd_tcp_start_client]: Initiating TCP Client Apr 9 22:02:26 [jsrpd_tcp_start_client]: Opened TCP Client client socket (12) Apr 9 22:02:26 [jsrpd_tcp_start_client]: client src ip address is 130.16.0.1/0 Apr 9 22:02:26 [jsrpd_tcp_start_client]: TCP-C: evConnect failed (No route to host) Apr 9 22:02:26 [jsrpd_tcp_start_client]: TCP Client init failed Apr 9 22:02:26 [jsrpd_tcp_close_client]: TCP-C: Closing TCP Client (Connection Error) Apr 9 22:02:26 [jsrpd_tcp_client_start_retry_timer]: TCP-C: Started retry timer Apr 9 22:02:26 [jsrpd_send_hb]: Failed to send ctrl heartbeat packet on ctrl link(0) with ifl_idx 4, error: Network is down (50) Apr 9 22:02:27 [jsrpd_tcp_start_client]: Initiating TCP Client Apr 9 22:02:27 [jsrpd_tcp_start_client]: Opened TCP Client client socket (12) Apr 9 22:02:27 [jsrpd_tcp_start_client]: client src ip address is 130.16.0.1/0 Apr 9 22:02:27 [jsrpd_tcp_start_client]: TCP-C: evConnect failed (No route to host) Apr 9 22:02:27 [jsrpd_tcp_start_client]: TCP Client init failed Apr 9 22:02:27 [jsrpd_tcp_close_client]: TCP-C: Closing TCP Client (Connection Error) Apr 9 22:02:27 [jsrpd_tcp_client_start_retry_timer]: TCP-C: Started retry timer Apr 9 22:02:27 [get_fpc_frm_intf]: printing fpc_num 1 Apr 9 22:02:27 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fxp1 Apr 9 22:02:27 [jsrpd_ctrl_ifd_state_changed]: Interface fxp1 is up. devflags: 0x3, ifdm_flags: 0x0 Apr 9 22:02:27 [jsrpd_jsrxnle_handle_ctrl_ifd_state_change]: Ctrl-link state change: DOWN->UP Apr 9 22:02:27 [jsrpd_jsrxnle_handle_ctrl_ifd_state_change]: Flowd UP, RG-0 state: secondary Apr 9 22:02:27 [jsrpd_uspipc_open]: tnp address from PIC entry for pfe: 0x2100001 Apr 9 22:02:27 [jsrpd_jsrxnle_stop_flowd_down_timer]: Invalid flowd down timer clearing. Ignoring... Apr 9 22:02:27 [jsrpd_bringup_dest_route]: Success to bringup the destination route Apr 9 22:02:27 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:27 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fxp0 Apr 9 22:02:27 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface fxp0 is up Apr 9 22:02:27 [jsrpd_uspipc_event_handler]: uspipc client pfe channel established Apr 9 22:02:27 [jsrpd_fabric_pre_reqs_ready]: fabric_to_child_mapping: 1 uspipc to pfe : 1 ifstate download : 0 Apr 9 22:02:27 [jsrpd_fabmon_hb_attrib_sync]: sync hb: interval=1000(1000) threshold=3(3) p_len=16(16) Apr 9 22:02:27 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:27 [jsrpd_start_or_reset_ctrl_link_timer]: Ctrl-link (0) timer started Apr 9 22:02:27 [fsm_process_hb]: Dropping HB as control link is marked down! Apr 9 22:02:28 [jsrpd_tcp_start_client]: Initiating TCP Client Apr 9 22:02:28 [jsrpd_tcp_start_client]: Opened TCP Client client socket (13) Apr 9 22:02:28 [jsrpd_tcp_start_client]: client src ip address is 130.16.0.1/0 Apr 9 22:02:28 [jsrpd_tcp_start_client]: TCP Client init complete. Connecting to server: 129.16.0.1/62845 Apr 9 22:02:28 [jsrpd_tcp_client_connected]: TCP-C: client connected. Apr 9 22:02:28 [jsrpd_tcp_client_connected]: TCP-C: client connection setup complete Apr 9 22:02:28 [get_fpc_frm_intf]: printing fpc_num Apr 9 22:02:28 [fabric_reth_and_ae_process_intf]: Processing interface state change for:pp0 Apr 9 22:02:28 [jsrpd_ifd_msg_handler]: Interface pp0 is getting deleted Apr 9 22:02:28 [get_fpc_frm_intf]: printing fpc_num Apr 9 22:02:28 last message repeated 2 times Apr 9 22:02:28 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:28 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-0/0/2 Apr 9 22:02:28 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface fe-0/0/2 is up Apr 9 22:02:28 [jsrpd_aggr_db_find_child_and_delete]: ifd fe-0/0/2 is found on aggr_type 1 db delete it from the db Apr 9 22:02:28 [jsrpd_get_aggr_ifd_other_node_status]: aggr interface ???H peer new state 1 peer_active_link 0 mimimum_active_link 0 Apr 9 22:02:28 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:02:28 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:02:28 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:02:28 [jsrpd_calculate_and_update_rg_priority]: Node1-RG1's weight is -255 Apr 9 22:02:28 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-1 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:02:28 [jsrpd_delete_reth_ifl_entry]: successfully deleted the reth0.0 ifl entry Apr 9 22:02:28 [get_fpc_frm_intf]: printing fpc_num h0 Apr 9 22:02:28 [fabric_reth_and_ae_process_intf]: Processing interface state change for:reth0 Apr 9 22:02:28 [jsrpd_ifd_msg_handler]: Interface reth0 is getting deleted Apr 9 22:02:28 [jsrpd_ifd_msg_handler]: Unable to update the reth0 ifd state (32) Apr 9 22:02:28 [jsrpd_delete_reth_ifl_entry]: successfully deleted the reth1.10 ifl entry Apr 9 22:02:28 [jsrpd_delete_reth_ifl_entry]: successfully deleted the reth1.40 ifl entry Apr 9 22:02:28 [jsrpd_delete_reth_ifl_entry]: successfully deleted the reth1.50 ifl entry Apr 9 22:02:28 [jsrpd_delete_reth_ifl_entry]: successfully deleted the reth1.60 ifl entry Apr 9 22:02:28 [jsrpd_delete_reth_ifl_entry]: successfully deleted the reth1.70 ifl entry Apr 9 22:02:28 [jsrpd_delete_reth_ifl_entry]: successfully deleted the reth1.80 ifl entry Apr 9 22:02:28 [jsrpd_delete_reth_ifl_entry]: successfully deleted the reth1.90 ifl entry Apr 9 22:02:28 [jsrpd_delete_reth_ifl_entry]: successfully deleted the reth1.91 ifl entry Apr 9 22:02:28 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:28 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ge-0/0/0 Apr 9 22:02:28 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface ge-0/0/0 is up Apr 9 22:02:28 [jsrpd_aggr_db_find_child_and_delete]: ifd ge-0/0/0 is found on aggr_type 1 db delete it from the db Apr 9 22:02:28 [jsrpd_get_aggr_ifd_other_node_status]: aggr interface ???H peer new state 1 peer_active_link 0 mimimum_active_link 0 Apr 9 22:02:28 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:02:28 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:02:28 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:02:28 [jsrpd_calculate_and_update_rg_priority]: Node1-RG2's weight is -255 Apr 9 22:02:28 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-2 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:02:28 [jsrpd_delete_reth_ifl_entry]: successfully deleted the reth1.92 ifl entry Apr 9 22:02:28 [get_fpc_frm_intf]: printing fpc_num h1 Apr 9 22:02:28 [fabric_reth_and_ae_process_intf]: Processing interface state change for:reth1 Apr 9 22:02:28 [jsrpd_ifd_msg_handler]: Interface reth1 is getting deleted Apr 9 22:02:28 [jsrpd_ifd_msg_handler]: Unable to update the reth1 ifd state (32) Apr 9 22:02:28 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:28 [fabric_reth_and_ae_process_intf]: fab0 deleted Apr 9 22:02:28 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fab0 Apr 9 22:02:28 [jsrpd_ifd_msg_handler]: Interface fab0 is getting deleted Apr 9 22:02:28 [fabric_reth_and_ae_process_intf]: swfab0 marked down, parent id 131 Apr 9 22:02:28 [fabric_reth_and_ae_process_intf]: swfab0 deleted Apr 9 22:02:28 [fabric_reth_and_ae_process_intf]: Processing interface state change for:swfab0 Apr 9 22:02:28 [jsrpd_ifd_msg_handler]: Interface swfab0 is getting deleted Apr 9 22:02:28 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:28 last message repeated 10 times Apr 9 22:02:28 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ge-0/0/0 Apr 9 22:02:28 [jsrpd_ifd_msg_handler]: Interface ge-0/0/0 is getting deleted Apr 9 22:02:28 [jsrpd_update_interface_mon_info]: ge-0/0/0 interface monitored by RG-2 changed state from Up to Down Apr 9 22:02:28 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:02:28 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:02:28 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:02:28 [jsrpd_calculate_and_update_rg_priority]: Node1-RG2's weight is -255 Apr 9 22:02:28 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-2 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:02:28 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:28 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ge-0/0/1 Apr 9 22:02:28 [jsrpd_ifd_msg_handler]: Interface ge-0/0/1 is getting deleted Apr 9 22:02:28 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:28 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-0/0/2 Apr 9 22:02:28 [jsrpd_ifd_msg_handler]: Interface fe-0/0/2 is getting deleted Apr 9 22:02:28 [jsrpd_update_interface_mon_info]: fe-0/0/2 interface monitored by RG-1 changed state from Up to Down Apr 9 22:02:28 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:02:28 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:02:28 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:02:28 [jsrpd_calculate_and_update_rg_priority]: Node1-RG1's weight is -255 Apr 9 22:02:28 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-1 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:02:28 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:28 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-0/0/3 Apr 9 22:02:28 [jsrpd_ifd_msg_handler]: Interface fe-0/0/3 is getting deleted Apr 9 22:02:28 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:28 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-0/0/4 Apr 9 22:02:28 [jsrpd_ifd_msg_handler]: Interface fe-0/0/4 is getting deleted Apr 9 22:02:28 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:28 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-0/0/5 Apr 9 22:02:28 [jsrpd_ifd_msg_handler]: Interface fe-0/0/5 is getting deleted Apr 9 22:02:28 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:28 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-0/0/6 Apr 9 22:02:28 [jsrpd_ifd_msg_handler]: Interface fe-0/0/6 is getting deleted Apr 9 22:02:28 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:28 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-0/0/7 Apr 9 22:02:28 [jsrpd_ifd_msg_handler]: Interface fe-0/0/7 is getting deleted Apr 9 22:02:28 [get_fpc_frm_intf]: printing fpc_num Apr 9 22:02:28 [fabric_reth_and_ae_process_intf]: Processing interface state change for:irb Apr 9 22:02:28 [jsrpd_ifd_msg_handler]: Interface irb is getting deleted Apr 9 22:02:28 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:28 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ip-0/0/0 Apr 9 22:02:28 [jsrpd_ifd_msg_handler]: Interface ip-0/0/0 is getting deleted Apr 9 22:02:28 [get_fpc_frm_intf]: printing fpc_num n Apr 9 22:02:28 [fabric_reth_and_ae_process_intf]: Processing interface state change for:vlan Apr 9 22:02:28 [jsrpd_ifd_msg_handler]: Interface vlan is getting deleted Apr 9 22:02:28 [fabric_reth_and_ae_process_intf]: swfab1 marked down, parent id 149 Apr 9 22:02:28 [fabric_reth_and_ae_process_intf]: swfab1 deleted Apr 9 22:02:28 [fabric_reth_and_ae_process_intf]: Processing interface state change for:swfab1 Apr 9 22:02:28 [jsrpd_ifd_msg_handler]: Interface swfab1 is getting deleted Apr 9 22:02:28 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:28 last message repeated 5 times Apr 9 22:02:28 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ge-2/0/0 Apr 9 22:02:28 [jsrpd_ifd_msg_handler]: Interface ge-2/0/0 is getting deleted Apr 9 22:02:28 [jsrpd_get_aggr_ifd_other_node_status]: aggr interface peer new state 1 peer_active_link 0 mimimum_active_link 0 Apr 9 22:02:28 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:02:28 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:02:28 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:02:28 [jsrpd_calculate_and_update_rg_priority]: Node1-RG2's weight is -255 Apr 9 22:02:28 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-2 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:02:28 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:28 [fsm_process_hb]: Dropping HB as control link is marked down! Apr 9 22:02:29 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:29 [fsm_process_hb]: process HB to trigger possible yield Apr 9 22:02:29 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:30 [jsrpd_sigusr2_handler]: received SIGUSR2, pid 1676 Apr 9 22:02:30 [jsrpd_update_on_sigusr2]: processing SIGUSR2 ... Apr 9 22:02:30 [fsm_set_link_status_timer]: link status timer started, delay=1000 Apr 9 22:02:30 [jsrpd_pfe_rx_ipc_event_handler]: new PFE Rx client connection established (socket id: 21, session 5e6680) Apr 9 22:02:30 [jsrpd_dump_session_list]: session(5e6680) id:1, PFE socket id: 21, Performing ipmon: No Apr 9 22:02:30 [jsrpd_pfe_rx_ipc_msg_handler]: Received Nexthop monitor status Apr 9 22:02:30 [jsrpd_pfe_nexthop_status_update]: Received nexthop status from PFE 0 Apr 9 22:02:30 [jsrpd_loopback_status_dump]: Loopback Status: Apr 9 22:02:30 [jsrpd_loopback_status_dump]: Index: 0 PFE Id: 0, Error_code: 0x00 - Apr 9 22:02:30 [jsrpd_pfe_rx_ipc_msg_handler]: Received HA mbuf monitor status Apr 9 22:02:30 [jsrpd_pfe_mbuf_status_update]: Received mbuf status from PFE 0 Apr 9 22:02:30 [jsrpd_loopback_status_dump]: Loopback Status: Apr 9 22:02:30 [jsrpd_loopback_status_dump]: Index: 0 PFE Id: 0, Error_code: 0x00 - Apr 9 22:02:30 [jsrpd_pfe_rx_ipc_msg_handler]: Received fabric monitor status Apr 9 22:02:30 [jsrpd_pfe_fabmon_status_update]: Received fabric monitor link status from node1 PFE Apr 9 22:02:30 [jsrpd_pfe_fabmon_status_update]: lnk_idx:0 name() ifd_state(curr:0, new:0), pfe_state(curr:0, new:0) Apr 9 22:02:30 [jsrpd_pfe_fabmon_status_update]: lnk_idx:1 name() ifd_state(curr:0, new:0), pfe_state(curr:0, new:0) Apr 9 22:02:30 [jsrpd_pfe_fabmon_status_update]: Fabric link current state: DOWN link up count:0 Apr 9 22:02:30 [jsrpd_fabric_info_dump]: HA Fabric Info: After fabric status is updated Apr 9 22:02:30 [jsrpd_fabric_info_dump]: node0: fab0 is Inactive with 0 child (AggId: 0) Apr 9 22:02:30 [jsrpd_fabric_info_dump]: fab0: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:02:30 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:02:30 [jsrpd_fabric_info_dump]: node1: fab1 is Inactive with 0 child (AggId: 0) Apr 9 22:02:30 [jsrpd_fabric_info_dump]: fab0: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:02:30 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:02:30 [jsrpd_pfe_rx_ipc_msg_handler]: Received fabric monitor status Apr 9 22:02:30 [jsrpd_pfe_fabmon_status_update]: Received fabric monitor link status from node1 PFE Apr 9 22:02:30 [jsrpd_pfe_fabmon_status_update]: lnk_idx:0 name() ifd_state(curr:0, new:0), pfe_state(curr:0, new:0) Apr 9 22:02:30 [jsrpd_pfe_fabmon_status_update]: lnk_idx:1 name() ifd_state(curr:0, new:0), pfe_state(curr:0, new:0) Apr 9 22:02:30 [jsrpd_pfe_fabmon_status_update]: Fabric link current state: DOWN link up count:0 Apr 9 22:02:30 [jsrpd_fabric_info_dump]: HA Fabric Info: After fabric status is updated Apr 9 22:02:30 [jsrpd_fabric_info_dump]: node0: fab0 is Inactive with 0 child (AggId: 0) Apr 9 22:02:30 [jsrpd_fabric_info_dump]: fab0: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:02:30 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:02:30 [jsrpd_fabric_info_dump]: node1: fab1 is Inactive with 0 child (AggId: 0) Apr 9 22:02:30 [jsrpd_fabric_info_dump]: fab0: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:02:30 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:02:30 [get_fpc_frm_intf]: printing fpc_num Apr 9 22:02:30 [get_fpc_frm_intf]: printing fpc_num h0 Apr 9 22:02:30 [fabric_reth_and_ae_process_intf]: Processing interface state change for:reth0 Apr 9 22:02:30 [jsrpd_ifd_msg_handler]: Interface reth0 is going down Apr 9 22:02:30 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:30 [jsrpd_ifd_msg_handler]: reth0 jsrpd not ready Apr 9 22:02:30 [jsrpd_update_interface_mon_info]: ifd reth0 is aggr intf idx 0 aggr type 1 Apr 9 22:02:30 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:30 [jsrpd_update_interface_mon_info]: ifd reth0 is aggr intf idx 0 aggr type 1 Apr 9 22:02:30 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:30 [jsrpd_update_interface_mon_info]: ifd reth0 is aggr intf idx 0 aggr type 1 Apr 9 22:02:30 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:30 [jsrpd_update_reth_ifl_entry]: RG-1 reth0.0, state primary added to reth database Apr 9 22:02:30 [get_fpc_frm_intf]: printing fpc_num h1 Apr 9 22:02:30 [fabric_reth_and_ae_process_intf]: Processing interface state change for:reth1 Apr 9 22:02:30 [jsrpd_ifd_msg_handler]: Interface reth1 is going down Apr 9 22:02:30 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:30 [jsrpd_ifd_msg_handler]: reth1 jsrpd not ready Apr 9 22:02:30 [jsrpd_update_interface_mon_info]: ifd reth1 is aggr intf idx 1 aggr type 1 Apr 9 22:02:30 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:30 [jsrpd_update_interface_mon_info]: ifd reth1 is aggr intf idx 1 aggr type 1 Apr 9 22:02:30 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:30 [jsrpd_update_interface_mon_info]: ifd reth1 is aggr intf idx 1 aggr type 1 Apr 9 22:02:30 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:30 [jsrpd_update_reth_ifl_entry]: RG-2 reth1.92, state primary added to reth database Apr 9 22:02:30 [jsrpd_update_reth_ifl_entry]: RG-2 reth1.91, state primary appended to reth database Apr 9 22:02:30 [jsrpd_update_reth_ifl_entry]: RG-2 reth1.90, state primary appended to reth database Apr 9 22:02:30 [jsrpd_update_reth_ifl_entry]: RG-2 reth1.80, state primary appended to reth database Apr 9 22:02:30 [jsrpd_update_reth_ifl_entry]: RG-2 reth1.70, state primary appended to reth database Apr 9 22:02:30 [jsrpd_update_reth_ifl_entry]: RG-2 reth1.60, state primary appended to reth database Apr 9 22:02:30 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:30 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:30 [jsrpd_update_reth_ifl_entry]: RG-2 reth1.50, state primary appended to reth database Apr 9 22:02:30 [jsrpd_update_reth_ifl_entry]: RG-2 reth1.40, state primary appended to reth database Apr 9 22:02:30 [jsrpd_update_reth_ifl_entry]: RG-2 reth1.10, state primary appended to reth database Apr 9 22:02:31 [fabric_reth_and_ae_process_intf]: fab0 marked up Apr 9 22:02:31 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fab0 Apr 9 22:02:31 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface fab0 is up Apr 9 22:02:31 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:31 [fabric_reth_and_ae_process_intf]: swfab0 marked down, parent id 131 Apr 9 22:02:31 [fabric_reth_and_ae_process_intf]: Processing interface state change for:swfab0 Apr 9 22:02:31 [jsrpd_ifd_msg_handler]: Interface swfab0 is going down Apr 9 22:02:31 [fsm_process_link_status_event]: Processing link status event Apr 9 22:02:31 [jsrpd_jsrxnle_get_link_status]: control link up count:1 Apr 9 22:02:31 [jsrpd_jsrxnle_get_link_status]: fabric link up count:0 Apr 9 22:02:31 [jsrpd_fabric_pre_reqs_ready]: fabric_to_child_mapping: 1 uspipc to pfe : 1 ifstate download : 0 Apr 9 22:02:31 [fsm_process_link_status_event]: control link UP/UP fabric link DOWN/DOWN Apr 9 22:02:31 [fsm_process_link_status_event]: no change to both control (UP) and fabric (DOWN) link status Apr 9 22:02:31 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:31 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ge-0/0/1 Apr 9 22:02:31 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface ge-0/0/1 is up Apr 9 22:02:31 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:31 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ge-0/0/0 Apr 9 22:02:31 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface ge-0/0/0 is up Apr 9 22:02:31 [jsrpd_update_interface_mon_info]: ge-0/0/0 interface monitored by RG-2 changed state from Down to Up Apr 9 22:02:31 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:02:31 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:02:31 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:02:31 [jsrpd_calculate_and_update_rg_priority]: Node1-RG2's weight is -255 Apr 9 22:02:31 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-2 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:02:31 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:31 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-0/0/3 Apr 9 22:02:31 [jsrpd_ifd_msg_handler]: Interface fe-0/0/3 is going down Apr 9 22:02:31 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:31 last message repeated 9 times Apr 9 22:02:31 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-0/0/2 Apr 9 22:02:31 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface fe-0/0/2 is up Apr 9 22:02:31 [jsrpd_update_interface_mon_info]: fe-0/0/2 interface monitored by RG-1 changed state from Down to Up Apr 9 22:02:31 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:02:31 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:02:31 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:02:31 [jsrpd_calculate_and_update_rg_priority]: Node1-RG1's weight is -255 Apr 9 22:02:31 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-1 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:02:31 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:31 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-0/0/4 Apr 9 22:02:31 [jsrpd_ifd_msg_handler]: Interface fe-0/0/4 is going down Apr 9 22:02:31 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:31 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-0/0/5 Apr 9 22:02:31 [jsrpd_ifd_msg_handler]: Interface fe-0/0/5 is going down Apr 9 22:02:31 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:31 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-0/0/6 Apr 9 22:02:31 [jsrpd_ifd_msg_handler]: Interface fe-0/0/6 is going down Apr 9 22:02:31 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:31 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-0/0/7 Apr 9 22:02:31 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface fe-0/0/7 is up Apr 9 22:02:31 [get_fpc_frm_intf]: printing fpc_num Apr 9 22:02:31 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:31 [get_fpc_frm_intf]: printing fpc_num h1 Apr 9 22:02:31 [fabric_reth_and_ae_process_intf]: Processing interface state change for:reth1 Apr 9 22:02:31 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface reth1 is up Apr 9 22:02:31 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:31 [jsrpd_ifd_msg_handler]: reth1 jsrpd not ready Apr 9 22:02:31 [jsrpd_update_interface_mon_info]: ifd reth1 is aggr intf idx 1 aggr type 1 Apr 9 22:02:31 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:31 [jsrpd_update_interface_mon_info]: ifd reth1 is aggr intf idx 1 aggr type 1 Apr 9 22:02:31 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:31 [jsrpd_update_interface_mon_info]: ifd reth1 is aggr intf idx 1 aggr type 1 Apr 9 22:02:31 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:31 [fabric_reth_and_ae_process_intf]: ifd ge-0/0/0 state change may let reth or ae 1 1 state change Apr 9 22:02:31 [jsrpd_add_aggr_child]: Found empty entry; adding child ge-0/0/0 at index 0 mac: 28:8a:1c:d8:5e:58:, prefix: ge fpc: 0 pic: 0, port: 0, child count: 1 Apr 9 22:02:31 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:31 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface ge-0/0/0 is up Apr 9 22:02:31 [jsrpd_update_interface_mon_info]: ifd ge-0/0/0 has parent aggr id 1 aggr type 1 Apr 9 22:02:31 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:31 [jsrpd_update_interface_mon_info]: ifd ge-0/0/0 has parent aggr id 1 aggr type 1 Apr 9 22:02:31 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:31 [jsrpd_update_interface_mon_info]: ifd ge-0/0/0 has parent aggr id 1 aggr type 1 Apr 9 22:02:31 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:31 [jsrpd_get_aggr_ifd_other_node_status]: peer child name ge-0/0/0 Apr 9 22:02:31 [jsrpd_get_aggr_ifd_other_node_status]: aggr interface reth1 peer new state 1 peer_active_link 1 mimimum_active_link 1 Apr 9 22:02:31 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:02:31 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:02:31 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:02:31 [jsrpd_calculate_and_update_rg_priority]: Node1-RG2's weight is -255 Apr 9 22:02:31 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-2 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:02:31 [jsrpd_find_and_update_ifl]: RG-2 reth1.91, state primary updated in reth database Apr 9 22:02:31 [jsrpd_find_and_update_ifl]: RG-2 reth1.92, state primary updated in reth database Apr 9 22:02:31 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:31 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ge-2/0/0 Apr 9 22:02:31 [jsrpd_ifd_msg_handler]: Interface ge-2/0/0 is going down Apr 9 22:02:31 [jsrpd_get_aggr_ifd_other_node_status]: aggr interface peer new state 1 peer_active_link 0 mimimum_active_link 0 Apr 9 22:02:31 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:02:31 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:02:31 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:02:31 [jsrpd_calculate_and_update_rg_priority]: Node1-RG2's weight is -255 Apr 9 22:02:31 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-2 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:02:31 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:31 [jsrpd_find_and_update_ifl]: RG-2 reth1.90, state primary updated in reth database Apr 9 22:02:31 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:31 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/2 Apr 9 22:02:31 [jsrpd_ifd_msg_handler]: Interface fe-2/0/2 is going down Apr 9 22:02:31 [jsrpd_get_aggr_ifd_other_node_status]: aggr interface peer new state 1 peer_active_link 0 mimimum_active_link 0 Apr 9 22:02:31 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:02:31 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:02:31 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:02:31 [jsrpd_calculate_and_update_rg_priority]: Node1-RG1's weight is -255 Apr 9 22:02:31 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-1 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:02:31 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:31 [get_fpc_frm_intf]: printing fpc_num h0 Apr 9 22:02:31 [fabric_reth_and_ae_process_intf]: Processing interface state change for:reth0 Apr 9 22:02:31 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface reth0 is up Apr 9 22:02:31 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:31 [jsrpd_ifd_msg_handler]: reth0 jsrpd not ready Apr 9 22:02:31 [jsrpd_update_interface_mon_info]: ifd reth0 is aggr intf idx 0 aggr type 1 Apr 9 22:02:31 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:31 [jsrpd_update_interface_mon_info]: ifd reth0 is aggr intf idx 0 aggr type 1 Apr 9 22:02:31 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:31 [jsrpd_update_interface_mon_info]: ifd reth0 is aggr intf idx 0 aggr type 1 Apr 9 22:02:31 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:31 [fabric_reth_and_ae_process_intf]: ifd fe-0/0/2 state change may let reth or ae 1 0 state change Apr 9 22:02:31 [jsrpd_add_aggr_child]: Found empty entry; adding child fe-0/0/2 at index 0 mac: 28:8a:1c:d8:5e:5a:, prefix: fe fpc: 0 pic: 0, port: 2, child count: 1 Apr 9 22:02:31 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:31 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface fe-0/0/2 is up Apr 9 22:02:31 [jsrpd_update_interface_mon_info]: ifd fe-0/0/2 has parent aggr id 0 aggr type 1 Apr 9 22:02:31 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:31 [jsrpd_update_interface_mon_info]: ifd fe-0/0/2 has parent aggr id 0 aggr type 1 Apr 9 22:02:31 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:31 [jsrpd_get_aggr_ifd_other_node_status]: peer child name fe-0/0/2 Apr 9 22:02:31 [jsrpd_get_aggr_ifd_other_node_status]: aggr interface reth0 peer new state 1 peer_active_link 1 mimimum_active_link 1 Apr 9 22:02:31 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:02:31 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:02:31 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:02:31 [jsrpd_calculate_and_update_rg_priority]: Node1-RG1's weight is -255 Apr 9 22:02:31 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-1 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:02:31 [jsrpd_update_interface_mon_info]: ifd fe-0/0/2 has parent aggr id 0 aggr type 1 Apr 9 22:02:31 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:31 [jsrpd_find_and_update_ifl]: RG-1 reth0.0, state primary updated in reth database Apr 9 22:02:31 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:31 [jsrpd_find_and_update_ifl]: RG-2 reth1.50, state primary updated in reth database Apr 9 22:02:31 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:31 [jsrpd_find_and_update_ifl]: RG-2 reth1.80, state primary updated in reth database Apr 9 22:02:31 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:31 [jsrpd_find_and_update_ifl]: RG-2 reth1.70, state primary updated in reth database Apr 9 22:02:31 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:31 [jsrpd_find_and_update_ifl]: RG-2 reth1.10, state primary updated in reth database Apr 9 22:02:31 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:31 [jsrpd_find_and_update_ifl]: RG-2 reth1.40, state primary updated in reth database Apr 9 22:02:31 [get_fpc_frm_intf]: printing fpc_num Apr 9 22:02:31 [fabric_reth_and_ae_process_intf]: Processing interface state change for:pp0 Apr 9 22:02:31 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface pp0 is up Apr 9 22:02:31 [get_fpc_frm_intf]: printing fpc_num Apr 9 22:02:31 [fabric_reth_and_ae_process_intf]: Processing interface state change for:irb Apr 9 22:02:31 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface irb is up Apr 9 22:02:31 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:31 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ip-0/0/0 Apr 9 22:02:31 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface ip-0/0/0 is up Apr 9 22:02:31 [get_fpc_frm_intf]: printing fpc_num n Apr 9 22:02:31 [fabric_reth_and_ae_process_intf]: Processing interface state change for:vlan Apr 9 22:02:31 [jsrpd_ifd_msg_handler]: Interface vlan is going down Apr 9 22:02:31 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:31 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:31 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:31 [jsrpd_find_and_update_ifl]: RG-2 reth1.60, state primary updated in reth database Apr 9 22:02:32 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:32 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:33 [fabric_reth_and_ae_process_intf]: swfab1 marked down, parent id 149 Apr 9 22:02:33 [fabric_reth_and_ae_process_intf]: Processing interface state change for:swfab1 Apr 9 22:02:33 [jsrpd_ifd_msg_handler]: Interface swfab1 is going down Apr 9 22:02:33 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:33 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:34 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:35 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:37 [check_is_schedule_slip]: JSRPD scheduling delay for (3258 ms) Apr 9 22:02:37 [check_is_schedule_slip]: Schedule slip detected, jsrpd delay for 3258 ms, threshold: 3000 ms (HB interval: 1000 ms) Apr 9 22:02:37 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:02:37 [jsrpd_calculate_and_update_rg_priority]: Node1-RG0's weight is 255 Apr 9 22:02:37 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-0 is 255. Failures: none Apr 9 22:02:37 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:02:37 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:02:37 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:02:37 [jsrpd_calculate_and_update_rg_priority]: Node1-RG1's weight is -255 Apr 9 22:02:37 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-1 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:02:37 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:02:37 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:02:37 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:02:37 [jsrpd_calculate_and_update_rg_priority]: Node1-RG2's weight is -255 Apr 9 22:02:37 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-2 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:02:37 [jsrpd_sched_mon_slip_check]: Detected schedule slip Apr 9 22:02:37 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:37 [update_ctrl_hb_counter]: JSRPD noticed jitter on control heartbeat Apr 9 22:02:37 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:37 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:37 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:37 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:37 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:38 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:38 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:39 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:39 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:40 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:40 [fabric_reth_and_ae_process_intf]: Processing interface state change for:gr-0/0/0 Apr 9 22:02:40 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface gr-0/0/0 is up Apr 9 22:02:40 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:40 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ppd0 Apr 9 22:02:40 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface ppd0 is up Apr 9 22:02:40 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:40 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ppe0 Apr 9 22:02:40 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface ppe0 is up Apr 9 22:02:40 [get_fpc_frm_intf]: printing fpc_num Apr 9 22:02:40 [fabric_reth_and_ae_process_intf]: Processing interface state change for:st0 Apr 9 22:02:40 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface st0 is up Apr 9 22:02:40 [fabric_reth_and_ae_process_intf]: fab0 marked up Apr 9 22:02:40 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fab0 Apr 9 22:02:40 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface fab0 is up Apr 9 22:02:40 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:40 [jsrpd_process_fab_chld]: Adding fab0 child ge-0/0/1 to the database Apr 9 22:02:40 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:40 [jsrpd_add_chld_fab_lnk]: extracting node_id 0 slot 0 Apr 9 22:02:40 [jsrpd_fabric_info_dump]: HA Fabric Info: After child add Apr 9 22:02:40 [jsrpd_fabric_info_dump]: node0: fab0 is Active with 1 child (AggId: 130) Apr 9 22:02:40 [jsrpd_fabric_info_dump]: fab0: ge-0/0/1 (0/0/1) is Active : ifd_state: Down pfe_state: Down Apr 9 22:02:40 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:02:40 [jsrpd_fabric_info_dump]: node1: fab1 is Inactive with 0 child (AggId: 0) Apr 9 22:02:40 [jsrpd_fabric_info_dump]: fab0: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:02:40 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:02:40 [jsrpd_process_fab_chld]: fab0 child ge-0/0/1 is up Apr 9 22:02:40 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ge-0/0/1 Apr 9 22:02:40 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface ge-0/0/1 is up Apr 9 22:02:40 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:02:40 [fabric_reth_and_ae_process_intf]: ifd ge-2/0/0 state change may let reth or ae 1 1 state change Apr 9 22:02:40 [jsrpd_add_aggr_child]: Found empty entry; adding child ge-2/0/0 at index 1 mac: 10:0e:7e:49:46:80:, prefix: ge fpc: 2 pic: 0, port: 0, child count: 2 Apr 9 22:02:40 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:40 [jsrpd_ifd_msg_handler]: Interface ge-2/0/0 is going down Apr 9 22:02:40 [jsrpd_update_interface_mon_info]: ifd ge-2/0/0 has parent aggr id 1 aggr type 1 Apr 9 22:02:40 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:40 [jsrpd_update_interface_mon_info]: ifd ge-2/0/0 has parent aggr id 1 aggr type 1 Apr 9 22:02:40 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:40 [jsrpd_update_interface_mon_info]: ifd ge-2/0/0 has parent aggr id 1 aggr type 1 Apr 9 22:02:40 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:40 [jsrpd_get_aggr_ifd_other_node_status]: peer child name ge-0/0/0 Apr 9 22:02:40 [jsrpd_get_aggr_ifd_other_node_status]: aggr interface reth1 peer new state 1 peer_active_link 1 mimimum_active_link 1 Apr 9 22:02:40 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:02:40 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:02:40 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:02:40 [jsrpd_calculate_and_update_rg_priority]: Node1-RG2's weight is -255 Apr 9 22:02:40 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-2 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:02:40 [jsrpd_find_and_update_ifl]: RG-2 reth1.10, state primary updated in reth database Apr 9 22:02:40 [jsrpd_find_and_update_ifl]: RG-2 reth1.40, state primary updated in reth database Apr 9 22:02:40 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:40 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ge-2/0/1 Apr 9 22:02:40 [jsrpd_ifd_msg_handler]: Interface ge-2/0/1 is going down Apr 9 22:02:40 [jsrpd_find_and_update_ifl]: RG-2 reth1.50, state primary updated in reth database Apr 9 22:02:40 [jsrpd_pfe_rx_ipc_msg_handler]: Received fabric monitor status Apr 9 22:02:40 [jsrpd_pfe_fabmon_status_update]: Received fabric monitor link status from node1 PFE Apr 9 22:02:40 [jsrpd_pfe_fabmon_status_update]: lnk_idx:0 name() ifd_state(curr:0, new:0), pfe_state(curr:0, new:0) Apr 9 22:02:40 [jsrpd_pfe_fabmon_status_update]: lnk_idx:1 name() ifd_state(curr:0, new:0), pfe_state(curr:0, new:0) Apr 9 22:02:40 [jsrpd_pfe_fabmon_status_update]: Fabric link current state: DOWN link up count:0 Apr 9 22:02:40 [jsrpd_fabric_info_dump]: HA Fabric Info: After fabric status is updated Apr 9 22:02:40 [jsrpd_fabric_info_dump]: node0: fab0 is Active with 1 child (AggId: 130) Apr 9 22:02:40 [jsrpd_fabric_info_dump]: fab0: ge-0/0/1 (0/0/1) is Active : ifd_state: Up pfe_state: Down Apr 9 22:02:40 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:02:40 [jsrpd_fabric_info_dump]: node1: fab1 is Inactive with 0 child (AggId: 0) Apr 9 22:02:40 [jsrpd_fabric_info_dump]: fab0: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:02:40 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:02:40 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:40 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/3 Apr 9 22:02:40 [jsrpd_ifd_msg_handler]: Interface fe-2/0/3 is going down Apr 9 22:02:40 [jsrpd_find_and_update_ifl]: RG-2 reth1.60, state primary updated in reth database Apr 9 22:02:40 [jsrpd_find_and_update_ifl]: RG-2 reth1.70, state primary updated in reth database Apr 9 22:02:40 [jsrpd_find_and_update_ifl]: RG-2 reth1.80, state primary updated in reth database Apr 9 22:02:40 [jsrpd_find_and_update_ifl]: RG-2 reth1.90, state primary updated in reth database Apr 9 22:02:40 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:40 [jsrpd_find_and_update_ifl]: RG-2 reth1.91, state primary updated in reth database Apr 9 22:02:40 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:40 [jsrpd_find_and_update_ifl]: RG-2 reth1.92, state primary updated in reth database Apr 9 22:02:40 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:40 [jsrpd_update_reth_ifl_entry]: RG-2 reth1.32767, state primary appended to reth database Apr 9 22:02:40 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:40 [fabric_reth_and_ae_process_intf]: ifd fe-2/0/2 state change may let reth or ae 1 0 state change Apr 9 22:02:40 [jsrpd_add_aggr_child]: Found empty entry; adding child fe-2/0/2 at index 1 mac: 10:0e:7e:49:46:82:, prefix: fe fpc: 2 pic: 0, port: 2, child count: 2 Apr 9 22:02:40 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:40 [jsrpd_ifd_msg_handler]: Interface fe-2/0/2 is going down Apr 9 22:02:40 [jsrpd_update_interface_mon_info]: ifd fe-2/0/2 has parent aggr id 0 aggr type 1 Apr 9 22:02:40 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:40 [jsrpd_update_interface_mon_info]: ifd fe-2/0/2 has parent aggr id 0 aggr type 1 Apr 9 22:02:40 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:40 [jsrpd_get_aggr_ifd_other_node_status]: peer child name fe-0/0/2 Apr 9 22:02:40 [jsrpd_get_aggr_ifd_other_node_status]: aggr interface reth0 peer new state 1 peer_active_link 1 mimimum_active_link 1 Apr 9 22:02:40 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:02:40 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:02:40 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:02:40 [jsrpd_calculate_and_update_rg_priority]: Node1-RG1's weight is -255 Apr 9 22:02:40 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-1 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:02:40 [jsrpd_update_interface_mon_info]: ifd fe-2/0/2 has parent aggr id 0 aggr type 1 Apr 9 22:02:40 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:02:40 [jsrpd_find_and_update_ifl]: RG-1 reth0.0, state primary updated in reth database Apr 9 22:02:40 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:40 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/4 Apr 9 22:02:40 [jsrpd_ifd_msg_handler]: Interface fe-2/0/4 is going down Apr 9 22:02:40 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:40 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/5 Apr 9 22:02:40 [jsrpd_ifd_msg_handler]: Interface fe-2/0/5 is going down Apr 9 22:02:40 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:40 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/6 Apr 9 22:02:40 [jsrpd_ifd_msg_handler]: Interface fe-2/0/6 is going down Apr 9 22:02:40 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:02:40 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/7 Apr 9 22:02:40 [jsrpd_ifd_msg_handler]: Interface fe-2/0/7 is going down Apr 9 22:02:40 [jsrpd_fabric_info_dump]: HA Fabric Info: Before populated from blob Apr 9 22:02:40 [jsrpd_fabric_info_dump]: node0: fab0 is Active with 1 child (AggId: 130) Apr 9 22:02:40 [jsrpd_fabric_info_dump]: fab0: ge-0/0/1 (0/0/1) is Active : ifd_state: Up pfe_state: Down Apr 9 22:02:40 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:02:40 [jsrpd_fabric_info_dump]: node1: fab1 is Inactive with 0 child (AggId: 0) Apr 9 22:02:40 [jsrpd_fabric_info_dump]: fab0: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:02:40 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:02:40 [jsrpd_fabric_info_dump]: HA Fabric Info: After populated from blob Apr 9 22:02:40 [jsrpd_fabric_info_dump]: node0: fab0 is Active with 1 child (AggId: 130) Apr 9 22:02:40 [jsrpd_fabric_info_dump]: fab0: ge-0/0/1 (0/0/1) is Active : ifd_state: Up pfe_state: Down Apr 9 22:02:40 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:02:40 [jsrpd_fabric_info_dump]: node1: fab1 is Inactive with 0 child (AggId: 0) Apr 9 22:02:40 [jsrpd_fabric_info_dump]: fab0: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:02:40 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:02:40 [jsrpd_gencfg_msg_handler]: blob major_type:2 minor_type: 76 Apr 9 22:02:40 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:40 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:41 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:41 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:42 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:42 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:43 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:43 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:44 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:44 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:45 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:45 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:46 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:46 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:47 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:47 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:48 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:48 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:49 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:49 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:50 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:50 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:51 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:51 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:52 [jsrpd_pfe_rx_ipc_msg_handler]: received ifstate download status message: type 1032, sub-type 46, length 2 Apr 9 22:02:52 [jsrpd_handle_pfe_ifstate_status_msg]: ifstate status message received from PFE: 0, status: 0x1 Apr 9 22:02:52 [jsrpd_set_pfe_ifstate_download_status]: PFE ifstate download status set to 1 Apr 9 22:02:52 [jsrpd_fabric_pre_reqs_ready]: fabric_to_child_mapping: 1 uspipc to pfe : 1 ifstate download : 1 Apr 9 22:02:52 [jsrpd_set_fabric_dead_timer]: fabric probe dead timer not started since fab-mon is suspended Apr 9 22:02:52 [jsrpd_pfe_rx_ipc_msg_handler]: received coldsync status message: type 1032, sub-type 45, length 82 Apr 9 22:02:52 [jsrpd_handle_pfe_cs_status_msg]: coldsync status message received from PFE: 0, status: 0x6 Apr 9 22:02:52 [jsrpd_handle_pfe_cs_status_msg]: Cold-sync progress for PFE: 0. Prereq_0: 1 RTO_0: 0, Postreq_0: 0 Info: 0 Apr 9 22:02:52 [jsrpd_pfe_rx_ipc_msg_handler]: received coldsync status message: type 1032, sub-type 45, length 82 Apr 9 22:02:52 [jsrpd_handle_pfe_cs_status_msg]: coldsync status message received from PFE: 0, status: 0x6 Apr 9 22:02:52 [jsrpd_handle_pfe_cs_status_msg]: Cold-sync progress for PFE: 0. Prereq_0: 5 RTO_0: 0, Postreq_0: 0 Info: 0 Apr 9 22:02:52 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:52 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:53 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:53 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:54 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:54 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:55 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:55 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:57 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:57 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:58 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:58 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:02:59 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:02:59 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:00 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:00 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:01 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:01 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:02 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:02 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:03 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:03 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:04 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:04 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:05 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:05 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:06 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:06 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:07 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:07 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:08 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:08 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:09 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:09 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:10 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:10 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:11 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:11 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:11 [jsrpd_pfe_rx_ipc_event_handler]: PFE Rx client is shutdown (socket id: 21, session 5e6680) Apr 9 22:03:11 [jsrpd_dump_session_list]: session list is empty Apr 9 22:03:11 [jsrpd_uspipc_event_handler]: uspipc client pfe channel is shutdown due to idle timeout or error in receiving msg or pfe going down.Reconnecting to pfe.. Apr 9 22:03:11 [jsrpd_uspipc_event_handler]: usp ipc connection shutdown, suspending fabric monitoring Apr 9 22:03:11 [jsrpd_clear_fabric_dead_timer]: fabric timer never started dead timer not stopped Apr 9 22:03:11 [jsrpd_uspipc_open]: tnp address from PIC entry for pfe: 0x2100001 Apr 9 22:03:11 [get_fpc_frm_intf]: printing fpc_num 1 Apr 9 22:03:11 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fxp1 Apr 9 22:03:11 [jsrpd_ctrl_ifd_state_changed]: Interface fxp1 is down. devflags: 0x3, ifdm_flags: 0x8 Apr 9 22:03:11 [jsrpd_jsrxnle_handle_ctrl_ifd_state_change]: Ctrl-link state change: UP->DOWN Apr 9 22:03:11 [jsrpd_jsrxnle_handle_ctrl_ifd_state_change]: Flowd down, RG-0 state: secondary Apr 9 22:03:11 [jsrpd_jsrxnle_handle_ctrl_ifd_state_change]: Flowd down, set control link status DOWN Apr 9 22:03:11 [jsrpd_set_pfe_ifstate_download_status]: PFE ifstate download status set to 0 Apr 9 22:03:11 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:03:11 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:03:11 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:03:11 [jsrpd_calculate_and_update_rg_priority]: Node1-RG1's weight is -255 Apr 9 22:03:11 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-1 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:03:11 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:03:11 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:03:11 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:03:11 [jsrpd_calculate_and_update_rg_priority]: Node1-RG2's weight is -255 Apr 9 22:03:11 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-2 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:03:11 [jsrpd_jsrxnle_handle_ctrl_ifd_state_change]: Starting Flowd DOWN timer. Apr 9 22:03:11 [jsrpd_jsrxnle_start_flowd_down_timer]: Starting FLOWD down timer: 1 Apr 9 22:03:11 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:03:11 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fxp0 Apr 9 22:03:11 [jsrpd_ifd_msg_handler]: Interface fxp0 is going down Apr 9 22:03:12 [jsrpd_send_hb]: Failed to send ctrl heartbeat packet on ctrl link(0) with ifl_idx 4, error: Network is down (50) Apr 9 22:03:12 [jsrpd_jsrxnle_flowd_down_timer_callback]: FLOWD down handler. RG-0, state (secondary) Apr 9 22:03:12 [jsrpd_jsrxnle_flowd_down_timer_callback]: FLOWD down handler. RG-1, state (secondary) Apr 9 22:03:12 [jsrpd_jsrxnle_flowd_down_timer_callback]: FLOWD down handler. RG-2, state (secondary) Apr 9 22:03:12 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:12 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fxp2 Apr 9 22:03:12 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface fxp2 is up Apr 9 22:03:13 [jsrpd_send_hb]: Failed to send ctrl heartbeat packet on ctrl link(0) with ifl_idx 4, error: Network is down (50) Apr 9 22:03:13 [jsrpd_uspipc_event_handler]: uspipc client pfe channel established Apr 9 22:03:13 [jsrpd_fabric_pre_reqs_ready]: fabric_to_child_mapping: 1 uspipc to pfe : 1 ifstate download : 0 Apr 9 22:03:13 [jsrpd_fabmon_hb_attrib_sync]: sync hb: interval=1000(1000) threshold=3(3) p_len=16(16) Apr 9 22:03:13 [jsrpd_uspipc_event_handler]: uspipc client pfe channel is shutdown due to idle timeout or error in receiving msg or pfe going down.Reconnecting to pfe.. Apr 9 22:03:13 [jsrpd_uspipc_event_handler]: usp ipc connection shutdown, suspending fabric monitoring Apr 9 22:03:13 [jsrpd_clear_fabric_dead_timer]: fabric timer never started dead timer not stopped Apr 9 22:03:13 [get_fpc_frm_intf]: printing fpc_num 1 Apr 9 22:03:13 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fxp1 Apr 9 22:03:13 [jsrpd_ctrl_ifd_state_changed]: Interface fxp1 is up. devflags: 0x3, ifdm_flags: 0x0 Apr 9 22:03:13 [jsrpd_jsrxnle_handle_ctrl_ifd_state_change]: Ctrl-link state change: DOWN->UP Apr 9 22:03:13 [jsrpd_jsrxnle_handle_ctrl_ifd_state_change]: Flowd UP, RG-0 state: secondary Apr 9 22:03:13 [jsrpd_uspipc_open]: tnp address from PIC entry for pfe: 0x2100001 Apr 9 22:03:13 [jsrpd_jsrxnle_stop_flowd_down_timer]: Invalid flowd down timer clearing. Ignoring... Apr 9 22:03:13 [jsrpd_bringup_dest_route]: Success to bringup the destination route Apr 9 22:03:13 [jsrpd_uspipc_event_handler]: uspipc client pfe channel established Apr 9 22:03:13 [jsrpd_fabric_pre_reqs_ready]: fabric_to_child_mapping: 1 uspipc to pfe : 1 ifstate download : 0 Apr 9 22:03:13 [jsrpd_fabmon_hb_attrib_sync]: sync hb: interval=1000(1000) threshold=3(3) p_len=16(16) Apr 9 22:03:13 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:03:13 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fxp0 Apr 9 22:03:13 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface fxp0 is up Apr 9 22:03:14 [fabric_reth_and_ae_process_intf]: ifd ge-2/0/0 state change may let reth or ae 1 1 state change Apr 9 22:03:14 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:03:14 [jsrpd_ifd_msg_handler]: Interface ge-2/0/0 is going down Apr 9 22:03:14 [jsrpd_update_interface_mon_info]: ifd ge-2/0/0 has parent aggr id 1 aggr type 1 Apr 9 22:03:14 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:03:14 [jsrpd_update_interface_mon_info]: ifd ge-2/0/0 has parent aggr id 1 aggr type 1 Apr 9 22:03:14 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:03:14 [jsrpd_update_interface_mon_info]: ifd ge-2/0/0 has parent aggr id 1 aggr type 1 Apr 9 22:03:14 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:03:14 [jsrpd_get_aggr_ifd_other_node_status]: peer child name ge-0/0/0 Apr 9 22:03:14 [jsrpd_get_aggr_ifd_other_node_status]: aggr interface reth1 peer new state 1 peer_active_link 1 mimimum_active_link 1 Apr 9 22:03:14 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:03:14 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:03:14 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:03:14 [jsrpd_calculate_and_update_rg_priority]: Node1-RG2's weight is -255 Apr 9 22:03:14 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-2 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:03:14 [jsrpd_find_and_update_ifl]: RG-2 reth1.10, state primary updated in reth database Apr 9 22:03:14 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:14 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ge-2/0/1 Apr 9 22:03:14 [jsrpd_ifd_msg_handler]: Interface ge-2/0/1 is going down Apr 9 22:03:14 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:14 [fabric_reth_and_ae_process_intf]: ifd fe-2/0/2 state change may let reth or ae 1 0 state change Apr 9 22:03:14 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:03:14 [jsrpd_ifd_msg_handler]: Interface fe-2/0/2 is going down Apr 9 22:03:14 [jsrpd_update_interface_mon_info]: ifd fe-2/0/2 has parent aggr id 0 aggr type 1 Apr 9 22:03:14 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:03:14 [jsrpd_update_interface_mon_info]: ifd fe-2/0/2 has parent aggr id 0 aggr type 1 Apr 9 22:03:14 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:03:14 [jsrpd_get_aggr_ifd_other_node_status]: peer child name fe-0/0/2 Apr 9 22:03:14 [jsrpd_get_aggr_ifd_other_node_status]: aggr interface reth0 peer new state 1 peer_active_link 1 mimimum_active_link 1 Apr 9 22:03:14 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:03:14 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:03:14 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:03:14 [jsrpd_calculate_and_update_rg_priority]: Node1-RG1's weight is -255 Apr 9 22:03:14 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-1 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:03:14 [jsrpd_update_interface_mon_info]: ifd fe-2/0/2 has parent aggr id 0 aggr type 1 Apr 9 22:03:14 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:03:14 [jsrpd_find_and_update_ifl]: RG-2 reth1.40, state primary updated in reth database Apr 9 22:03:14 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:14 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/3 Apr 9 22:03:14 [jsrpd_ifd_msg_handler]: Interface fe-2/0/3 is going down Apr 9 22:03:14 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:14 [jsrpd_find_and_update_ifl]: RG-2 reth1.50, state primary updated in reth database Apr 9 22:03:14 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:14 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/4 Apr 9 22:03:14 [jsrpd_ifd_msg_handler]: Interface fe-2/0/4 is going down Apr 9 22:03:14 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:14 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/5 Apr 9 22:03:14 [jsrpd_ifd_msg_handler]: Interface fe-2/0/5 is going down Apr 9 22:03:14 [jsrpd_find_and_update_ifl]: RG-2 reth1.60, state primary updated in reth database Apr 9 22:03:14 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:14 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/6 Apr 9 22:03:14 [jsrpd_ifd_msg_handler]: Interface fe-2/0/6 is going down Apr 9 22:03:14 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:14 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/7 Apr 9 22:03:14 [jsrpd_ifd_msg_handler]: Interface fe-2/0/7 is going down Apr 9 22:03:14 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:14 [jsrpd_find_and_update_ifl]: RG-2 reth1.70, state primary updated in reth database Apr 9 22:03:14 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:14 [jsrpd_find_and_update_ifl]: RG-2 reth1.80, state primary updated in reth database Apr 9 22:03:14 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:14 [jsrpd_find_and_update_ifl]: RG-2 reth1.90, state primary updated in reth database Apr 9 22:03:14 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:14 [jsrpd_find_and_update_ifl]: RG-2 reth1.91, state primary updated in reth database Apr 9 22:03:14 [fabric_reth_and_ae_process_intf]: fab1 marked down Apr 9 22:03:14 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fab1 Apr 9 22:03:14 [jsrpd_ifd_msg_handler]: Interface fab1 is going down Apr 9 22:03:14 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:14 [jsrpd_find_and_update_ifl]: RG-2 reth1.92, state primary updated in reth database Apr 9 22:03:14 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:14 [fabric_reth_and_ae_process_intf]: ifd ge-2/0/0 state change may let reth or ae 1 1 state change Apr 9 22:03:14 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:03:14 [jsrpd_ifd_msg_handler]: Interface ge-2/0/0 is going down Apr 9 22:03:14 [jsrpd_update_interface_mon_info]: ifd ge-2/0/0 has parent aggr id 1 aggr type 1 Apr 9 22:03:14 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:03:14 [jsrpd_update_interface_mon_info]: ifd ge-2/0/0 has parent aggr id 1 aggr type 1 Apr 9 22:03:14 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:03:14 [jsrpd_update_interface_mon_info]: ifd ge-2/0/0 has parent aggr id 1 aggr type 1 Apr 9 22:03:14 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:03:14 [jsrpd_get_aggr_ifd_other_node_status]: peer child name ge-0/0/0 Apr 9 22:03:14 [jsrpd_get_aggr_ifd_other_node_status]: aggr interface reth1 peer new state 1 peer_active_link 1 mimimum_active_link 1 Apr 9 22:03:14 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:03:14 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:03:14 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:03:14 [jsrpd_calculate_and_update_rg_priority]: Node1-RG2's weight is -255 Apr 9 22:03:14 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-2 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:03:14 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:14 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ge-2/0/0 Apr 9 22:03:14 [jsrpd_ifd_msg_handler]: Interface ge-2/0/0 is going down Apr 9 22:03:14 [jsrpd_aggr_db_find_child_and_delete]: ifd ge-2/0/0 is found on aggr_type 1 db delete it from the db Apr 9 22:03:14 [jsrpd_get_aggr_ifd_other_node_status]: aggr interface ???H peer new state 1 peer_active_link 0 mimimum_active_link 0 Apr 9 22:03:14 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:03:14 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:03:14 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:03:14 [jsrpd_calculate_and_update_rg_priority]: Node1-RG2's weight is -255 Apr 9 22:03:14 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-2 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:03:14 [jsrpd_find_and_update_ifl]: RG-2 reth1.32767, state primary updated in reth database Apr 9 22:03:14 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:14 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ge-2/0/0 Apr 9 22:03:14 [jsrpd_ifd_msg_handler]: Interface ge-2/0/0 is getting deleted Apr 9 22:03:14 [jsrpd_get_aggr_ifd_other_node_status]: aggr interface peer new state 1 peer_active_link 0 mimimum_active_link 0 Apr 9 22:03:14 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:03:14 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:03:14 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:03:14 [jsrpd_calculate_and_update_rg_priority]: Node1-RG2's weight is -255 Apr 9 22:03:14 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-2 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:03:14 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:14 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ge-2/0/1 Apr 9 22:03:14 [jsrpd_ifd_msg_handler]: Interface ge-2/0/1 is getting deleted Apr 9 22:03:15 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:15 [jsrpd_start_or_reset_ctrl_link_timer]: Ctrl-link (0) timer started Apr 9 22:03:15 [fsm_process_hb]: process HB to trigger possible yield Apr 9 22:03:15 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:15 [fabric_reth_and_ae_process_intf]: ifd fe-2/0/2 state change may let reth or ae 1 0 state change Apr 9 22:03:15 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:03:15 [jsrpd_ifd_msg_handler]: Interface fe-2/0/2 is going down Apr 9 22:03:15 [jsrpd_update_interface_mon_info]: ifd fe-2/0/2 has parent aggr id 0 aggr type 1 Apr 9 22:03:15 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:03:15 [jsrpd_update_interface_mon_info]: ifd fe-2/0/2 has parent aggr id 0 aggr type 1 Apr 9 22:03:15 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:03:15 [jsrpd_get_aggr_ifd_other_node_status]: peer child name fe-0/0/2 Apr 9 22:03:15 [jsrpd_get_aggr_ifd_other_node_status]: aggr interface reth0 peer new state 1 peer_active_link 1 mimimum_active_link 1 Apr 9 22:03:15 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:03:15 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:03:15 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:03:15 [jsrpd_calculate_and_update_rg_priority]: Node1-RG1's weight is -255 Apr 9 22:03:15 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-1 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:03:15 [jsrpd_update_interface_mon_info]: ifd fe-2/0/2 has parent aggr id 0 aggr type 1 Apr 9 22:03:15 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:03:15 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:15 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/2 Apr 9 22:03:15 [jsrpd_ifd_msg_handler]: Interface fe-2/0/2 is going down Apr 9 22:03:15 [jsrpd_aggr_db_find_child_and_delete]: ifd fe-2/0/2 is found on aggr_type 1 db delete it from the db Apr 9 22:03:15 [jsrpd_get_aggr_ifd_other_node_status]: aggr interface ???H peer new state 1 peer_active_link 0 mimimum_active_link 0 Apr 9 22:03:15 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:03:15 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:03:15 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:03:15 [jsrpd_calculate_and_update_rg_priority]: Node1-RG1's weight is -255 Apr 9 22:03:15 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-1 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:03:15 [jsrpd_find_and_update_ifl]: RG-1 reth0.0, state primary updated in reth database Apr 9 22:03:15 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:15 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/2 Apr 9 22:03:15 [jsrpd_ifd_msg_handler]: Interface fe-2/0/2 is getting deleted Apr 9 22:03:15 [jsrpd_get_aggr_ifd_other_node_status]: aggr interface peer new state 1 peer_active_link 0 mimimum_active_link 0 Apr 9 22:03:15 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:03:15 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:03:15 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:03:15 [jsrpd_calculate_and_update_rg_priority]: Node1-RG1's weight is -255 Apr 9 22:03:15 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-1 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:03:15 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:15 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/3 Apr 9 22:03:15 [jsrpd_ifd_msg_handler]: Interface fe-2/0/3 is getting deleted Apr 9 22:03:15 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:15 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/4 Apr 9 22:03:15 [jsrpd_ifd_msg_handler]: Interface fe-2/0/4 is getting deleted Apr 9 22:03:15 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:15 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/5 Apr 9 22:03:15 [jsrpd_ifd_msg_handler]: Interface fe-2/0/5 is getting deleted Apr 9 22:03:15 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:15 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/6 Apr 9 22:03:15 [jsrpd_ifd_msg_handler]: Interface fe-2/0/6 is getting deleted Apr 9 22:03:15 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:15 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/7 Apr 9 22:03:15 [jsrpd_ifd_msg_handler]: Interface fe-2/0/7 is getting deleted Apr 9 22:03:15 [fabric_reth_and_ae_process_intf]: fab1 marked down Apr 9 22:03:15 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fab1 Apr 9 22:03:15 [jsrpd_ifd_msg_handler]: Interface fab1 is going down Apr 9 22:03:15 [get_fpc_frm_intf]: printing fpc_num 1 Apr 9 22:03:15 [fabric_reth_and_ae_process_intf]: fab0 marked up Apr 9 22:03:15 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fab0 Apr 9 22:03:15 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface fab0 is up Apr 9 22:03:15 [get_fpc_frm_intf]: printing fpc_num 1 Apr 9 22:03:15 [fabric_reth_and_ae_process_intf]: fab1 marked down Apr 9 22:03:15 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fab1 Apr 9 22:03:15 [jsrpd_ifd_msg_handler]: Interface fab1 is going down Apr 9 22:03:15 [fabric_reth_and_ae_process_intf]: fab1 marked down Apr 9 22:03:15 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fab1 Apr 9 22:03:15 [jsrpd_ifd_msg_handler]: Interface fab1 is going down Apr 9 22:03:15 [get_fpc_frm_intf]: printing fpc_num 1 Apr 9 22:03:15 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:03:15 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-0/0/7 Apr 9 22:03:15 [jsrpd_ifd_msg_handler]: Interface fe-0/0/7 is going down Apr 9 22:03:15 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:03:15 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-0/0/7 Apr 9 22:03:15 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface fe-0/0/7 is up Apr 9 22:03:16 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:16 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:16 [jsrpd_pfe_rx_ipc_event_handler]: new PFE Rx client connection established (socket id: 21, session 5e6600) Apr 9 22:03:16 [jsrpd_dump_session_list]: session(5e6600) id:1, PFE socket id: 21, Performing ipmon: No Apr 9 22:03:16 [jsrpd_pfe_rx_ipc_msg_handler]: Received Nexthop monitor status Apr 9 22:03:16 [jsrpd_pfe_nexthop_status_update]: Received nexthop status from PFE 0 Apr 9 22:03:16 [jsrpd_loopback_status_dump]: Loopback Status: Apr 9 22:03:16 [jsrpd_loopback_status_dump]: Index: 0 PFE Id: 0, Error_code: 0x00 - Apr 9 22:03:16 [jsrpd_pfe_rx_ipc_msg_handler]: Received HA mbuf monitor status Apr 9 22:03:16 [jsrpd_pfe_mbuf_status_update]: Received mbuf status from PFE 0 Apr 9 22:03:16 [jsrpd_loopback_status_dump]: Loopback Status: Apr 9 22:03:16 [jsrpd_loopback_status_dump]: Index: 0 PFE Id: 0, Error_code: 0x00 - Apr 9 22:03:16 [jsrpd_pfe_rx_ipc_msg_handler]: Received fabric monitor status Apr 9 22:03:16 [jsrpd_pfe_fabmon_status_update]: Received fabric monitor link status from node1 PFE Apr 9 22:03:16 [jsrpd_pfe_fabmon_status_update]: lnk_idx:0 name() ifd_state(curr:0, new:0), pfe_state(curr:0, new:0) Apr 9 22:03:16 [jsrpd_pfe_fabmon_status_update]: lnk_idx:1 name() ifd_state(curr:0, new:0), pfe_state(curr:0, new:0) Apr 9 22:03:16 [jsrpd_pfe_fabmon_status_update]: Fabric link current state: DOWN link up count:0 Apr 9 22:03:16 [jsrpd_fabric_info_dump]: HA Fabric Info: After fabric status is updated Apr 9 22:03:16 [jsrpd_fabric_info_dump]: node0: fab0 is Active with 1 child (AggId: 130) Apr 9 22:03:16 [jsrpd_fabric_info_dump]: fab0: ge-0/0/1 (0/0/1) is Active : ifd_state: Up pfe_state: Down Apr 9 22:03:16 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:03:16 [jsrpd_fabric_info_dump]: node1: fab1 is Active with 0 child (AggId: 158) Apr 9 22:03:16 [jsrpd_fabric_info_dump]: fab0: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:03:16 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:03:16 [jsrpd_pfe_rx_ipc_msg_handler]: Received fabric monitor status Apr 9 22:03:16 [jsrpd_pfe_fabmon_status_update]: Received fabric monitor link status from node1 PFE Apr 9 22:03:16 [jsrpd_pfe_fabmon_status_update]: lnk_idx:0 name() ifd_state(curr:0, new:0), pfe_state(curr:0, new:0) Apr 9 22:03:16 [jsrpd_pfe_fabmon_status_update]: lnk_idx:1 name() ifd_state(curr:0, new:0), pfe_state(curr:0, new:0) Apr 9 22:03:16 [jsrpd_pfe_fabmon_status_update]: Fabric link current state: DOWN link up count:0 Apr 9 22:03:16 [jsrpd_fabric_info_dump]: HA Fabric Info: After fabric status is updated Apr 9 22:03:16 [jsrpd_fabric_info_dump]: node0: fab0 is Active with 1 child (AggId: 130) Apr 9 22:03:16 [jsrpd_fabric_info_dump]: fab0: ge-0/0/1 (0/0/1) is Active : ifd_state: Up pfe_state: Down Apr 9 22:03:16 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:03:16 [jsrpd_fabric_info_dump]: node1: fab1 is Active with 0 child (AggId: 158) Apr 9 22:03:16 [jsrpd_fabric_info_dump]: fab0: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:03:16 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:03:17 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:17 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:17 [jsrpd_sigusr2_handler]: received SIGUSR2, pid 1676 Apr 9 22:03:17 [jsrpd_update_on_sigusr2]: processing SIGUSR2 ... Apr 9 22:03:17 [fsm_set_link_status_timer]: link status timer started, delay=1000 Apr 9 22:03:18 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:18 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:18 [fsm_process_link_status_event]: Processing link status event Apr 9 22:03:18 [jsrpd_jsrxnle_get_link_status]: control link up count:1 Apr 9 22:03:18 [jsrpd_jsrxnle_get_link_status]: fabric link up count:0 Apr 9 22:03:18 [jsrpd_fabric_pre_reqs_ready]: fabric_to_child_mapping: 1 uspipc to pfe : 1 ifstate download : 0 Apr 9 22:03:18 [fsm_process_link_status_event]: control link UP/UP fabric link DOWN/DOWN Apr 9 22:03:18 [fsm_process_link_status_event]: no change to both control (UP) and fabric (DOWN) link status Apr 9 22:03:19 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:19 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:20 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:20 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:21 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:21 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:21 [fabric_reth_and_ae_process_intf]: fab1 marked down Apr 9 22:03:21 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fab1 Apr 9 22:03:21 [jsrpd_ifd_msg_handler]: Interface fab1 is going down Apr 9 22:03:21 [get_fpc_frm_intf]: printing fpc_num 1 Apr 9 22:03:22 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:22 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:23 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:23 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:24 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:24 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:25 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:25 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:26 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:26 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:27 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:27 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:27 [jsrpd_pfe_rx_ipc_msg_handler]: received ifstate download status message: type 1032, sub-type 46, length 2 Apr 9 22:03:27 [jsrpd_handle_pfe_ifstate_status_msg]: ifstate status message received from PFE: 0, status: 0x1 Apr 9 22:03:27 [jsrpd_set_pfe_ifstate_download_status]: PFE ifstate download status set to 1 Apr 9 22:03:27 [jsrpd_fabric_pre_reqs_ready]: fabric_to_child_mapping: 1 uspipc to pfe : 1 ifstate download : 1 Apr 9 22:03:27 [jsrpd_set_fabric_dead_timer]: fabric probe dead timer not started since fab-mon is suspended Apr 9 22:03:27 [jsrpd_pfe_rx_ipc_msg_handler]: received coldsync status message: type 1032, sub-type 45, length 82 Apr 9 22:03:27 [jsrpd_handle_pfe_cs_status_msg]: coldsync status message received from PFE: 0, status: 0x6 Apr 9 22:03:27 [jsrpd_handle_pfe_cs_status_msg]: Cold-sync progress for PFE: 0. Prereq_0: 1 RTO_0: 0, Postreq_0: 0 Info: 0 Apr 9 22:03:27 [jsrpd_pfe_rx_ipc_msg_handler]: received coldsync status message: type 1032, sub-type 45, length 82 Apr 9 22:03:27 [jsrpd_handle_pfe_cs_status_msg]: coldsync status message received from PFE: 0, status: 0x6 Apr 9 22:03:27 [jsrpd_handle_pfe_cs_status_msg]: Cold-sync progress for PFE: 0. Prereq_0: 5 RTO_0: 0, Postreq_0: 0 Info: 0 Apr 9 22:03:28 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:28 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:28 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:28 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ge-2/0/0 Apr 9 22:03:28 [jsrpd_ifd_msg_handler]: Interface ge-2/0/0 is going down Apr 9 22:03:28 [jsrpd_get_aggr_ifd_other_node_status]: aggr interface peer new state 1 peer_active_link 0 mimimum_active_link 0 Apr 9 22:03:28 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:03:28 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:03:28 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:03:28 [jsrpd_calculate_and_update_rg_priority]: Node1-RG2's weight is -255 Apr 9 22:03:28 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-2 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:03:28 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:28 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ge-2/0/0 Apr 9 22:03:28 [jsrpd_ifd_msg_handler]: Interface ge-2/0/0 is going down Apr 9 22:03:28 [jsrpd_get_aggr_ifd_other_node_status]: aggr interface peer new state 1 peer_active_link 0 mimimum_active_link 0 Apr 9 22:03:28 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:03:28 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:03:28 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:03:28 [jsrpd_calculate_and_update_rg_priority]: Node1-RG2's weight is -255 Apr 9 22:03:28 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-2 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:03:28 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:28 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ge-2/0/1 Apr 9 22:03:28 [jsrpd_ifd_msg_handler]: Interface ge-2/0/1 is going down Apr 9 22:03:28 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:28 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ge-2/0/0 Apr 9 22:03:28 [jsrpd_ifd_msg_handler]: Interface ge-2/0/0 is going down Apr 9 22:03:28 [jsrpd_get_aggr_ifd_other_node_status]: aggr interface peer new state 1 peer_active_link 0 mimimum_active_link 0 Apr 9 22:03:28 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:03:28 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:03:28 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:03:28 [jsrpd_calculate_and_update_rg_priority]: Node1-RG2's weight is -255 Apr 9 22:03:28 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-2 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:03:28 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:28 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/2 Apr 9 22:03:28 [jsrpd_ifd_msg_handler]: Interface fe-2/0/2 is going down Apr 9 22:03:28 [jsrpd_get_aggr_ifd_other_node_status]: aggr interface peer new state 1 peer_active_link 0 mimimum_active_link 0 Apr 9 22:03:28 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:03:28 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:03:28 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:03:28 [jsrpd_calculate_and_update_rg_priority]: Node1-RG1's weight is -255 Apr 9 22:03:28 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-1 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:03:28 [fabric_reth_and_ae_process_intf]: ifd ge-2/0/0 state change may let reth or ae 1 1 state change Apr 9 22:03:28 [jsrpd_add_aggr_child]: Found empty entry; adding child ge-2/0/0 at index 1 mac: 10:0e:7e:49:46:80:, prefix: ge fpc: 2 pic: 0, port: 0, child count: 2 Apr 9 22:03:28 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:03:28 [jsrpd_ifd_msg_handler]: Interface ge-2/0/0 is going down Apr 9 22:03:28 [jsrpd_update_interface_mon_info]: ifd ge-2/0/0 has parent aggr id 1 aggr type 1 Apr 9 22:03:28 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:03:28 [jsrpd_update_interface_mon_info]: ifd ge-2/0/0 has parent aggr id 1 aggr type 1 Apr 9 22:03:28 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:03:28 [jsrpd_update_interface_mon_info]: ifd ge-2/0/0 has parent aggr id 1 aggr type 1 Apr 9 22:03:28 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:03:28 [jsrpd_get_aggr_ifd_other_node_status]: peer child name ge-0/0/0 Apr 9 22:03:28 [jsrpd_get_aggr_ifd_other_node_status]: aggr interface reth1 peer new state 1 peer_active_link 1 mimimum_active_link 1 Apr 9 22:03:28 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:03:28 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:03:28 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:03:28 [jsrpd_calculate_and_update_rg_priority]: Node1-RG2's weight is -255 Apr 9 22:03:28 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-2 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:03:28 [jsrpd_find_and_update_ifl]: RG-2 reth1.10, state primary updated in reth database Apr 9 22:03:28 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:28 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ge-2/0/1 Apr 9 22:03:28 [jsrpd_ifd_msg_handler]: Interface ge-2/0/1 is going down Apr 9 22:03:28 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:28 last message repeated 2 times Apr 9 22:03:28 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/3 Apr 9 22:03:28 [jsrpd_ifd_msg_handler]: Interface fe-2/0/3 is going down Apr 9 22:03:28 [jsrpd_find_and_update_ifl]: RG-2 reth1.40, state primary updated in reth database Apr 9 22:03:28 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:28 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/2 Apr 9 22:03:28 [jsrpd_ifd_msg_handler]: Interface fe-2/0/2 is going down Apr 9 22:03:28 [jsrpd_get_aggr_ifd_other_node_status]: aggr interface peer new state 1 peer_active_link 0 mimimum_active_link 0 Apr 9 22:03:28 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:03:28 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:03:28 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:03:28 [jsrpd_calculate_and_update_rg_priority]: Node1-RG1's weight is -255 Apr 9 22:03:28 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-1 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:03:28 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:28 [jsrpd_find_and_update_ifl]: RG-2 reth1.50, state primary updated in reth database Apr 9 22:03:28 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:28 [jsrpd_find_and_update_ifl]: RG-2 reth1.60, state primary updated in reth database Apr 9 22:03:28 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:28 last message repeated 2 times Apr 9 22:03:28 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/4 Apr 9 22:03:28 [jsrpd_ifd_msg_handler]: Interface fe-2/0/4 is going down Apr 9 22:03:28 [jsrpd_find_and_update_ifl]: RG-2 reth1.70, state primary updated in reth database Apr 9 22:03:28 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:28 [jsrpd_find_and_update_ifl]: RG-2 reth1.80, state primary updated in reth database Apr 9 22:03:29 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:29 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/5 Apr 9 22:03:29 [jsrpd_ifd_msg_handler]: Interface fe-2/0/5 is going down Apr 9 22:03:29 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:29 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/6 Apr 9 22:03:29 [jsrpd_ifd_msg_handler]: Interface fe-2/0/6 is going down Apr 9 22:03:29 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:29 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/3 Apr 9 22:03:29 [jsrpd_ifd_msg_handler]: Interface fe-2/0/3 is going down Apr 9 22:03:29 [jsrpd_find_and_update_ifl]: RG-2 reth1.90, state primary updated in reth database Apr 9 22:03:29 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:29 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/7 Apr 9 22:03:29 [jsrpd_ifd_msg_handler]: Interface fe-2/0/7 is going down Apr 9 22:03:29 [jsrpd_find_and_update_ifl]: RG-2 reth1.91, state primary updated in reth database Apr 9 22:03:29 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:29 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:29 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:29 [jsrpd_find_and_update_ifl]: RG-2 reth1.92, state primary updated in reth database Apr 9 22:03:29 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:29 [jsrpd_find_and_update_ifl]: RG-2 reth1.32767, state primary updated in reth database Apr 9 22:03:29 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:29 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ge-2/0/1 Apr 9 22:03:29 [jsrpd_ifd_msg_handler]: Interface ge-2/0/1 is going down Apr 9 22:03:29 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:29 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ge-2/0/1 Apr 9 22:03:29 [jsrpd_ifd_msg_handler]: Interface ge-2/0/1 is going down Apr 9 22:03:29 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:29 [jsrpd_process_fab_chld]: Adding fab1 child ge-2/0/1 to the database Apr 9 22:03:29 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:29 [jsrpd_add_chld_fab_lnk]: extracting node_id 1 slot 2 Apr 9 22:03:29 [jsrpd_jsrxnle_revoke_fabmon_suspension]: Fab's have children associated with them, usp-ipc channel is up. Revoking suspension of fabric monitoring Apr 9 22:03:29 [jsrpd_fabric_info_dump]: HA Fabric Info: After child add Apr 9 22:03:29 [jsrpd_fabric_info_dump]: node0: fab0 is Active with 1 child (AggId: 130) Apr 9 22:03:29 [jsrpd_fabric_info_dump]: fab0: ge-0/0/1 (0/0/1) is Active : ifd_state: Up pfe_state: Down Apr 9 22:03:29 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:03:29 [jsrpd_fabric_info_dump]: node1: fab1 is Active with 1 child (AggId: 158) Apr 9 22:03:29 [jsrpd_fabric_info_dump]: fab0: ge-2/0/1 (2/0/1) is Active : ifd_state: Down pfe_state: Down Apr 9 22:03:29 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:03:29 [jsrpd_process_fab_chld]: fab1 child ge-2/0/1 is down Apr 9 22:03:29 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ge-2/0/1 Apr 9 22:03:29 [jsrpd_ifd_msg_handler]: Interface ge-2/0/1 is going down Apr 9 22:03:29 [get_fpc_frm_intf]: printing fpc_num 1 Apr 9 22:03:29 [jsrpd_pfe_rx_ipc_msg_handler]: Received fabric monitor status Apr 9 22:03:29 [jsrpd_pfe_fabmon_status_update]: Received fabric monitor link status from node1 PFE Apr 9 22:03:29 [jsrpd_pfe_fabmon_status_update]: lnk_idx:0 name() ifd_state(curr:1, new:0), pfe_state(curr:0, new:0) Apr 9 22:03:29 [jsrpd_pfe_fabmon_status_update]: lnk_idx:1 name() ifd_state(curr:0, new:0), pfe_state(curr:0, new:0) Apr 9 22:03:29 [jsrpd_pfe_fabmon_status_update]: Fabric link current state: DOWN link up count:0 Apr 9 22:03:29 [jsrpd_fabric_info_dump]: HA Fabric Info: After fabric status is updated Apr 9 22:03:29 [jsrpd_fabric_info_dump]: node0: fab0 is Active with 1 child (AggId: 130) Apr 9 22:03:29 [jsrpd_fabric_info_dump]: fab0: ge-0/0/1 (0/0/1) is Active : ifd_state: Up pfe_state: Down Apr 9 22:03:29 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:03:29 [jsrpd_fabric_info_dump]: node1: fab1 is Active with 1 child (AggId: 158) Apr 9 22:03:29 [jsrpd_fabric_info_dump]: fab0: ge-2/0/1 (2/0/1) is Active : ifd_state: Down pfe_state: Down Apr 9 22:03:29 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:03:29 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:29 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/2 Apr 9 22:03:29 [jsrpd_ifd_msg_handler]: Interface fe-2/0/2 is going down Apr 9 22:03:29 [jsrpd_get_aggr_ifd_other_node_status]: aggr interface peer new state 1 peer_active_link 0 mimimum_active_link 0 Apr 9 22:03:29 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:03:29 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:03:29 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:03:29 [jsrpd_calculate_and_update_rg_priority]: Node1-RG1's weight is -255 Apr 9 22:03:29 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-1 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:03:29 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:29 [fabric_reth_and_ae_process_intf]: ifd fe-2/0/2 state change may let reth or ae 1 0 state change Apr 9 22:03:29 [jsrpd_add_aggr_child]: Found empty entry; adding child fe-2/0/2 at index 1 mac: 10:0e:7e:49:46:82:, prefix: fe fpc: 2 pic: 0, port: 2, child count: 2 Apr 9 22:03:29 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:03:29 [jsrpd_ifd_msg_handler]: Interface fe-2/0/2 is going down Apr 9 22:03:29 [jsrpd_update_interface_mon_info]: ifd fe-2/0/2 has parent aggr id 0 aggr type 1 Apr 9 22:03:29 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:03:29 [jsrpd_update_interface_mon_info]: ifd fe-2/0/2 has parent aggr id 0 aggr type 1 Apr 9 22:03:29 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:03:29 [jsrpd_get_aggr_ifd_other_node_status]: peer child name fe-0/0/2 Apr 9 22:03:29 [jsrpd_get_aggr_ifd_other_node_status]: aggr interface reth0 peer new state 1 peer_active_link 1 mimimum_active_link 1 Apr 9 22:03:29 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:03:29 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:03:29 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:03:29 [jsrpd_calculate_and_update_rg_priority]: Node1-RG1's weight is -255 Apr 9 22:03:29 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-1 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:03:29 [jsrpd_update_interface_mon_info]: ifd fe-2/0/2 has parent aggr id 0 aggr type 1 Apr 9 22:03:29 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:03:29 [jsrpd_find_and_update_ifl]: RG-1 reth0.0, state primary updated in reth database Apr 9 22:03:29 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:29 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/3 Apr 9 22:03:29 [jsrpd_ifd_msg_handler]: Interface fe-2/0/3 is going down Apr 9 22:03:29 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:29 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/4 Apr 9 22:03:29 [jsrpd_ifd_msg_handler]: Interface fe-2/0/4 is going down Apr 9 22:03:29 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:29 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/5 Apr 9 22:03:29 [jsrpd_ifd_msg_handler]: Interface fe-2/0/5 is going down Apr 9 22:03:29 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:29 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/6 Apr 9 22:03:29 [jsrpd_ifd_msg_handler]: Interface fe-2/0/6 is going down Apr 9 22:03:29 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:29 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/7 Apr 9 22:03:29 [jsrpd_ifd_msg_handler]: Interface fe-2/0/7 is going down Apr 9 22:03:29 [fabric_reth_and_ae_process_intf]: ifd ge-2/0/0 state change may let reth or ae 1 1 state change Apr 9 22:03:29 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:03:29 [jsrpd_ifd_msg_handler]: Interface ge-2/0/0 is going down Apr 9 22:03:29 [jsrpd_update_interface_mon_info]: ifd ge-2/0/0 has parent aggr id 1 aggr type 1 Apr 9 22:03:29 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:03:29 [jsrpd_update_interface_mon_info]: ifd ge-2/0/0 has parent aggr id 1 aggr type 1 Apr 9 22:03:29 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:03:29 [jsrpd_update_interface_mon_info]: ifd ge-2/0/0 has parent aggr id 1 aggr type 1 Apr 9 22:03:29 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:03:29 [jsrpd_get_aggr_ifd_other_node_status]: peer child name ge-0/0/0 Apr 9 22:03:29 [jsrpd_get_aggr_ifd_other_node_status]: aggr interface reth1 peer new state 1 peer_active_link 1 mimimum_active_link 1 Apr 9 22:03:29 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:03:29 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:03:29 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:03:29 [jsrpd_calculate_and_update_rg_priority]: Node1-RG2's weight is -255 Apr 9 22:03:29 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-2 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:03:29 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:29 [jsrpd_process_fab_chld]: fab1 child ge-2/0/1 is down Apr 9 22:03:29 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ge-2/0/1 Apr 9 22:03:29 [jsrpd_ifd_msg_handler]: Interface ge-2/0/1 is going down Apr 9 22:03:29 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:29 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/3 Apr 9 22:03:29 [jsrpd_ifd_msg_handler]: Interface fe-2/0/3 is going down Apr 9 22:03:29 [fabric_reth_and_ae_process_intf]: ifd fe-2/0/2 state change may let reth or ae 1 0 state change Apr 9 22:03:29 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:03:29 [jsrpd_ifd_msg_handler]: Interface fe-2/0/2 is going down Apr 9 22:03:29 [jsrpd_update_interface_mon_info]: ifd fe-2/0/2 has parent aggr id 0 aggr type 1 Apr 9 22:03:29 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:03:29 [jsrpd_update_interface_mon_info]: ifd fe-2/0/2 has parent aggr id 0 aggr type 1 Apr 9 22:03:29 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:03:29 [jsrpd_get_aggr_ifd_other_node_status]: peer child name fe-0/0/2 Apr 9 22:03:29 [jsrpd_get_aggr_ifd_other_node_status]: aggr interface reth0 peer new state 1 peer_active_link 1 mimimum_active_link 1 Apr 9 22:03:29 [jsrpd_calculate_health]: intf failed, computed-weight 0 Apr 9 22:03:29 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 0, cs-mon-weight 255 Apr 9 22:03:29 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:03:29 [jsrpd_calculate_and_update_rg_priority]: Node1-RG1's weight is -255 Apr 9 22:03:29 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-1 is -255. Setting priority to 0. Failures: interface-monitoring, cold-sync-monitoring Apr 9 22:03:29 [jsrpd_update_interface_mon_info]: ifd fe-2/0/2 has parent aggr id 0 aggr type 1 Apr 9 22:03:29 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 0 local_active_link 0 minimum_active_link 1 Apr 9 22:03:29 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:29 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/4 Apr 9 22:03:29 [jsrpd_ifd_msg_handler]: Interface fe-2/0/4 is going down Apr 9 22:03:29 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:29 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/5 Apr 9 22:03:29 [jsrpd_ifd_msg_handler]: Interface fe-2/0/5 is going down Apr 9 22:03:29 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:29 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/6 Apr 9 22:03:29 [jsrpd_ifd_msg_handler]: Interface fe-2/0/6 is going down Apr 9 22:03:29 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:29 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/7 Apr 9 22:03:29 [jsrpd_ifd_msg_handler]: Interface fe-2/0/7 is going down Apr 9 22:03:29 [fabric_reth_and_ae_process_intf]: fab0 marked down Apr 9 22:03:29 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fab0 Apr 9 22:03:29 [jsrpd_ifd_msg_handler]: Interface fab0 is going down Apr 9 22:03:30 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:03:30 [jsrpd_process_fab_chld]: fab0 child ge-0/0/1 is down Apr 9 22:03:30 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ge-0/0/1 Apr 9 22:03:30 [jsrpd_ifd_msg_handler]: Interface ge-0/0/1 is going down Apr 9 22:03:30 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:03:30 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:30 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:30 [jsrpd_set_remote_node_suspend_fabmon_flag]: Remote node revoking suspension of fabric monitoring Apr 9 22:03:30 [jsrpd_fabric_pre_reqs_ready]: fabric_to_child_mapping: 1 uspipc to pfe : 1 ifstate download : 1 Apr 9 22:03:30 [jsrpd_set_fabric_dead_timer]: fabric probe dead timer started Apr 9 22:03:30 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:30 [jsrpd_pfe_rx_ipc_msg_handler]: Received fabric monitor status Apr 9 22:03:30 [jsrpd_pfe_fabmon_status_update]: Received fabric monitor link status from node1 PFE Apr 9 22:03:30 [jsrpd_pfe_fabmon_status_update]: lnk_idx:0 name(ge-2/0/1) ifd_state(curr:1, new:1), pfe_state(curr:0, new:0) Apr 9 22:03:30 [jsrpd_pfe_fabmon_status_update]: lnk_idx:1 name() ifd_state(curr:0, new:0), pfe_state(curr:0, new:0) Apr 9 22:03:30 [jsrpd_pfe_fabmon_status_update]: Fabric link current state: DOWN link up count:0 Apr 9 22:03:30 [jsrpd_fabric_info_dump]: HA Fabric Info: After fabric status is updated Apr 9 22:03:30 [jsrpd_fabric_info_dump]: node0: fab0 is Active with 1 child (AggId: 130) Apr 9 22:03:30 [jsrpd_fabric_info_dump]: fab0: ge-0/0/1 (0/0/1) is Active : ifd_state: Down pfe_state: Down Apr 9 22:03:30 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:03:30 [jsrpd_fabric_info_dump]: node1: fab1 is Active with 1 child (AggId: 158) Apr 9 22:03:30 [jsrpd_fabric_info_dump]: fab0: ge-2/0/1 (2/0/1) is Active : ifd_state: Down pfe_state: Down Apr 9 22:03:30 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:03:30 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:30 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/4 Apr 9 22:03:30 [jsrpd_ifd_msg_handler]: Interface fe-2/0/4 is going down Apr 9 22:03:30 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:30 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/5 Apr 9 22:03:30 [jsrpd_ifd_msg_handler]: Interface fe-2/0/5 is going down Apr 9 22:03:30 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:30 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/6 Apr 9 22:03:30 [jsrpd_ifd_msg_handler]: Interface fe-2/0/6 is going down Apr 9 22:03:30 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:30 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/7 Apr 9 22:03:30 [jsrpd_ifd_msg_handler]: Interface fe-2/0/7 is going down Apr 9 22:03:30 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:30 last message repeated 2 times Apr 9 22:03:30 [jsrpd_process_fab_chld_ifl]: fab1 child ge-2/0/1 is up, starting fabmon Apr 9 22:03:30 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:30 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fe-2/0/7 Apr 9 22:03:30 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface fe-2/0/7 is up Apr 9 22:03:31 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:31 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:32 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:32 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:32 [jsrpd_pfe_rx_ipc_msg_handler]: Received Nexthop monitor status Apr 9 22:03:32 [jsrpd_pfe_nexthop_status_update]: Received nexthop status from PFE 0 Apr 9 22:03:32 [jsrpd_loopback_status_dump]: Loopback Status: Apr 9 22:03:32 [jsrpd_loopback_status_dump]: Index: 0 PFE Id: 0, Error_code: 0x02 - Nexthop Apr 9 22:03:32 [fabric_reth_and_ae_process_intf]: ifd ge-2/0/0 state change may let reth or ae 1 1 state change Apr 9 22:03:32 [jsrpd_get_aggr_ifd_status]: local child name ge-2/0/0 Apr 9 22:03:32 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 1 local_active_link 1 minimum_active_link 1 Apr 9 22:03:32 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface ge-2/0/0 is up Apr 9 22:03:32 [jsrpd_update_interface_mon_info]: ifd ge-2/0/0 has parent aggr id 1 aggr type 1 Apr 9 22:03:32 [jsrpd_get_aggr_ifd_status]: local child name ge-2/0/0 Apr 9 22:03:32 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 1 local_active_link 1 minimum_active_link 1 Apr 9 22:03:32 [jsrpd_update_interface_mon_info]: ifd ge-2/0/0 has parent aggr id 1 aggr type 1 Apr 9 22:03:32 [jsrpd_get_aggr_ifd_status]: local child name ge-2/0/0 Apr 9 22:03:32 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 1 local_active_link 1 minimum_active_link 1 Apr 9 22:03:32 [jsrpd_update_interface_mon_info]: ifd ge-2/0/0 has parent aggr id 1 aggr type 1 Apr 9 22:03:32 [jsrpd_get_aggr_ifd_status]: local child name ge-2/0/0 Apr 9 22:03:32 [jsrpd_get_aggr_ifd_status]: interface reth1 new state 1 local_active_link 1 minimum_active_link 1 Apr 9 22:03:32 [jsrpd_update_interface_mon_info]: ge-2/0/0 interface monitored by RG-2 changed state from Down to Up Apr 9 22:03:32 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 255, cs-mon-weight 255 Apr 9 22:03:32 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:03:32 [jsrpd_calculate_and_update_rg_priority]: Node1-RG2's weight is 0 Apr 9 22:03:32 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-2 is 0. Setting priority to 0. Failures: cold-sync-monitoring Apr 9 22:03:33 [fabric_reth_and_ae_process_intf]: fab1 marked up Apr 9 22:03:33 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fab1 Apr 9 22:03:33 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface fab1 is up Apr 9 22:03:33 [get_fpc_frm_intf]: printing fpc_num 2 Apr 9 22:03:33 [jsrpd_process_fab_chld]: fab1 child ge-2/0/1 is up Apr 9 22:03:33 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ge-2/0/1 Apr 9 22:03:33 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface ge-2/0/1 is up Apr 9 22:03:33 [get_fpc_frm_intf]: printing fpc_num 1 Apr 9 22:03:33 [fabric_reth_and_ae_process_intf]: ifd fe-2/0/2 state change may let reth or ae 1 0 state change Apr 9 22:03:33 [jsrpd_get_aggr_ifd_status]: local child name fe-2/0/2 Apr 9 22:03:33 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 1 local_active_link 1 minimum_active_link 1 Apr 9 22:03:33 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface fe-2/0/2 is up Apr 9 22:03:33 [jsrpd_update_interface_mon_info]: ifd fe-2/0/2 has parent aggr id 0 aggr type 1 Apr 9 22:03:33 [jsrpd_get_aggr_ifd_status]: local child name fe-2/0/2 Apr 9 22:03:33 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 1 local_active_link 1 minimum_active_link 1 Apr 9 22:03:33 [jsrpd_update_interface_mon_info]: ifd fe-2/0/2 has parent aggr id 0 aggr type 1 Apr 9 22:03:33 [jsrpd_get_aggr_ifd_status]: local child name fe-2/0/2 Apr 9 22:03:33 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 1 local_active_link 1 minimum_active_link 1 Apr 9 22:03:33 [jsrpd_update_interface_mon_info]: fe-2/0/2 interface monitored by RG-1 changed state from Down to Up Apr 9 22:03:33 [jsrpd_csmon_calculate_weight]: csmon failure, computed-weight 255, cs-mon-weight 255 Apr 9 22:03:33 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:03:33 [jsrpd_calculate_and_update_rg_priority]: Node1-RG1's weight is 0 Apr 9 22:03:33 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-1 is 0. Setting priority to 0. Failures: cold-sync-monitoring Apr 9 22:03:33 [jsrpd_update_interface_mon_info]: ifd fe-2/0/2 has parent aggr id 0 aggr type 1 Apr 9 22:03:33 [jsrpd_get_aggr_ifd_status]: local child name fe-2/0/2 Apr 9 22:03:33 [jsrpd_get_aggr_ifd_status]: interface reth0 new state 1 local_active_link 1 minimum_active_link 1 Apr 9 22:03:33 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:33 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:33 [fabric_reth_and_ae_process_intf]: fab0 marked up Apr 9 22:03:33 [fabric_reth_and_ae_process_intf]: Processing interface state change for:fab0 Apr 9 22:03:33 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface fab0 is up Apr 9 22:03:33 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:03:33 [jsrpd_process_fab_chld]: fab0 child ge-0/0/1 is up Apr 9 22:03:33 [fabric_reth_and_ae_process_intf]: Processing interface state change for:ge-0/0/1 Apr 9 22:03:33 [jsrpd_ifd_msg_handler]: jsrpd_ifd_msg_handler: Interface ge-0/0/1 is up Apr 9 22:03:33 [get_fpc_frm_intf]: printing fpc_num 0 Apr 9 22:03:34 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:34 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:34 [jsrpd_pfe_rx_ipc_msg_handler]: received coldsync status message: type 1032, sub-type 45, length 82 Apr 9 22:03:34 [jsrpd_handle_pfe_cs_status_msg]: coldsync status message received from PFE: 0, status: 0x6 Apr 9 22:03:34 [jsrpd_handle_pfe_cs_status_msg]: Cold-sync progress for PFE: 0. Prereq_0: 63 RTO_0: 0, Postreq_0: 0 Info: 1 Apr 9 22:03:34 [jsrpd_pfe_rx_ipc_msg_handler]: received coldsync status message: type 1032, sub-type 45, length 82 Apr 9 22:03:34 [jsrpd_handle_pfe_cs_status_msg]: coldsync status message received from PFE: 0, status: 0x6 Apr 9 22:03:34 [jsrpd_handle_pfe_cs_status_msg]: Cold-sync progress for PFE: 0. Prereq_0: 63 RTO_0: 0, Postreq_0: 0 Info: 1 Apr 9 22:03:34 [jsrpd_pfe_rx_ipc_msg_handler]: received coldsync status message: type 1032, sub-type 45, length 82 Apr 9 22:03:34 [jsrpd_handle_pfe_cs_status_msg]: coldsync status message received from PFE: 0, status: 0x6 Apr 9 22:03:34 [jsrpd_handle_pfe_cs_status_msg]: Cold-sync progress for PFE: 0. Prereq_0: 63 RTO_0: 0, Postreq_0: 0 Info: 1 Apr 9 22:03:34 [jsrpd_pfe_rx_ipc_msg_handler]: received coldsync status message: type 1032, sub-type 45, length 82 Apr 9 22:03:34 [jsrpd_handle_pfe_cs_status_msg]: coldsync status message received from PFE: 0, status: 0x6 Apr 9 22:03:34 [jsrpd_handle_pfe_cs_status_msg]: Cold-sync progress for PFE: 0. Prereq_0: 63 RTO_0: 0, Postreq_0: 0 Info: 1 Apr 9 22:03:34 [jsrpd_pfe_rx_ipc_msg_handler]: received coldsync status message: type 1032, sub-type 45, length 82 Apr 9 22:03:34 [jsrpd_handle_pfe_cs_status_msg]: coldsync status message received from PFE: 0, status: 0x4 Apr 9 22:03:34 [jsrpd_handle_pfe_cs_status_msg]: coldsync all pre-reqs complete PFE: 0. Apr 9 22:03:35 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:35 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:35 [jsrpd_pfe_rx_ipc_msg_handler]: received coldsync status message: type 1032, sub-type 45, length 82 Apr 9 22:03:35 [jsrpd_handle_pfe_cs_status_msg]: coldsync status message received from PFE: 0, status: 0x5 Apr 9 22:03:35 [jsrpd_handle_pfe_cs_status_msg]: coldsync post check started PFE: 0. Apr 9 22:03:35 [jsrpd_pfe_rx_ipc_msg_handler]: Received Nexthop monitor status Apr 9 22:03:35 [jsrpd_pfe_nexthop_status_update]: Received nexthop status from PFE 0 Apr 9 22:03:35 [jsrpd_loopback_status_dump]: Loopback Status: Apr 9 22:03:35 [jsrpd_loopback_status_dump]: Index: 0 PFE Id: 0, Error_code: 0x00 - Apr 9 22:03:36 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:36 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:36 [jsrpd_pfe_rx_ipc_msg_handler]: received coldsync status message: type 1032, sub-type 45, length 82 Apr 9 22:03:37 [jsrpd_sigusr2_handler]: received SIGUSR2, pid 1676 Apr 9 22:03:37 [jsrpd_handle_pfe_cs_status_msg]: coldsync status message received from PFE: 0, status: 0x6 Apr 9 22:03:37 [jsrpd_handle_pfe_cs_status_msg]: Cold-sync progress for PFE: 0. Prereq_0: 63 RTO_0: 0, Postreq_0: 1 Info: 1 Apr 9 22:03:37 [jsrpd_update_on_sigusr2]: processing SIGUSR2 ... Apr 9 22:03:37 [fsm_set_link_status_timer]: link status timer started, delay=1000 Apr 9 22:03:37 [jsrpd_fabric_info_dump]: HA Fabric Info: Before populated from blob Apr 9 22:03:37 [jsrpd_fabric_info_dump]: node0: fab0 is Active with 1 child (AggId: 130) Apr 9 22:03:37 [jsrpd_fabric_info_dump]: fab0: ge-0/0/1 (0/0/1) is Active : ifd_state: Up pfe_state: Down Apr 9 22:03:37 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:03:37 [jsrpd_fabric_info_dump]: node1: fab1 is Active with 1 child (AggId: 158) Apr 9 22:03:37 [jsrpd_fabric_info_dump]: fab0: ge-2/0/1 (2/0/1) is Active : ifd_state: Up pfe_state: Down Apr 9 22:03:37 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:03:37 [jsrpd_fabric_info_dump]: HA Fabric Info: After populated from blob Apr 9 22:03:37 [jsrpd_fabric_info_dump]: node0: fab0 is Active with 1 child (AggId: 130) Apr 9 22:03:37 [jsrpd_fabric_info_dump]: fab0: ge-0/0/1 (0/0/1) is Active : ifd_state: Up pfe_state: Up Apr 9 22:03:37 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:03:37 [jsrpd_fabric_info_dump]: node1: fab1 is Active with 1 child (AggId: 158) Apr 9 22:03:37 [jsrpd_fabric_info_dump]: fab0: ge-2/0/1 (2/0/1) is Active : ifd_state: Up pfe_state: Down Apr 9 22:03:37 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:03:37 [jsrpd_gencfg_msg_handler]: blob major_type:2 minor_type: 76 Apr 9 22:03:37 [jsrpd_pfe_rx_ipc_msg_handler]: Received fabric monitor status Apr 9 22:03:37 [jsrpd_pfe_fabmon_status_update]: Received fabric monitor link status from node1 PFE Apr 9 22:03:37 [jsrpd_pfe_fabmon_status_update]: lnk_idx:0 name(ge-2/0/1) ifd_state(curr:1, new:1), pfe_state(curr:0, new:1) Apr 9 22:03:37 [jsrpd_set_fab_chld_lnk_state]: State of lnk-0 of fab1 changed from DOWN to UP Apr 9 22:03:37 [jsrpd_pfe_fabmon_status_update]: lnk_idx:1 name() ifd_state(curr:0, new:0), pfe_state(curr:0, new:0) Apr 9 22:03:37 [jsrpd_pfe_fabmon_status_update]: Fabric link current state: DOWN link up count:1 Apr 9 22:03:37 [jsrpd_pfe_fabmon_status_update]: Fabric link state change detected current state: DOWN fabric link up count:1 Apr 9 22:03:37 [jsrpd_pfe_fabmon_status_update]: Control link status UP, Fabric monitoring: Enabled Apr 9 22:03:37 [fsm_set_link_status_timer]: link status timer is already set Apr 9 22:03:37 [jsrpd_fabric_info_dump]: HA Fabric Info: After fabric status is updated Apr 9 22:03:37 [jsrpd_fabric_info_dump]: node0: fab0 is Active with 1 child (AggId: 130) Apr 9 22:03:37 [jsrpd_fabric_info_dump]: fab0: ge-0/0/1 (0/0/1) is Active : ifd_state: Up pfe_state: Up Apr 9 22:03:37 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:03:37 [jsrpd_fabric_info_dump]: node1: fab1 is Active with 1 child (AggId: 158) Apr 9 22:03:37 [jsrpd_fabric_info_dump]: fab0: ge-2/0/1 (2/0/1) is Active : ifd_state: Up pfe_state: Up Apr 9 22:03:37 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:03:37 [jsrpd_pfe_fabmon_status_update]: jsrpd_pfe_fabmon_status_update: fab child link state change detected Apr 9 22:03:37 [jsrpd_ssam_fab_update]: Only RG0 primary can do ssame update nmchassis_is_re_protocol_master :0 Apr 9 22:03:37 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:37 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:37 [jsrpd_pfe_rx_ipc_msg_handler]: received coldsync status message: type 1032, sub-type 45, length 82 Apr 9 22:03:37 [jsrpd_handle_pfe_cs_status_msg]: coldsync status message received from PFE: 0, status: 0x6 Apr 9 22:03:37 [jsrpd_handle_pfe_cs_status_msg]: Cold-sync progress for PFE: 0. Prereq_0: 63 RTO_0: 0, Postreq_0: 3 Info: 5 Apr 9 22:03:37 [jsrpd_pfe_rx_ipc_msg_handler]: received coldsync status message: type 1032, sub-type 45, length 82 Apr 9 22:03:37 [jsrpd_handle_pfe_cs_status_msg]: coldsync status message received from PFE: 0, status: 0x1 Apr 9 22:03:37 [jsrpd_handle_pfe_cs_status_msg]: coldsync is completed for PFE: 0 Apr 9 22:03:37 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Amber Apr 9 22:03:37 [jsrpd_snmp_health_weight_trap]: Successfully sent an snmp-trap due to change of weight.cluster1-node1-RG1: Healthy(255) Apr 9 22:03:37 [jsrpd_calculate_and_update_rg_priority]: Node1-RG1's weight is 255 Apr 9 22:03:37 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-1 is 255. Failures: none Apr 9 22:03:37 [jsrpd_set_led_status]: old LED color is Amber, new LED color is Green Apr 9 22:03:37 [jsrpd_set_led_status]: LED changed from Amber to Green, reason is No failures Apr 9 22:03:37 [jsrpd_set_led_status]: setting sysctl for ha led color(Green) Apr 9 22:03:37 [jsrpd_snmp_health_weight_trap]: Successfully sent an snmp-trap due to change of weight.cluster1-node1-RG2: Healthy(255) Apr 9 22:03:37 [jsrpd_calculate_and_update_rg_priority]: Node1-RG2's weight is 255 Apr 9 22:03:37 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-2 is 255. Failures: none Apr 9 22:03:37 [jsrpd_handle_pfe_cs_status_msg]: coldsync is completed for all the PFEs. cs monitoring weight is set to ZERO. Mark coldsync as done. Apr 9 22:03:38 [fsm_process_link_status_event]: Processing link status event Apr 9 22:03:38 [jsrpd_jsrxnle_get_link_status]: control link up count:1 Apr 9 22:03:38 [jsrpd_jsrxnle_get_link_status]: fabric link up count:1 Apr 9 22:03:38 [jsrpd_fabric_pre_reqs_ready]: fabric_to_child_mapping: 1 uspipc to pfe : 1 ifstate download : 1 Apr 9 22:03:38 [jsrpd_pfe_fabmon_update_lnk_status]: Received fabrics child link status from PFE Apr 9 22:03:38 [jsrpd_pfe_fabmon_update_lnk_status]: jsrpd_pfe_fabmon_update_lnk_status: lnk_idx:0, link_state(curr:1, new:255) Apr 9 22:03:38 [jsrpd_pfe_fabmon_update_lnk_status]: State of lnk-0 of fab0 remains UP Apr 9 22:03:38 [jsrpd_pfe_fabmon_update_lnk_status]: jsrpd_pfe_fabmon_update_lnk_status: lnk_idx:1, link_state(curr:0, new:255) Apr 9 22:03:38 [jsrpd_pfe_fabmon_update_lnk_status]: State of lnk-1 of fab0 remains DOWN Apr 9 22:03:38 [jsrpd_pfe_fabmon_update_lnk_status]: jsrpd_pfe_fabmon_update_lnk_status: lnk_idx:2, link_state(curr:1, new:1) Apr 9 22:03:38 [jsrpd_pfe_fabmon_update_lnk_status]: jsrpd_pfe_fabmon_update_lnk_status: lnk_idx:3, link_state(curr:0, new:0) Apr 9 22:03:38 [jsrpd_fabric_info_dump]: HA Fabric Info: After fabric child status is updated Apr 9 22:03:38 [jsrpd_fabric_info_dump]: node0: fab0 is Active with 1 child (AggId: 130) Apr 9 22:03:38 [jsrpd_fabric_info_dump]: fab0: ge-0/0/1 (0/0/1) is Active : ifd_state: Up pfe_state: Up Apr 9 22:03:38 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:03:38 [jsrpd_fabric_info_dump]: node1: fab1 is Active with 1 child (AggId: 158) Apr 9 22:03:38 [jsrpd_fabric_info_dump]: fab0: ge-2/0/1 (2/0/1) is Active : ifd_state: Up pfe_state: Up Apr 9 22:03:38 [jsrpd_fabric_info_dump]: fab1: (0/0/0) is Inactive : ifd_state: Down pfe_state: Down Apr 9 22:03:38 [fsm_process_link_status_event]: control link UP/UP fabric link DOWN/UP Apr 9 22:03:38 [fsm_process_link_status_event]: no change to control link status (UP) Apr 9 22:03:38 [jsrpd_fabric_pre_reqs_ready]: fabric_to_child_mapping: 1 uspipc to pfe : 1 ifstate download : 1 Apr 9 22:03:38 [fsm_process_link_status_event]: fabric link status changed from DOWN->UP. Apr 9 22:03:38 [fabric_link_up_actions]: HA Fab: fabric link state changed DOWN->UP Apr 9 22:03:38 [fabric_link_up_actions]: HA Fab: fabric link up, node1 doesn't have to recover Apr 9 22:03:38 [fsm_process_link_status_event]: Control link recovery qualified : true Apr 9 22:03:38 [jsrpd_set_led_status]: old LED color is Green, new LED color is Green Apr 9 22:03:38 [jsrpd_calculate_and_update_rg_priority]: Node1-RG0's weight is 255 Apr 9 22:03:38 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-0 is 255. Failures: none Apr 9 22:03:38 [jsrpd_set_led_status]: old LED color is Green, new LED color is Green Apr 9 22:03:38 [jsrpd_calculate_and_update_rg_priority]: Node1-RG1's weight is 255 Apr 9 22:03:38 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-1 is 255. Failures: none Apr 9 22:03:38 [jsrpd_set_led_status]: old LED color is Green, new LED color is Green Apr 9 22:03:38 [jsrpd_calculate_and_update_rg_priority]: Node1-RG2's weight is 255 Apr 9 22:03:38 [jsrpd_calculate_and_update_rg_priority]: Current threshold for rg-2 is 255. Failures: none Apr 9 22:03:38 [jsrpd_sched_mon_slip_check]: Cleared schedule slip Apr 9 22:03:38 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:38 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:39 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:39 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:40 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:40 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:41 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:41 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:42 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:42 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:43 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:43 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:44 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:44 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:45 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:45 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:46 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:46 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:47 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:47 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:48 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:48 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:49 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:49 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:50 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:50 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:51 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:51 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:52 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:52 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:53 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:53 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:54 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:54 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:55 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:55 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:56 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:56 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:57 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:57 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:58 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:58 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:03:59 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:03:59 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:04:00 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:04:00 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:04:01 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:04:01 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:04:02 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:04:02 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:04:03 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:04:03 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:04:04 [jsrpd_service_incoming_hb]: HB Received len=137 Apr 9 22:04:04 [fsm_process_hb]: Received TLV hb packet total_len=117 RG info length = 29 Apr 9 22:04:05 [jsrpd_service_incoming_hb]: HB Received len=137