Switching

 View Only
last person joined: 3 days ago 

Ask questions and share experiences about EX and QFX portfolios and all switching solutions across your data center, campus, and branch locations.
Back to discussions
Expand all | Collapse all

Virtual Chassis LACP flap (GRES / NSB ?)

  • 1.  Virtual Chassis LACP flap (GRES / NSB ?)

    Posted 06-07-2016 00:41

    Hello,

    I have a topology composed of 6 EX3300 in VC.

    1 is master , one other is backup (botj have same weight, 129). The four others are linecard.

     

    I've done an upgrade from 12.3R9 to 12.3R12 few days ago.

    During this upgrade, i've noticed NSB is not activated in my preprovisionned VC.

    GRES is activated:

    root@sw-cloud-ex3300-stack> show configuration chassis
    redundancy {
    graceful-switchover;
    }

     

    Tonight, all my LACP linksflapped (40 links approximately in my VC). Problem started at 01:42:53

     

    I can't find something interresting in logs except LACP timeout.

    Jun 7 00:53:28 sw-cloud-ex3300-stack xntpd[10092]: NTP Server Unreachable
    Jun 7 00:53:44 sw-cloud-ex3300-stack last message repeated 8 times
    Jun 7 01:11:01 sw-cloud-ex3300-stack last message repeated 9 times
    Jun 7 01:28:03 sw-cloud-ex3300-stack xntpd[10092]: NTP Server Unreachable
    Jun 7 01:28:19 sw-cloud-ex3300-stack last message repeated 8 times
    Jun 7 01:42:53 sw-cloud-ex3300-stack sfid[1303]: JTASK_SCHED_SLIP_KEVENT: 21 sec 481478 usec kevent block
    Jun 7 01:42:53 sw-cloud-ex3300-stack chassism[1302]: JTASK_SCHED_SLIP_KEVENT: 21 sec 486749 usec kevent block
    Jun 7 01:42:53 sw-cloud-ex3300-stack lldpd[10106]: JTASK_SCHED_SLIP: 21 sec scheduler slip, user: 0 sec 0 usec, system: 0 sec, 557 usec
    Jun 7 01:42:53 sw-cloud-ex3300-stack eswd[10087]: JTASK_SCHED_SLIP_KEVENT: 21 sec 526552 usec kevent block
    Jun 7 01:42:53 sw-cloud-ex3300-stack eswd[10087]: Root bridge in context 0 changed from 4:cc:4e:24:3a:e9:b8 to 8192:84:b5:9c:46:79:01
    Jun 7 01:42:53 sw-cloud-ex3300-stack cfmd[10091]: JTASK_SCHED_SLIP_KEVENT: 23 sec 280174 usec kevent block
    Jun 7 01:42:53 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/2 - ATTACHED state - acting as standby link
    Jun 7 01:42:53 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-2/0/2: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:53 sw-cloud-ex3300-stack sflowd[10107]: JTASK_SCHED_SLIP_KEVENT: 24 sec 297734 usec kevent block
    Jun 7 01:42:53 sw-cloud-ex3300-stack mcsnoopd[10108]: JTASK_SCHED_SLIP_KEVENT: 23 sec 337595 usec kevent block
    Jun 7 01:42:53 sw-cloud-ex3300-stack rpd[1319]: RPD_SCHED_SLIP_KEVENT: 22 sec 425412 usec kevent block
    Jun 7 01:42:53 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-2/0/10: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:53 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/10 - ATTACHED state - acting as standby link
    Jun 7 01:42:53 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-2/0/9: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:53 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/9 - ATTACHED state - acting as standby link
    Jun 7 01:42:53 sw-cloud-ex3300-stack bdbrepd: Subscriber Management is not ready for GRES
    Jun 7 01:42:53 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-3/0/10: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:53 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae31: bundle IFD minimum links not met 0 < 1
    Jun 7 01:42:53 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/10 - ATTACHED state - acting as standby link
    Jun 7 01:42:53 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae31: Interface marked down due to lacp timeout on member ge-3/0/10
    Jun 7 01:42:54 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-3/0/9: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:54 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae30: Interface marked down due to lacp timeout on member ge-3/0/9
    Jun 7 01:42:54 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae30: bundle IFD minimum links not met 0 < 1
    Jun 7 01:42:54 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/9 - ATTACHED state - acting as standby link
    Jun 7 01:42:54 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-5/0/11: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:54 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/11 - ATTACHED state - acting as standby link
    Jun 7 01:42:54 sw-cloud-ex3300-stack eswd[10087]: Root bridge in context 0 changed from 8192:84:b5:9c:46:79:01 to 4:cc:4e:24:3a:e9:b8

     

    I think the only interessting information is Subscriber Management is not ready for GRES

     

    Is LACP flaps are linked to NSB not activated ? How can I debug this nihght issue ?

     

    Thanks,



  • 2.  RE: Virtual Chassis LACP flap (GRES / NSB ?)

     
    Posted 06-07-2016 02:54

    Hi, 

     

    I doubt 'subscriber management' is related to the LACP link flaps.

    I would rather look at LACP and why LACP is timing out [LACPD_TIMEOUT messages].

    The following commands may provide more info:

    show lacp interfaces aex
show lacp statistics interfaces aex
show lacp timeouts aex

    You could run the commands against the physical LACP member interfaces as well.

     

    Cheers,

    Ashvin



  • 3.  RE: Virtual Chassis LACP flap (GRES / NSB ?)

    Posted 06-07-2016 03:25

    Hello,

     

    I use ae31 for example:

    root@sw-cloud-ex3300-stack> show lacp interfaces ae31
    Aggregated interface: ae31
    LACP state: Role Exp Def Dist Col Syn Aggr Timeout Activity
    ge-2/0/10 Actor No No Yes Yes Yes Yes Fast Active
    ge-2/0/10 Partner No No Yes Yes Yes Yes Slow Active
    ge-3/0/10 Actor No No Yes Yes Yes Yes Fast Active
    ge-3/0/10 Partner No No Yes Yes Yes Yes Slow Active
    LACP protocol: Receive State Transmit State Mux State
    ge-2/0/10 Current Slow periodic Collecting distributing
    ge-3/0/10 Current Slow periodic Collecting distributing

    {master:1}
    root@sw-cloud-ex3300-stack> show lacp statistics interfaces ae31
    Aggregated interface: ae31
    LACP Statistics: LACP Rx LACP Tx Unknown Rx Illegal Rx
    ge-2/0/10 423435 14245 0 0
    ge-3/0/10 423434 14245 0 0

    {master:1}
    root@sw-cloud-ex3300-stack> show lacp timeouts ae31
    Aggregated interface: ae31
    LACP Interfaces Current state Last timeout
    ge-2/0/10 Collecting distributing 2016-06-07 01:42:53 CEST (10:34:01 ago)
    ge-3/0/10 Collecting distributing 2016-06-07 01:42:53 CEST (10:34:01 ago)

    {master:1}
    root@sw-cloud-ex3300-stack>

     

    Is my problems related to Fast and Slow mode (switch in fast and partner in slow mode).

     

    Moreover, during 1 year, I used this configuration without defect. Junos release was 12.3.R9.

    I've upgraded 1 week ago to 12.3R12.4. 

    I'm surprised why all my LACP have timeout today and never during the last year.

    Do you think NSB unactivated can be root cause of this issue ?



  • 4.  RE: Virtual Chassis LACP flap (GRES / NSB ?)

     
    Posted 06-07-2016 04:32

    Hi,

     

    NSB comes into play during Routing Engine failovers to maintain L2 Control Protocol information on the backup RE:

    http://www.juniper.net/techpubs/en_US/junos12.3/topics/concept/nonstop-bridging-ex-series.html

    http://www.juniper.net/documentation/en_US/junos15.1/topics/concept/nonstop-bridging-overview.html

     

    Looking at the logs:

    Jun 7 01:42:53 sw-cloud-ex3300-stack sfid[1303]: JTASK_SCHED_SLIP_KEVENT: 21 sec 481478 usec kevent block
Jun 7 01:42:53 sw-cloud-ex3300-stack chassism[1302]: JTASK_SCHED_SLIP_KEVENT: 21 sec 486749 usec kevent block
Jun 7 01:42:53 sw-cloud-ex3300-stack lldpd[10106]: JTASK_SCHED_SLIP: 21 sec scheduler slip, user: 0 sec 0 usec, system: 0 sec, 557 usec
Jun 7 01:42:53 sw-cloud-ex3300-stack eswd[10087]: JTASK_SCHED_SLIP_KEVENT: 21 sec 526552 usec kevent block
Jun 7 01:42:53 sw-cloud-ex3300-stack eswd[10087]: Root bridge in context 0 changed from 4:cc:4e:24:3a:e9:b8 to 8192:84:b5:9c:46:79:01
Jun 7 01:42:53 sw-cloud-ex3300-stack cfmd[10091]: JTASK_SCHED_SLIP_KEVENT: 23 sec 280174 usec kevent block

    You may need to try correlate the LACP flap event with other events that may have triggered this. Maybe check whether there were any RE failovers at that time, in this case VC master switchover.

     

    In the absence of NSB should there be a RE failover, this would cause the L2 Control Protocol process [l2cpd] to restart. Did all the LACP interfaces flap at this time?

     

    As for fast and slow periodic rates, as per this link the rate is adaptable:

    The interval can be fast (every second) or slow (every 30 seconds). You can configure different periodic rates on active and passive interfaces. When you configure the active and passive interfaces at different rates, the transmitter honors the receiver’s rate.

    http://www.juniper.net/documentation/en_US/junos13.3/topics/usage-guidelines/interfaces-configuring-aggregated-ethernet-lacp.html

     



  • 5.  RE: Virtual Chassis LACP flap (GRES / NSB ?)

    Posted 06-07-2016 05:02

    Hi, 

     

    thanks for fast answer.

     

    All my LACP interfaces flaped at same time:

    I did'nt find a RE failover.

    I've just done these commands to see switchover state:

     

    root@sw-cloud-ex3300-stack> show system switchover 
fpc0:
--------------------------------------------------------------------------
Graceful switchover: On
Configuration database: Ready
Kernel database: Synchronizing
Peer state: Steady State

{backup:0}
root@sw-cloud-ex3300-stack> show system switchover    
fpc0:
--------------------------------------------------------------------------
Graceful switchover: On
Configuration database: Ready
Kernel database: Ready
Peer state: Steady State

{backup:0}
root@sw-cloud-ex3300-stack> show system switchover    
fpc0:
--------------------------------------------------------------------------
Graceful switchover: On
Configuration database: Ready
Kernel database: Ready
Peer state: Steady State

{backup:0}
root@sw-cloud-ex3300-stack> show system switchover
    If I paste all logs during the LACP problem:
    Spoiler
    Jun 6 23:44:24 sw-cloud-ex3300-stack last message repeated 5 times
    Jun 6 23:44:30 sw-cloud-ex3300-stack last message repeated 3 times
    Jun 6 23:46:39 sw-cloud-ex3300-stack xntpd[10092]: kernel time sync enabled 2001
    Jun 7 00:01:33 sw-cloud-ex3300-stack xntpd[10092]: NTP Server Unreachable
    Jun 7 00:01:49 sw-cloud-ex3300-stack last message repeated 8 times
    Jun 7 00:18:52 sw-cloud-ex3300-stack xntpd[10092]: NTP Server Unreachable
    Jun 7 00:19:08 sw-cloud-ex3300-stack last message repeated 8 times
    Jun 7 00:36:27 sw-cloud-ex3300-stack last message repeated 9 times
    Jun 7 00:53:28 sw-cloud-ex3300-stack xntpd[10092]: NTP Server Unreachable
    Jun 7 00:53:44 sw-cloud-ex3300-stack last message repeated 8 times
    Jun 7 01:11:01 sw-cloud-ex3300-stack last message repeated 9 times
    Jun 7 01:28:03 sw-cloud-ex3300-stack xntpd[10092]: NTP Server Unreachable
    Jun 7 01:28:19 sw-cloud-ex3300-stack last message repeated 8 times
    Jun 7 01:42:53 sw-cloud-ex3300-stack sfid[1303]: JTASK_SCHED_SLIP_KEVENT: 21 sec 481478 usec kevent block
    Jun 7 01:42:53 sw-cloud-ex3300-stack chassism[1302]: JTASK_SCHED_SLIP_KEVENT: 21 sec 486749 usec kevent block
    Jun 7 01:42:53 sw-cloud-ex3300-stack lldpd[10106]: JTASK_SCHED_SLIP: 21 sec scheduler slip, user: 0 sec 0 usec, system: 0 sec, 557 usec
    Jun 7 01:42:53 sw-cloud-ex3300-stack eswd[10087]: JTASK_SCHED_SLIP_KEVENT: 21 sec 526552 usec kevent block
    Jun 7 01:42:53 sw-cloud-ex3300-stack eswd[10087]: Root bridge in context 0 changed from 4:cc:4e:24:3a:e9:b8 to 8192:84:b5:9c:46:79:01
    Jun 7 01:42:53 sw-cloud-ex3300-stack cfmd[10091]: JTASK_SCHED_SLIP_KEVENT: 23 sec 280174 usec kevent block
    Jun 7 01:42:53 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/2 - ATTACHED state - acting as standby link
    Jun 7 01:42:53 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-2/0/2: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:53 sw-cloud-ex3300-stack sflowd[10107]: JTASK_SCHED_SLIP_KEVENT: 24 sec 297734 usec kevent block
    Jun 7 01:42:53 sw-cloud-ex3300-stack mcsnoopd[10108]: JTASK_SCHED_SLIP_KEVENT: 23 sec 337595 usec kevent block
    Jun 7 01:42:53 sw-cloud-ex3300-stack rpd[1319]: RPD_SCHED_SLIP_KEVENT: 22 sec 425412 usec kevent block
    Jun 7 01:42:53 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-2/0/10: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:53 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/10 - ATTACHED state - acting as standby link
    Jun 7 01:42:53 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-2/0/9: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:53 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/9 - ATTACHED state - acting as standby link
    Jun 7 01:42:53 sw-cloud-ex3300-stack bdbrepd: Subscriber Management is not ready for GRES
    Jun 7 01:42:53 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-3/0/10: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:53 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae31: bundle IFD minimum links not met 0 < 1
    Jun 7 01:42:53 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/10 - ATTACHED state - acting as standby link
    Jun 7 01:42:53 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae31: Interface marked down due to lacp timeout on member ge-3/0/10
    Jun 7 01:42:54 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-3/0/9: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:54 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae30: Interface marked down due to lacp timeout on member ge-3/0/9
    Jun 7 01:42:54 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae30: bundle IFD minimum links not met 0 < 1
    Jun 7 01:42:54 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/9 - ATTACHED state - acting as standby link
    Jun 7 01:42:54 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-5/0/11: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:54 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/11 - ATTACHED state - acting as standby link
    Jun 7 01:42:54 sw-cloud-ex3300-stack eswd[10087]: Root bridge in context 0 changed from 8192:84:b5:9c:46:79:01 to 4:cc:4e:24:3a:e9:b8
    Jun 7 01:42:54 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-5/0/16: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:54 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/16 - ATTACHED state - acting as standby link
    Jun 7 01:42:54 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-0/0/10: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:54 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/10 - ATTACHED state - acting as standby link
    Jun 7 01:42:54 sw-cloud-ex3300-stack vccpd[1304]: JTASK_SCHED_SLIP_KEVENT: 22 sec 763173 usec kevent block
    Jun 7 01:42:54 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-2/0/28: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:54 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/28 - ATTACHED state - acting as standby link
    Jun 7 01:42:54 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-3/0/28: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:54 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae46: Interface marked down due to lacp timeout on member ge-3/0/28
    Jun 7 01:42:54 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae46: bundle IFD minimum links not met 0 < 1
    Jun 7 01:42:54 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/28 - ATTACHED state - acting as standby link
    Jun 7 01:42:54 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-3/0/6: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:54 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/6 - ATTACHED state - acting as standby link
    Jun 7 01:42:54 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-3/0/5: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:54 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/5 - ATTACHED state - acting as standby link
    Jun 7 01:42:54 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-2/0/6: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:54 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae26: Interface marked down due to lacp timeout on member ge-2/0/6
    Jun 7 01:42:55 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae26: bundle IFD minimum links not met 0 < 1
    Jun 7 01:42:55 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/6 - ATTACHED state - acting as standby link
    Jun 7 01:42:55 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-2/0/5: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:55 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae25: Interface marked down due to lacp timeout on member ge-2/0/5
    Jun 7 01:42:55 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae25: bundle IFD minimum links not met 0 < 1
    Jun 7 01:42:55 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/5 - ATTACHED state - acting as standby link
    Jun 7 01:42:55 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-1/0/24: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:55 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/24 - ATTACHED state - acting as standby link
    Jun 7 01:42:55 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-4/0/24: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:55 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae44: Interface marked down due to lacp timeout on member ge-4/0/24
    Jun 7 01:42:55 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae44: bundle IFD minimum links not met 0 < 1
    Jun 7 01:42:55 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/24 - ATTACHED state - acting as standby link
    Jun 7 01:42:55 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-4/0/25: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:55 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/25 - ATTACHED state - acting as standby link
    Jun 7 01:42:55 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-1/0/25: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:55 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae45: Interface marked down due to lacp timeout on member ge-1/0/25
    Jun 7 01:42:55 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae45: bundle IFD minimum links not met 0 < 1
    Jun 7 01:42:55 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/25 - ATTACHED state - acting as standby link
    Jun 7 01:42:55 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-4/0/22: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:55 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/22 - ATTACHED state - acting as standby link
    Jun 7 01:42:55 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-1/0/22: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:55 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae38: Interface marked down due to lacp timeout on member ge-1/0/22
    Jun 7 01:42:55 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae38: bundle IFD minimum links not met 0 < 1
    Jun 7 01:42:55 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/22 - ATTACHED state - acting as standby link
    Jun 7 01:42:55 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-1/0/11: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:55 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/11 - ATTACHED state - acting as standby link
    Jun 7 01:42:55 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-5/0/14: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:55 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/14 - ATTACHED state - acting as standby link
    Jun 7 01:42:56 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: xe-0/1/1: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:56 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd xe-0/1/1 - ATTACHED state - acting as standby link
    Jun 7 01:42:56 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: xe-1/1/1: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:56 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae8: Interface marked down due to lacp timeout on member xe-1/1/1
    Jun 7 01:42:56 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae8: bundle IFD minimum links not met 0 < 1
    Jun 7 01:42:56 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd xe-1/1/1 - ATTACHED state - acting as standby link
    Jun 7 01:42:56 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-3/0/8: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:56 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/8 - ATTACHED state - acting as standby link
    Jun 7 01:42:56 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/2 - DETACHED state - will not carry traffic
    Jun 7 01:42:56 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-3/0/7: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:56 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/7 - ATTACHED state - acting as standby link
    Jun 7 01:42:56 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/10 - DETACHED state - will not carry traffic
    Jun 7 01:42:56 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-2/0/8: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:56 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae29: Interface marked down due to lacp timeout on member ge-2/0/8
    Jun 7 01:42:56 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae29: bundle IFD minimum links not met 0 < 1
    Jun 7 01:42:56 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/8 - ATTACHED state - acting as standby link
    Jun 7 01:42:56 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/9 - DETACHED state - will not carry traffic
    Jun 7 01:42:56 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/10 - DETACHED state - will not carry traffic
    Jun 7 01:42:56 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-2/0/7: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:56 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae28: Interface marked down due to lacp timeout on member ge-2/0/7
    Jun 7 01:42:56 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae28: bundle IFD minimum links not met 0 < 1
    Jun 7 01:42:56 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/7 - ATTACHED state - acting as standby link
    Jun 7 01:42:57 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/9 - DETACHED state - will not carry traffic
    Jun 7 01:42:57 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-4/0/3: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:57 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/3 - ATTACHED state - acting as standby link
    Jun 7 01:42:57 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/11 - DETACHED state - will not carry traffic
    Jun 7 01:42:57 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-1/0/1: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:57 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/1 - ATTACHED state - acting as standby link
    Jun 7 01:42:57 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/16 - DETACHED state - will not carry traffic
    Jun 7 01:42:57 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/10 - DETACHED state - will not carry traffic
    Jun 7 01:42:57 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-4/0/1: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:57 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae0: Interface marked down due to lacp timeout on member ge-4/0/1
    Jun 7 01:42:57 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae0: bundle IFD minimum links not met 0 < 1
    Jun 7 01:42:57 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/1 - ATTACHED state - acting as standby link
    Jun 7 01:42:57 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/28 - DETACHED state - will not carry traffic
    Jun 7 01:42:57 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-3/0/4: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:57 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/4 - ATTACHED state - acting as standby link
    Jun 7 01:42:57 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/28 - DETACHED state - will not carry traffic
    Jun 7 01:42:57 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/6 - DETACHED state - will not carry traffic
    Jun 7 01:42:57 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-2/0/4: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:57 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae27: Interface marked down due to lacp timeout on member ge-2/0/4
    Jun 7 01:42:57 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae27: bundle IFD minimum links not met 0 < 1
    Jun 7 01:42:57 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/4 - ATTACHED state - acting as standby link
    Jun 7 01:42:58 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/5 - DETACHED state - will not carry traffic
    Jun 7 01:42:58 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/6 - DETACHED state - will not carry traffic
    Jun 7 01:42:58 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/5 - DETACHED state - will not carry traffic
    Jun 7 01:42:58 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/24 - DETACHED state - will not carry traffic
    Jun 7 01:42:58 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-2/0/0: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:58 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/0 - ATTACHED state - acting as standby link
    Jun 7 01:42:58 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/24 - DETACHED state - will not carry traffic
    Jun 7 01:42:58 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/25 - DETACHED state - will not carry traffic
    Jun 7 01:42:58 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/25 - DETACHED state - will not carry traffic
    Jun 7 01:42:58 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-3/0/0: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:58 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae21: Interface marked down due to lacp timeout on member ge-3/0/0
    Jun 7 01:42:58 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae21: bundle IFD minimum links not met 0 < 1
    Jun 7 01:42:58 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/0 - ATTACHED state - acting as standby link
    Jun 7 01:42:58 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/22 - DETACHED state - will not carry traffic
    Jun 7 01:42:58 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-3/0/12: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:58 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/12 - ATTACHED state - acting as standby link
    Jun 7 01:42:58 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/22 - DETACHED state - will not carry traffic
    Jun 7 01:42:58 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/11 - DETACHED state - will not carry traffic
    Jun 7 01:42:58 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/14 - DETACHED state - will not carry traffic
    Jun 7 01:42:59 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-3/0/11: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:59 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/11 - ATTACHED state - acting as standby link
    Jun 7 01:42:59 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd xe-0/1/1 - DETACHED state - will not carry traffic
    Jun 7 01:42:59 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-2/0/12: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:59 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae33: Interface marked down due to lacp timeout on member ge-2/0/12
    Jun 7 01:42:59 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae33: bundle IFD minimum links not met 0 < 1
    Jun 7 01:42:59 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/12 - ATTACHED state - acting as standby link
    Jun 7 01:42:59 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd xe-1/1/1 - DETACHED state - will not carry traffic
    Jun 7 01:42:59 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-2/0/11: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:59 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae32: Interface marked down due to lacp timeout on member ge-2/0/11
    Jun 7 01:42:59 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae32: bundle IFD minimum links not met 0 < 1
    Jun 7 01:42:59 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/11 - ATTACHED state - acting as standby link
    Jun 7 01:42:59 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/8 - DETACHED state - will not carry traffic
    Jun 7 01:42:59 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/7 - DETACHED state - will not carry traffic
    Jun 7 01:42:59 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-5/0/35: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:59 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/35 - ATTACHED state - acting as standby link
    Jun 7 01:42:59 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/8 - DETACHED state - will not carry traffic
    Jun 7 01:42:59 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-5/0/36: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:59 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/36 - ATTACHED state - acting as standby link
    Jun 7 01:42:59 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/7 - DETACHED state - will not carry traffic
    Jun 7 01:42:59 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-5/0/28: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:42:59 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/28 - ATTACHED state - acting as standby link
    Jun 7 01:43:00 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-3/0/2: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:00 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae23: Interface marked down due to lacp timeout on member ge-3/0/2
    Jun 7 01:43:00 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae23: bundle IFD minimum links not met 0 < 1
    Jun 7 01:43:00 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/2 - ATTACHED state - acting as standby link
    Jun 7 01:43:00 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/3 - DETACHED state - will not carry traffic
    Jun 7 01:43:00 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/1 - DETACHED state - will not carry traffic
    Jun 7 01:43:00 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-3/0/1: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:00 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/1 - ATTACHED state - acting as standby link
    Jun 7 01:43:00 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-2/0/1: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:00 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae22: Interface marked down due to lacp timeout on member ge-2/0/1
    Jun 7 01:43:00 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae22: bundle IFD minimum links not met 0 < 1
    Jun 7 01:43:00 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/1 - ATTACHED state - acting as standby link
    Jun 7 01:43:00 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/1 - DETACHED state - will not carry traffic
    Jun 7 01:43:00 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-0/0/16: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:00 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae50: Interface marked down due to lacp timeout on member ge-0/0/16
    Jun 7 01:43:00 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae50: bundle IFD minimum links not met 0 < 1
    Jun 7 01:43:00 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/16 - ATTACHED state - acting as standby link
    Jun 7 01:43:00 sw-cloud-ex3300-stack eswd[10087]: Root bridge in context 0 changed from 4:cc:4e:24:3a:e9:b8 to 8192:84:b5:9c:46:79:01
    Jun 7 01:43:00 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/4 - DETACHED state - will not carry traffic
    Jun 7 01:43:00 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-5/0/17: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:00 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/17 - ATTACHED state - acting as standby link
    Jun 7 01:43:00 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-0/0/17: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:00 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae51: Interface marked down due to lacp timeout on member ge-0/0/17
    Jun 7 01:43:00 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae51: bundle IFD minimum links not met 0 < 1
    Jun 7 01:43:00 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/17 - ATTACHED state - acting as standby link
    Jun 7 01:43:00 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/4 - DETACHED state - will not carry traffic
    Jun 7 01:43:00 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-1/0/20: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:01 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/20 - ATTACHED state - acting as standby link
    Jun 7 01:43:01 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-4/0/20: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:01 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae36: Interface marked down due to lacp timeout on member ge-4/0/20
    Jun 7 01:43:01 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae36: bundle IFD minimum links not met 0 < 1
    Jun 7 01:43:01 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/20 - ATTACHED state - acting as standby link
    Jun 7 01:43:01 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-1/0/21: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:01 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/21 - ATTACHED state - acting as standby link
    Jun 7 01:43:01 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/0 - DETACHED state - will not carry traffic
    Jun 7 01:43:01 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-4/0/21: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:01 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae37: Interface marked down due to lacp timeout on member ge-4/0/21
    Jun 7 01:43:01 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae37: bundle IFD minimum links not met 0 < 1
    Jun 7 01:43:01 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/21 - ATTACHED state - acting as standby link
    Jun 7 01:43:01 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-3/0/29: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:01 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/29 - ATTACHED state - acting as standby link
    Jun 7 01:43:01 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/0 - DETACHED state - will not carry traffic
    Jun 7 01:43:01 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-2/0/29: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:01 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae47: Interface marked down due to lacp timeout on member ge-2/0/29
    Jun 7 01:43:01 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae47: bundle IFD minimum links not met 0 < 1
    Jun 7 01:43:01 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/29 - ATTACHED state - acting as standby link
    Jun 7 01:43:01 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/12 - DETACHED state - will not carry traffic
    Jun 7 01:43:01 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-0/0/11: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:01 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae9: Interface marked down due to lacp timeout on member ge-0/0/11
    Jun 7 01:43:02 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae9: bundle IFD minimum links not met 0 < 1
    Jun 7 01:43:02 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/11 - ATTACHED state - acting as standby link
    Jun 7 01:43:02 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/11 - DETACHED state - will not carry traffic
    Jun 7 01:43:02 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-5/0/10: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:02 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae13: Interface marked down due to lacp timeout on member ge-5/0/10
    Jun 7 01:43:02 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae13: bundle IFD minimum links not met 0 < 1
    Jun 7 01:43:02 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/10 - ATTACHED state - acting as standby link
    Jun 7 01:43:02 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/12 - DETACHED state - will not carry traffic
    Jun 7 01:43:02 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-1/0/3: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:02 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae1: Interface marked down due to lacp timeout on member ge-1/0/3
    Jun 7 01:43:02 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae1: bundle IFD minimum links not met 0 < 1
    Jun 7 01:43:02 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/3 - ATTACHED state - acting as standby link
    Jun 7 01:43:02 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/11 - DETACHED state - will not carry traffic
    Jun 7 01:43:02 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-3/0/26: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:02 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/26 - ATTACHED state - acting as standby link
    Jun 7 01:43:02 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/35 - DETACHED state - will not carry traffic
    Jun 7 01:43:02 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-2/0/26: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:02 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae42: Interface marked down due to lacp timeout on member ge-2/0/26
    Jun 7 01:43:02 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae42: bundle IFD minimum links not met 0 < 1
    Jun 7 01:43:02 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/26 - ATTACHED state - acting as standby link
    Jun 7 01:43:02 sw-cloud-ex3300-stack bdbrepd: Subscriber Management is ready for GRES
    Jun 7 01:43:02 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-3/0/27: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:02 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/27 - ATTACHED state - acting as standby link
    Jun 7 01:43:02 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/36 - DETACHED state - will not carry traffic
    Jun 7 01:43:02 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-2/0/27: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:02 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae43: Interface marked down due to lacp timeout on member ge-2/0/27
    Jun 7 01:43:02 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae43: bundle IFD minimum links not met 0 < 1
    Jun 7 01:43:02 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/27 - ATTACHED state - acting as standby link
    Jun 7 01:43:03 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/28 - DETACHED state - will not carry traffic
    Jun 7 01:43:03 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-1/0/23: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:03 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/23 - ATTACHED state - acting as standby link
    Jun 7 01:43:03 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/2 - DETACHED state - will not carry traffic
    Jun 7 01:43:03 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-4/0/23: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:03 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae39: Interface marked down due to lacp timeout on member ge-4/0/23
    Jun 7 01:43:03 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae39: bundle IFD minimum links not met 0 < 1
    Jun 7 01:43:03 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/23 - ATTACHED state - acting as standby link
    Jun 7 01:43:03 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/1 - DETACHED state - will not carry traffic
    Jun 7 01:43:03 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/1 - DETACHED state - will not carry traffic
    Jun 7 01:43:03 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/16 - DETACHED state - will not carry traffic
    Jun 7 01:43:03 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-4/0/11: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:03 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae48: Interface marked down due to lacp timeout on member ge-4/0/11
    Jun 7 01:43:03 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae48: bundle IFD minimum links not met 0 < 1
    Jun 7 01:43:03 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/11 - ATTACHED state - acting as standby link
    Jun 7 01:43:03 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/17 - DETACHED state - will not carry traffic
    Jun 7 01:43:03 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-5/0/15: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:03 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/15 - ATTACHED state - acting as standby link
    Jun 7 01:43:03 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/17 - DETACHED state - will not carry traffic
    Jun 7 01:43:03 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-0/0/14: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:03 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae14: Interface marked down due to lacp timeout on member ge-0/0/14
    Jun 7 01:43:03 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae14: bundle IFD minimum links not met 0 < 1
    Jun 7 01:43:03 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/14 - ATTACHED state - acting as standby link
    Jun 7 01:43:04 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/20 - DETACHED state - will not carry traffic
    Jun 7 01:43:04 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-0/0/15: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:04 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae15: Interface marked down due to lacp timeout on member ge-0/0/15
    Jun 7 01:43:04 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae15: bundle IFD minimum links not met 0 < 1
    Jun 7 01:43:04 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/15 - ATTACHED state - acting as standby link
    Jun 7 01:43:04 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/20 - DETACHED state - will not carry traffic
    Jun 7 01:43:04 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/21 - DETACHED state - will not carry traffic
    Jun 7 01:43:04 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-4/0/12: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:04 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/12 - ATTACHED state - acting as standby link
    Jun 7 01:43:04 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/21 - DETACHED state - will not carry traffic
    Jun 7 01:43:04 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-1/0/12: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:04 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae49: Interface marked down due to lacp timeout on member ge-1/0/12
    Jun 7 01:43:04 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae49: bundle IFD minimum links not met 0 < 1
    Jun 7 01:43:04 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/12 - ATTACHED state - acting as standby link
    Jun 7 01:43:04 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/29 - DETACHED state - will not carry traffic
    Jun 7 01:43:04 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-2/0/24: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:04 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/29 - DETACHED state - will not carry traffic
    Jun 7 01:43:04 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/24 - ATTACHED state - acting as standby link
    Jun 7 01:43:04 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-3/0/24: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:04 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae40: Interface marked down due to lacp timeout on member ge-3/0/24
    Jun 7 01:43:04 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae40: bundle IFD minimum links not met 0 < 1
    Jun 7 01:43:04 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/24 - ATTACHED state - acting as standby link
    Jun 7 01:43:05 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/11 - DETACHED state - will not carry traffic
    Jun 7 01:43:05 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-3/0/25: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:05 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/25 - ATTACHED state - acting as standby link
    Jun 7 01:43:05 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/10 - DETACHED state - will not carry traffic
    Jun 7 01:43:05 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-1/0/46: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:05 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/46 - ATTACHED state - acting as standby link
    Jun 7 01:43:05 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/3 - DETACHED state - will not carry traffic
    Jun 7 01:43:05 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-0/0/46: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:05 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae20: Interface marked down due to lacp timeout on member ge-0/0/46
    Jun 7 01:43:05 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae20: bundle IFD minimum links not met 0 < 1
    Jun 7 01:43:05 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/46 - ATTACHED state - acting as standby link
    Jun 7 01:43:05 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/26 - DETACHED state - will not carry traffic
    Jun 7 01:43:05 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-2/0/25: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:05 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae41: Interface marked down due to lacp timeout on member ge-2/0/25
    Jun 7 01:43:05 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae41: bundle IFD minimum links not met 0 < 1
    Jun 7 01:43:05 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/25 - ATTACHED state - acting as standby link
    Jun 7 01:43:05 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/26 - DETACHED state - will not carry traffic
    Jun 7 01:43:05 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-1/0/5: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:05 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/5 - ATTACHED state - acting as standby link
    Jun 7 01:43:05 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/27 - DETACHED state - will not carry traffic
    Jun 7 01:43:05 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-4/0/5: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:05 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae3: Interface marked down due to lacp timeout on member ge-4/0/5
    Jun 7 01:43:05 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae3: bundle IFD minimum links not met 0 < 1
    Jun 7 01:43:05 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/5 - ATTACHED state - acting as standby link
    Jun 7 01:43:06 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/27 - DETACHED state - will not carry traffic
    Jun 7 01:43:06 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-2/0/3: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:06 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/3 - ATTACHED state - acting as standby link
    Jun 7 01:43:06 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/23 - DETACHED state - will not carry traffic
    Jun 7 01:43:06 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-3/0/3: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:06 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae24: Interface marked down due to lacp timeout on member ge-3/0/3
    Jun 7 01:43:06 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae24: bundle IFD minimum links not met 0 < 1
    Jun 7 01:43:06 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/3 - ATTACHED state - acting as standby link
    Jun 7 01:43:06 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/23 - DETACHED state - will not carry traffic
    Jun 7 01:43:06 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-0/0/28: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:06 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae16: Interface marked down due to lacp timeout on member ge-0/0/28
    Jun 7 01:43:06 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae16: bundle IFD minimum links not met 0 < 1
    Jun 7 01:43:06 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/28 - ATTACHED state - acting as standby link
    Jun 7 01:43:06 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-0/0/35: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:06 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae18: Interface marked down due to lacp timeout on member ge-0/0/35
    Jun 7 01:43:06 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae18: bundle IFD minimum links not met 0 < 1
    Jun 7 01:43:06 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/35 - ATTACHED state - acting as standby link
    Jun 7 01:43:06 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/11 - DETACHED state - will not carry traffic
    Jun 7 01:43:06 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-0/0/36: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:06 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae19: Interface marked down due to lacp timeout on member ge-0/0/36
    Jun 7 01:43:06 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae19: bundle IFD minimum links not met 0 < 1
    Jun 7 01:43:06 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/36 - ATTACHED state - acting as standby link
    Jun 7 01:43:06 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/15 - DETACHED state - will not carry traffic
    Jun 7 01:43:06 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-1/0/6: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:06 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/6 - ATTACHED state - acting as standby link
    Jun 7 01:43:07 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/14 - DETACHED state - will not carry traffic
    Jun 7 01:43:07 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/15 - DETACHED state - will not carry traffic
    Jun 7 01:43:07 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-4/0/6: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:07 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae4: Interface marked down due to lacp timeout on member ge-4/0/6
    Jun 7 01:43:07 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae4: bundle IFD minimum links not met 0 < 1
    Jun 7 01:43:07 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/6 - ATTACHED state - acting as standby link
    Jun 7 01:43:07 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-4/0/18: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:07 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/18 - ATTACHED state - acting as standby link
    Jun 7 01:43:07 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/12 - DETACHED state - will not carry traffic
    Jun 7 01:43:07 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-1/0/18: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:07 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae35: Interface marked down due to lacp timeout on member ge-1/0/18
    Jun 7 01:43:07 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae35: bundle IFD minimum links not met 0 < 1
    Jun 7 01:43:07 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/18 - ATTACHED state - acting as standby link
    Jun 7 01:43:07 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/12 - DETACHED state - will not carry traffic
    Jun 7 01:43:07 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-1/0/19: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:07 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/19 - ATTACHED state - acting as standby link
    Jun 7 01:43:07 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/24 - DETACHED state - will not carry traffic
    Jun 7 01:43:07 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-4/0/19: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:07 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae34: Interface marked down due to lacp timeout on member ge-4/0/19
    Jun 7 01:43:07 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae34: bundle IFD minimum links not met 0 < 1
    Jun 7 01:43:07 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/19 - ATTACHED state - acting as standby link
    Jun 7 01:43:08 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/24 - DETACHED state - will not carry traffic
    Jun 7 01:43:08 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-0/0/29: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:08 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/29 - ATTACHED state - acting as standby link
    Jun 7 01:43:08 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/25 - DETACHED state - will not carry traffic
    Jun 7 01:43:08 sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-5/0/29: lacp current while timer expired current Receive State: CURRENT
    Jun 7 01:43:08 sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae17: Interface marked down due to lacp timeout on member ge-5/0/29
    Jun 7 01:43:08 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae17: bundle IFD minimum links not met 0 < 1
    Jun 7 01:43:08 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/29 - ATTACHED state - acting as standby link
    Jun 7 01:43:08 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/46 - DETACHED state - will not carry traffic
    Jun 7 01:43:08 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/46 - DETACHED state - will not carry traffic
    Jun 7 01:43:08 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/25 - DETACHED state - will not carry traffic
    Jun 7 01:43:08 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/5 - DETACHED state - will not carry traffic
    Jun 7 01:43:09 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/5 - DETACHED state - will not carry traffic
    Jun 7 01:43:09 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/3 - DETACHED state - will not carry traffic
    Jun 7 01:43:09 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/3 - DETACHED state - will not carry traffic
    Jun 7 01:43:09 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/28 - DETACHED state - will not carry traffic
    Jun 7 01:43:09 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/35 - DETACHED state - will not carry traffic
    Jun 7 01:43:09 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/36 - DETACHED state - will not carry traffic
    Jun 7 01:43:10 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/6 - DETACHED state - will not carry traffic
    Jun 7 01:43:10 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/6 - DETACHED state - will not carry traffic
    Jun 7 01:43:10 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/18 - DETACHED state - will not carry traffic
    Jun 7 01:43:10 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/18 - DETACHED state - will not carry traffic
    Jun 7 01:43:10 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/2 - ATTACHED state - acting as standby link
    Jun 7 01:43:10 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/2 - CD state - ready to carry traffic
    Jun 7 01:43:10 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/19 - DETACHED state - will not carry traffic
    Jun 7 01:43:10 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/10 - ATTACHED state - acting as standby link
    Jun 7 01:43:10 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/10 - CD state - ready to carry traffic
    Jun 7 01:43:10 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/9 - ATTACHED state - acting as standby link
    Jun 7 01:43:10 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/9 - CD state - ready to carry traffic
    Jun 7 01:43:10 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/10 - ATTACHED state - acting as standby link
    Jun 7 01:43:10 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/10 - CD state - ready to carry traffic
    Jun 7 01:43:11 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/9 - ATTACHED state - acting as standby link
    Jun 7 01:43:11 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/9 - CD state - ready to carry traffic
    Jun 7 01:43:11 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/16 - ATTACHED state - acting as standby link
    Jun 7 01:43:11 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/16 - CD state - ready to carry traffic
    Jun 7 01:43:11 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/19 - DETACHED state - will not carry traffic
    Jun 7 01:43:11 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/29 - DETACHED state - will not carry traffic
    Jun 7 01:43:11 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/28 - ATTACHED state - acting as standby link
    Jun 7 01:43:11 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/28 - CD state - ready to carry traffic
    Jun 7 01:43:11 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/11 - ATTACHED state - acting as standby link
    Jun 7 01:43:11 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/11 - CD state - ready to carry traffic
    Jun 7 01:43:11 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/10 - ATTACHED state - acting as standby link
    Jun 7 01:43:11 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/10 - CD state - ready to carry traffic
    Jun 7 01:43:11 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/28 - ATTACHED state - acting as standby link
    Jun 7 01:43:11 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/28 - CD state - ready to carry traffic
    Jun 7 01:43:11 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/29 - DETACHED state - will not carry traffic
    Jun 7 01:43:11 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/6 - ATTACHED state - acting as standby link
    Jun 7 01:43:11 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/6 - CD state - ready to carry traffic
    Jun 7 01:43:12 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/5 - ATTACHED state - acting as standby link
    Jun 7 01:43:12 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/5 - CD state - ready to carry traffic
    Jun 7 01:43:12 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/6 - ATTACHED state - acting as standby link
    Jun 7 01:43:12 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/6 - CD state - ready to carry traffic
    Jun 7 01:43:12 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/5 - ATTACHED state - acting as standby link
    Jun 7 01:43:12 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/5 - CD state - ready to carry traffic
    Jun 7 01:43:12 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/24 - ATTACHED state - acting as standby link
    Jun 7 01:43:12 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/24 - CD state - ready to carry traffic
    Jun 7 01:43:12 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/24 - ATTACHED state - acting as standby link
    Jun 7 01:43:12 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/24 - CD state - ready to carry traffic
    Jun 7 01:43:12 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/25 - ATTACHED state - acting as standby link
    Jun 7 01:43:12 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/25 - CD state - ready to carry traffic
    Jun 7 01:43:12 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/25 - ATTACHED state - acting as standby link
    Jun 7 01:43:12 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/25 - CD state - ready to carry traffic
    Jun 7 01:43:12 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/22 - ATTACHED state - acting as standby link
    Jun 7 01:43:12 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/22 - CD state - ready to carry traffic
    Jun 7 01:43:12 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/22 - ATTACHED state - acting as standby link
    Jun 7 01:43:12 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/22 - CD state - ready to carry traffic
    Jun 7 01:43:12 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/14 - ATTACHED state - acting as standby link
    Jun 7 01:43:12 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/14 - CD state - ready to carry traffic
    Jun 7 01:43:12 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd xe-0/1/1 - ATTACHED state - acting as standby link
    Jun 7 01:43:12 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd xe-0/1/1 - CD state - ready to carry traffic
    Jun 7 01:43:13 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/11 - ATTACHED state - acting as standby link
    Jun 7 01:43:13 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/11 - CD state - ready to carry traffic
    Jun 7 01:43:13 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/8 - ATTACHED state - acting as standby link
    Jun 7 01:43:13 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/8 - CD state - ready to carry traffic
    Jun 7 01:43:13 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/7 - ATTACHED state - acting as standby link
    Jun 7 01:43:13 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/7 - CD state - ready to carry traffic
    Jun 7 01:43:13 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/8 - ATTACHED state - acting as standby link
    Jun 7 01:43:13 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/8 - CD state - ready to carry traffic
    Jun 7 01:43:13 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd xe-1/1/1 - ATTACHED state - acting as standby link
    Jun 7 01:43:13 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd xe-1/1/1 - CD state - ready to carry traffic
    Jun 7 01:43:13 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/7 - ATTACHED state - acting as standby link
    Jun 7 01:43:13 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/7 - CD state - ready to carry traffic
    Jun 7 01:43:15 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd xe-0/1/1 - ATTACHED state - acting as standby link
    Jun 7 01:43:15 sw-cloud-ex3300-stack /kernel: ae_bundlestate_ifd_change: bundle ae8: bundle IFD minimum links not met 0 < 1
    Jun 7 01:43:15 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd xe-1/1/1 - ATTACHED state - acting as standby link
    Jun 7 01:43:15 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/3 - ATTACHED state - acting as standby link
    Jun 7 01:43:15 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/3 - CD state - ready to carry traffic
    Jun 7 01:43:15 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/1 - ATTACHED state - acting as standby link
    Jun 7 01:43:15 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/1 - CD state - ready to carry traffic
    Jun 7 01:43:16 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/1 - ATTACHED state - acting as standby link
    Jun 7 01:43:16 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/1 - CD state - ready to carry traffic
    Jun 7 01:43:16 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/4 - ATTACHED state - acting as standby link
    Jun 7 01:43:16 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/4 - CD state - ready to carry traffic
    Jun 7 01:43:16 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/4 - ATTACHED state - acting as standby link
    Jun 7 01:43:16 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/4 - CD state - ready to carry traffic
    Jun 7 01:43:16 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/0 - ATTACHED state - acting as standby link
    Jun 7 01:43:16 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/0 - CD state - ready to carry traffic
    Jun 7 01:43:16 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/0 - ATTACHED state - acting as standby link
    Jun 7 01:43:16 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/0 - CD state - ready to carry traffic
    Jun 7 01:43:17 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/12 - ATTACHED state - acting as standby link
    Jun 7 01:43:17 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/12 - CD state - ready to carry traffic
    Jun 7 01:43:17 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/11 - ATTACHED state - acting as standby link
    Jun 7 01:43:17 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/11 - CD state - ready to carry traffic
    Jun 7 01:43:17 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/12 - ATTACHED state - acting as standby link
    Jun 7 01:43:17 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/12 - CD state - ready to carry traffic
    Jun 7 01:43:17 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/11 - ATTACHED state - acting as standby link
    Jun 7 01:43:17 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/11 - CD state - ready to carry traffic
    Jun 7 01:43:17 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/35 - ATTACHED state - acting as standby link
    Jun 7 01:43:17 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/35 - CD state - ready to carry traffic
    Jun 7 01:43:18 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/36 - ATTACHED state - acting as standby link
    Jun 7 01:43:18 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/36 - CD state - ready to carry traffic
    Jun 7 01:43:18 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/28 - ATTACHED state - acting as standby link
    Jun 7 01:43:18 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/28 - CD state - ready to carry traffic
    Jun 7 01:43:18 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/2 - ATTACHED state - acting as standby link
    Jun 7 01:43:18 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/2 - CD state - ready to carry traffic
    Jun 7 01:43:19 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/1 - ATTACHED state - acting as standby link
    Jun 7 01:43:19 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/1 - CD state - ready to carry traffic
    Jun 7 01:43:19 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/1 - ATTACHED state - acting as standby link
    Jun 7 01:43:19 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/1 - CD state - ready to carry traffic
    Jun 7 01:43:20 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/16 - ATTACHED state - acting as standby link
    Jun 7 01:43:20 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/16 - CD state - ready to carry traffic
    Jun 7 01:43:20 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd xe-0/1/1 - CD state - ready to carry traffic
    Jun 7 01:43:20 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/17 - ATTACHED state - acting as standby link
    Jun 7 01:43:20 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/17 - CD state - ready to carry traffic
    Jun 7 01:43:20 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/20 - ATTACHED state - acting as standby link
    Jun 7 01:43:20 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/20 - CD state - ready to carry traffic
    Jun 7 01:43:20 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/17 - ATTACHED state - acting as standby link
    Jun 7 01:43:20 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/17 - CD state - ready to carry traffic
    Jun 7 01:43:20 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/20 - ATTACHED state - acting as standby link
    Jun 7 01:43:20 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/20 - CD state - ready to carry traffic
    Jun 7 01:43:21 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/21 - ATTACHED state - acting as standby link
    Jun 7 01:43:21 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/21 - CD state - ready to carry traffic
    Jun 7 01:43:21 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/21 - ATTACHED state - acting as standby link
    Jun 7 01:43:21 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/21 - CD state - ready to carry traffic
    Jun 7 01:43:21 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/29 - ATTACHED state - acting as standby link
    Jun 7 01:43:21 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/29 - CD state - ready to carry traffic
    Jun 7 01:43:21 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd xe-1/1/1 - CD state - ready to carry traffic
    Jun 7 01:43:21 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/29 - ATTACHED state - acting as standby link
    Jun 7 01:43:21 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/29 - CD state - ready to carry traffic
    Jun 7 01:43:22 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/11 - ATTACHED state - acting as standby link
    Jun 7 01:43:22 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/11 - CD state - ready to carry traffic
    Jun 7 01:43:22 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/10 - ATTACHED state - acting as standby link
    Jun 7 01:43:22 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/10 - CD state - ready to carry traffic
    Jun 7 01:43:22 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/3 - ATTACHED state - acting as standby link
    Jun 7 01:43:22 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/3 - CD state - ready to carry traffic
    Jun 7 01:43:22 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/26 - ATTACHED state - acting as standby link
    Jun 7 01:43:22 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/26 - CD state - ready to carry traffic
    Jun 7 01:43:24 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/26 - ATTACHED state - acting as standby link
    Jun 7 01:43:24 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/26 - CD state - ready to carry traffic
    Jun 7 01:43:24 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/27 - ATTACHED state - acting as standby link
    Jun 7 01:43:24 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/27 - CD state - ready to carry traffic
    Jun 7 01:43:25 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/27 - ATTACHED state - acting as standby link
    Jun 7 01:43:25 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/27 - CD state - ready to carry traffic
    Jun 7 01:43:25 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/23 - ATTACHED state - acting as standby link
    Jun 7 01:43:25 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/23 - CD state - ready to carry traffic
    Jun 7 01:43:25 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/23 - ATTACHED state - acting as standby link
    Jun 7 01:43:25 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/23 - CD state - ready to carry traffic
    Jun 7 01:43:25 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/11 - ATTACHED state - acting as standby link
    Jun 7 01:43:25 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/11 - CD state - ready to carry traffic
    Jun 7 01:43:26 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/15 - ATTACHED state - acting as standby link
    Jun 7 01:43:26 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/15 - CD state - ready to carry traffic
    Jun 7 01:43:26 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/14 - ATTACHED state - acting as standby link
    Jun 7 01:43:26 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/14 - CD state - ready to carry traffic
    Jun 7 01:43:26 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/15 - ATTACHED state - acting as standby link
    Jun 7 01:43:26 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/15 - CD state - ready to carry traffic
    Jun 7 01:43:26 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/12 - ATTACHED state - acting as standby link
    Jun 7 01:43:26 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/12 - CD state - ready to carry traffic
    Jun 7 01:43:27 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/12 - ATTACHED state - acting as standby link
    Jun 7 01:43:27 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/12 - CD state - ready to carry traffic
    Jun 7 01:43:27 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/24 - ATTACHED state - acting as standby link
    Jun 7 01:43:27 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/24 - CD state - ready to carry traffic
    Jun 7 01:43:28 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/24 - ATTACHED state - acting as standby link
    Jun 7 01:43:28 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/24 - CD state - ready to carry traffic
    Jun 7 01:43:28 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/25 - ATTACHED state - acting as standby link
    Jun 7 01:43:28 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/25 - CD state - ready to carry traffic
    Jun 7 01:43:29 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 970, ifAdminStatus up(1), ifOperStatus down(2), ifName ae31
    Jun 7 01:43:29 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 966, ifAdminStatus up(1), ifOperStatus down(2), ifName ae30
    Jun 7 01:43:29 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 1053, ifAdminStatus up(1), ifOperStatus down(2), ifName ae46
    Jun 7 01:43:29 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 950, ifAdminStatus up(1), ifOperStatus down(2), ifName ae26
    Jun 7 01:43:29 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 942, ifAdminStatus up(1), ifOperStatus down(2), ifName ae25
    Jun 7 01:43:29 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 1034, ifAdminStatus up(1), ifOperStatus down(2), ifName ae44
    Jun 7 01:43:29 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 1036, ifAdminStatus up(1), ifOperStatus down(2), ifName ae45
    Jun 7 01:43:29 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 1010, ifAdminStatus up(1), ifOperStatus down(2), ifName ae38
    Jun 7 01:43:29 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 719, ifAdminStatus up(1), ifOperStatus down(2), ifName ae8
    Jun 7 01:43:29 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 962, ifAdminStatus up(1), ifOperStatus down(2), ifName ae29
    Jun 7 01:43:29 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 958, ifAdminStatus up(1), ifOperStatus down(2), ifName ae28
    Jun 7 01:43:29 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 554, ifAdminStatus up(1), ifOperStatus down(2), ifName ae0
    Jun 7 01:43:29 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 956, ifAdminStatus up(1), ifOperStatus down(2), ifName ae27
    Jun 7 01:43:29 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 928, ifAdminStatus up(1), ifOperStatus down(2), ifName ae21
    Jun 7 01:43:29 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 978, ifAdminStatus up(1), ifOperStatus down(2), ifName ae33
    Jun 7 01:43:29 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 974, ifAdminStatus up(1), ifOperStatus down(2), ifName ae32
    Jun 7 01:43:29 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 933, ifAdminStatus up(1), ifOperStatus down(2), ifName ae23
    Jun 7 01:43:29 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 932, ifAdminStatus up(1), ifOperStatus down(2), ifName ae22
    Jun 7 01:43:29 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/5 - ATTACHED state - acting as standby link
    Jun 7 01:43:29 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/5 - CD state - ready to carry traffic
    Jun 7 01:43:30 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/25 - ATTACHED state - acting as standby link
    Jun 7 01:43:30 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/25 - CD state - ready to carry traffic
    Jun 7 01:43:30 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 1072, ifAdminStatus up(1), ifOperStatus down(2), ifName ae50
    Jun 7 01:43:30 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/5 - ATTACHED state - acting as standby link
    Jun 7 01:43:30 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/5 - CD state - ready to carry traffic
    Jun 7 01:43:30 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/46 - ATTACHED state - acting as standby link
    Jun 7 01:43:30 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/46 - CD state - ready to carry traffic
    Jun 7 01:43:30 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 1073, ifAdminStatus up(1), ifOperStatus down(2), ifName ae51
    Jun 7 01:43:30 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/46 - ATTACHED state - acting as standby link
    Jun 7 01:43:30 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/46 - CD state - ready to carry traffic
    Jun 7 01:43:30 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 1004, ifAdminStatus up(1), ifOperStatus down(2), ifName ae36
    Jun 7 01:43:30 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 1005, ifAdminStatus up(1), ifOperStatus down(2), ifName ae37
    Jun 7 01:43:30 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 1056, ifAdminStatus up(1), ifOperStatus down(2), ifName ae47
    Jun 7 01:43:31 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/3 - ATTACHED state - acting as standby link
    Jun 7 01:43:31 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-2/0/3 - CD state - ready to carry traffic
    Jun 7 01:43:31 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 721, ifAdminStatus up(1), ifOperStatus down(2), ifName ae9
    Jun 7 01:43:31 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/3 - ATTACHED state - acting as standby link
    Jun 7 01:43:31 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 729, ifAdminStatus up(1), ifOperStatus down(2), ifName ae13
    Jun 7 01:43:31 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-3/0/3 - CD state - ready to carry traffic
    Jun 7 01:43:31 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 556, ifAdminStatus up(1), ifOperStatus down(2), ifName ae1
    Jun 7 01:43:31 sw-cloud-ex3300-stack eswd[10087]: Root bridge in context 0 changed from 8192:84:b5:9c:46:79:01 to 4:cc:4e:24:3a:e9:b8
    Jun 7 01:43:31 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 1018, ifAdminStatus up(1), ifOperStatus down(2), ifName ae42
    Jun 7 01:43:31 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 1019, ifAdminStatus up(1), ifOperStatus down(2), ifName ae43
    Jun 7 01:43:31 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 1011, ifAdminStatus up(1), ifOperStatus down(2), ifName ae39
    Jun 7 01:43:31 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 1066, ifAdminStatus up(1), ifOperStatus down(2), ifName ae48
    Jun 7 01:43:32 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 731, ifAdminStatus up(1), ifOperStatus down(2), ifName ae14
    Jun 7 01:43:32 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 733, ifAdminStatus up(1), ifOperStatus down(2), ifName ae15
    Jun 7 01:43:32 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 1067, ifAdminStatus up(1), ifOperStatus down(2), ifName ae49
    Jun 7 01:43:33 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/28 - ATTACHED state - acting as standby link
    Jun 7 01:43:33 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/28 - CD state - ready to carry traffic
    Jun 7 01:43:33 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/35 - ATTACHED state - acting as standby link
    Jun 7 01:43:33 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/35 - CD state - ready to carry traffic
    Jun 7 01:43:33 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/36 - ATTACHED state - acting as standby link
    Jun 7 01:43:33 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/36 - CD state - ready to carry traffic
    Jun 7 01:43:33 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/6 - ATTACHED state - acting as standby link
    Jun 7 01:43:33 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/6 - CD state - ready to carry traffic
    Jun 7 01:43:34 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/6 - ATTACHED state - acting as standby link
    Jun 7 01:43:34 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/6 - CD state - ready to carry traffic
    Jun 7 01:43:34 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/18 - ATTACHED state - acting as standby link
    Jun 7 01:43:34 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/18 - CD state - ready to carry traffic
    Jun 7 01:43:34 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/18 - ATTACHED state - acting as standby link
    Jun 7 01:43:34 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/18 - CD state - ready to carry traffic
    Jun 7 01:43:34 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/19 - ATTACHED state - acting as standby link
    Jun 7 01:43:34 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-1/0/19 - CD state - ready to carry traffic
    Jun 7 01:43:35 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/19 - ATTACHED state - acting as standby link
    Jun 7 01:43:35 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-4/0/19 - CD state - ready to carry traffic
    Jun 7 01:43:36 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/29 - ATTACHED state - acting as standby link
    Jun 7 01:43:36 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-5/0/29 - CD state - ready to carry traffic
    Jun 7 01:43:36 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/29 - ATTACHED state - acting as standby link
    Jun 7 01:43:36 sw-cloud-ex3300-stack /kernel: KERN_LACP_INTF_STATE_CHANGE: lacp_update_state_userspace: cifd ge-0/0/29 - CD state - ready to carry traffic
    Jun 7 01:43:47 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 1016, ifAdminStatus up(1), ifOperStatus down(2), ifName ae40
    Jun 7 01:43:48 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 743, ifAdminStatus up(1), ifOperStatus down(2), ifName ae20
    Jun 7 01:43:48 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 1017, ifAdminStatus up(1), ifOperStatus down(2), ifName ae41
    Jun 7 01:43:49 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 709, ifAdminStatus up(1), ifOperStatus down(2), ifName ae3
    Jun 7 01:43:49 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 941, ifAdminStatus up(1), ifOperStatus down(2), ifName ae24
    Jun 7 01:43:49 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 735, ifAdminStatus up(1), ifOperStatus down(2), ifName ae16
    Jun 7 01:43:49 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 739, ifAdminStatus up(1), ifOperStatus down(2), ifName ae18
    Jun 7 01:43:49 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 740, ifAdminStatus up(1), ifOperStatus down(2), ifName ae19
    Jun 7 01:43:49 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 711, ifAdminStatus up(1), ifOperStatus down(2), ifName ae4
    Jun 7 01:43:49 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 1001, ifAdminStatus up(1), ifOperStatus down(2), ifName ae35
    Jun 7 01:43:49 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 996, ifAdminStatus up(1), ifOperStatus down(2), ifName ae34
    Jun 7 01:43:49 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 736, ifAdminStatus up(1), ifOperStatus down(2), ifName ae17
    Jun 7 01:43:52 sw-cloud-ex3300-stack mib2d[10110]: SNMP_TRAP_LINK_DOWN: ifIndex 719, ifAdminStatus up(1), ifOperStatus down(2), ifName ae8
    Jun 7 01:45:00 sw-cloud-ex3300-stack newsyslog[19037]: logfile turned over due to size>128K
    Some interresting logs can be:
    Jun  7 01:43:08  sw-cloud-ex3300-stack lacpd[1329]: LACPD_TIMEOUT: ge-5/0/29: lacp current while timer expired current Receive State: CURRENT
Jun  7 01:43:08  sw-cloud-ex3300-stack lacpd[1329]: LACP_INTF_DOWN: ae17: Interface marked down due to lacp timeout on member ge-5/0/29
    All timeout came at same time. Can lacpd process can be the root cause ?


  • 6.  RE: Virtual Chassis LACP flap (GRES / NSB ?)

     
    Posted 06-07-2016 06:57

    Hi,

     

    All LACP flapping at same time indicate some local issue.

    To dig further, you may look at "show log chassisd".

     

    Can you also check ouput of the following commands:

     

    show chassis routing-engine
show virtual-chassis
show virtual-chassis status

    "show system switchover" would only display the state of GRES and not the command to be looking for any RE failover.

     

     



  • 7.  RE: Virtual Chassis LACP flap (GRES / NSB ?)

    Posted 06-07-2016 07:06

    show log chassisd output:

     

    Apr 27 17:00:32  adding message to chasssis manager queue, entries = 7
Apr 27 17:00:32  send: clear all Fan 7 alarms
Apr 27 17:00:32  adding message to chasssis manager queue, entries = 8
Apr 27 17:00:32  send: clear all Fan 8 alarms
Apr 27 17:00:32  adding message to chasssis manager queue, entries = 9
Apr 27 17:00:32  send: clear all Fan 9 alarms
Apr 27 17:00:32  adding message to chasssis manager queue, entries = 10
Apr 27 17:00:32  Fru type 5 in ch_do_fru_inits
Apr 27 17:00:32  initial startup complete
Jun  7 01:43:26  op 2 for ifd ge-0/0/14 
Jun  7 01:43:26  op 2 for ifd ge-0/0/15
Jun  7 01:43:26  op 2 for ifd ge-0/0/15
Jun  7 01:43:26  op 2 for ifd ge-4/0/12
Jun  7 01:43:26  op 2 for ifd ge-4/0/12
Jun  7 01:43:27  op 2 for ifd ge-1/0/12
Jun  7 01:43:27  op 2 for ifd ge-1/0/12
Jun  7 01:43:27  op 2 for ifd ge-2/0/24
Jun  7 01:43:27  op 2 for ifd ge-2/0/24
Jun  7 01:43:28  op 2 for ifd ge-3/0/24
Jun  7 01:43:28  op 2 for ifd ge-3/0/24
Jun  7 01:43:28  op 2 for ifd ge-3/0/25
Jun  7 01:43:28  op 2 for ifd ge-3/0/25
Jun  7 01:43:29  op 2 for ifd ge-1/0/5
Jun  7 01:43:29  op 2 for ifd ge-1/0/5
Jun  7 01:43:30  op 2 for ifd ge-2/0/25
Jun  7 01:43:30  op 2 for ifd ge-2/0/25
Jun  7 01:43:30  op 2 for ifd ge-4/0/5
Jun  7 01:43:30  op 2 for ifd ge-4/0/5
Jun  7 01:43:30  op 2 for ifd ge-0/0/46
Jun  7 01:43:30  op 2 for ifd ge-0/0/46
Jun  7 01:43:30  op 2 for ifd ge-1/0/46
Jun  7 01:43:31  op 2 for ifd ge-2/0/3
Jun  7 01:43:31  op 2 for ifd ge-2/0/3
Jun  7 01:43:31  op 2 for ifd ge-3/0/3
Jun  7 01:43:31  op 2 for ifd ge-3/0/3
Jun  7 01:43:33  op 2 for ifd ge-0/0/28
Jun  7 01:43:33  op 2 for ifd ge-0/0/35
Jun  7 01:43:33  op 2 for ifd ge-0/0/35
Jun  7 01:43:33  op 2 for ifd ge-0/0/36
Jun  7 01:43:33  op 2 for ifd ge-0/0/36
Jun  7 01:43:33  op 2 for ifd ge-1/0/6
Jun  7 01:43:33  op 2 for ifd ge-1/0/6
Jun  7 01:43:34  op 2 for ifd ge-4/0/6
Jun  7 01:43:34  op 2 for ifd ge-4/0/6
Jun  7 01:43:34  op 2 for ifd ge-4/0/18
Jun  7 01:43:34  op 2 for ifd ge-4/0/18
Jun  7 01:43:34  op 2 for ifd ge-1/0/18
Jun  7 01:43:34  op 2 for ifd ge-1/0/18
Jun  7 01:43:34  op 2 for ifd ge-1/0/19
Jun  7 01:43:34  op 2 for ifd ge-1/0/19
Jun  7 01:43:35  op 2 for ifd ge-4/0/19
Jun  7 01:43:35  op 2 for ifd ge-5/0/29
Jun  7 01:43:36  op 2 for ifd ge-5/0/29
Jun  7 01:43:36  op 2 for ifd ge-0/0/29
Jun  7 01:43:36  op 2 for ifd ge-0/0/29
Jun  7 01:46:58  op 2 for ifd ge-5/0/10
Jun  7 01:46:59  op 2 for ifd ge-0/0/10
Jun  7 01:46:59  op 2 for ifd ge-0/0/11
Jun  7 01:47:00  op 2 for ifd ge-5/0/11
Jun  7 01:47:03  op 2 for ifd ge-2/0/4
Jun  7 01:47:04  op 2 for ifd ge-3/0/4
Jun  7 01:47:05  op 2 for ifd ge-3/0/3
Jun  7 01:47:06  op 2 for ifd ge-3/0/3
Jun  7 01:47:08  op 2 for ifd ge-2/0/3
Jun  7 01:47:23  op 2 for ifd ge-5/0/17
Jun  7 01:47:24  op 2 for ifd ge-0/0/17
Jun  7 01:47:24  op 2 for ifd ge-5/0/16
Jun  7 01:47:25  op 2 for ifd ge-0/0/16
Jun  7 01:47:31  op 2 for ifd ge-5/0/15
Jun  7 01:47:32  op 2 for ifd ge-0/0/15
Jun  7 01:47:32  op 2 for ifd ge-0/0/14
Jun  7 01:47:33  op 2 for ifd ge-5/0/14

    So any revelant info I think...

     

    root@sw-cloud-ex3300-stack> show chassis routing-engine    
Routing Engine status:
  Slot 0:
    Current state                  Backup
    Temperature                 41 degrees C / 105 degrees F
    CPU temperature             41 degrees C / 105 degrees F
    DRAM                      1024
    Memory utilization          37 percent
    CPU utilization:
      User                       8 percent
      Background                 0 percent
      Kernel                     7 percent
      Interrupt                  0 percent
      Idle                      85 percent
    Model                          EX3300 48-Port
    Serial ID                      XXXXXXXXXXXXXX
    Start time                     2016-06-02 13:49:15 CEST
    Uptime                         5 days, 2 hours, 13 minutes, 16 seconds
    Last reboot reason             Router rebooted after a normal shutdown.
    Load averages:                 1 minute   5 minute  15 minute
                                       0.35       0.29       0.25
Routing Engine status:
  Slot 1:
    Current state                  Master
    Temperature                 41 degrees C / 105 degrees F
    CPU temperature             41 degrees C / 105 degrees F
    DRAM                      1024
    Memory utilization          42 percent
    CPU utilization:
      User                      54 percent
      Background                 0 percent
      Kernel                    45 percent
      Interrupt                  1 percent
      Idle                       0 percent
    Model                          EX3300 48-Port
    Serial ID                      XXXXXXXXXXXXXX
    Start time                     2016-06-02 12:46:09 CEST
    Uptime                         5 days, 3 hours, 17 minutes, 10 seconds
    Last reboot reason             Router rebooted after a normal shutdown.
    Load averages:                 1 minute   5 minute  15 minute
                                       2.33       1.89       1.80

{master:1}
root@sw-cloud-ex3300-stack> 

    root@sw-cloud-ex3300-stack> show virtual-chassis           

Preprovisioned Virtual Chassis
Virtual Chassis ID: 002b.54b3.16f3
Virtual Chassis Mode: Enabled
                                           Mstr           Mixed Neighbor List
Member ID  Status   Serial No    Model     prio  Role      Mode ID  Interface
0 (FPC 0)  Prsnt    XXXXXXXXXXX ex3300-48t 129  Backup      NA  1  vcp-255/1/2
                                                                 5  vcp-255/1/3
1 (FPC 1)  Prsnt    XXXXXXXXXXX ex3300-48t 129  Master*     NA  0  vcp-255/1/2
                                                                 2  vcp-255/1/3
2 (FPC 2)  Prsnt    XXXXXXXXXXX ex3300-48t   0  Linecard    NA  1  vcp-255/1/2
                                                                 3  vcp-255/1/3
3 (FPC 3)  Prsnt    XXXXXXXXXXX ex3300-48t   0  Linecard    NA  4  vcp-255/1/2
                                                                 2  vcp-255/1/3
4 (FPC 4)  Prsnt    XXXXXXXXXXX ex3300-48t   0  Linecard    NA  3  vcp-255/1/2
                                                                 5  vcp-255/1/3
5 (FPC 5)  Prsnt    XXXXXXXXXXX ex3300-48t   0  Linecard    NA  4  vcp-255/1/2
                                                                 0  vcp-255/1/3

{master:1}
root@sw-cloud-ex3300-stack> 
    root@sw-cloud-ex3300-stack> show virtual-chassis status 

Preprovisioned Virtual Chassis
Virtual Chassis ID: 002b.54b3.16f3
Virtual Chassis Mode: Enabled
                                           Mstr           Mixed Neighbor List
Member ID  Status   Serial No    Model     prio  Role      Mode ID  Interface
0 (FPC 0)  Prsnt    XXXXXXXXXXX ex3300-48t 129  Backup      NA  1  vcp-255/1/2
                                                                 5  vcp-255/1/3
1 (FPC 1)  Prsnt    XXXXXXXXXXX ex3300-48t 129  Master*     NA  0  vcp-255/1/2
                                                                 2  vcp-255/1/3
2 (FPC 2)  Prsnt    XXXXXXXXXXX ex3300-48t   0  Linecard    NA  1  vcp-255/1/2
                                                                 3  vcp-255/1/3
3 (FPC 3)  Prsnt    XXXXXXXXXXX ex3300-48t   0  Linecard    NA  4  vcp-255/1/2
                                                                 2  vcp-255/1/3
4 (FPC 4)  Prsnt    XXXXXXXXXXX ex3300-48t   0  Linecard    NA  3  vcp-255/1/2
                                                                 5  vcp-255/1/3
5 (FPC 5)  Prsnt    XXXXXXXXXXX ex3300-48t   0  Linecard    NA  4  vcp-255/1/2
                                                                 0  vcp-255/1/3

{master:1}
root@sw-cloud-ex3300-stack>

    I've never had any issue with release 12.3R9 during 1 year.

    Recommended release, 12.3R12.4 can be the cause ...



  • 8.  RE: Virtual Chassis LACP flap (GRES / NSB ?)

    Posted 07-12-2023 10:19

    is it solved ,i yes how?can you please share



    ------------------------------
    Amith MT
    ------------------------------

    Original Message


  • 9.  RE: Virtual Chassis LACP flap (GRES / NSB ?)

    Posted 06-07-2016 23:27

    Looking at your logs, I would say that the RE CPU has been consumed by some task, leading to the scheduler slips, and then failure of L2 control protocols - I notice that apart from LACP flapping, your spanning-tree topology also changed at the same time, which may be indicative of BPDUs not being sent or processed in a timely manner:

    Jun 7 01:42:53 sw-cloud-ex3300-stack eswd[10087]: Root bridge in context 0 changed from 4:cc:4e:24:3a:e9:b8 to 8192:84:b5:9c:46:79:01

    Check for any core dumps, but unfortunately without more logs you probably aren't going to get very far with root cause on this one



  • 10.  RE: Virtual Chassis LACP flap (GRES / NSB ?)

    Posted 06-08-2016 00:43

    Hello,

    Thanks for help.

    Regarding root bridge re-election, the "normal" root bridge (with a 4k configured weight) is connected to my VC but via a AE link, so when lacp goes down, root bridge changed.

    Unfortunately, no core dumps are available. 

     

    Moreover, is RE load normal ? 

    Yesterday

        Load averages:                 1 minute   5 minute  15 minute
                                       2.33       1.89       1.80

    Now

       Load averages:                 1 minute   5 minute  15 minute
                                       1.80       1.88       1.79

     

    Thanks,



  • 11.  RE: Virtual Chassis LACP flap (GRES / NSB ?)

     
    Posted 06-08-2016 00:59

    Hi, 

     

    I was suspecting RE failover having looked at the logs but judging from the Master and backup RE uptime, it doesn't seem so, assuming the node that came up first was master [i.e Member 1].   You might also try logging on the backup RE and check for any logs as well as core dumps if any.

     

    The load averages appear to be normal.

    I would suggest to open a JTAC case for RCA, if you have not done so already.

     

    Cheers,

    Ashvin



  • 12.  RE: Virtual Chassis LACP flap (GRES / NSB ?)

    Posted 06-08-2016 01:33

    Hi, 

    Thanks for answer,

     

    I couldn't find any core dump on backup RE.

     

    Master and Backup are the same (Master for member 1 , and Backup for memeber 0) since my upgrade to version 12.3R12.4.

    If failover has been done I have no log regarding this issue.

     

    I use observium for snmp monitoring.

    I've noticed observium couldn't poll in time the stack in release 12.3R9 (999s , and timeout after that).

     

    Now, in release 12.3R12.4 the polling finish before timeout (700-900s for finish polling).

    If I see RE load, snmpd / mib2d cossume a lot of cpu, ... Can the problem be linked to snmp "high"-use ?

     

    Thanks,



  • 13.  RE: Virtual Chassis LACP flap (GRES / NSB ?)

     
    Posted 06-08-2016 03:14

    Hi,

     

    Is the issue recurring or was it a one off?

    I believe JTAC would be more apt to provide the answers for the RCA.

     



  • 14.  RE: Virtual Chassis LACP flap (GRES / NSB ?)

    Posted 06-08-2016 05:08

    With 12.3R9, during 1 year and more, I've never had this issue.

    With 12.3R12.4, I had issue 1 time in 6 days.

     

    I'm will contact JTACCwhen my support contract will be activated 



  • 15.  RE: Virtual Chassis LACP flap (GRES / NSB ?)

     
    Posted 06-08-2016 05:21

    IMO, it could be or could as well not be JUNOS version related. JTAC would be best placed to answer.

    Would advise to save the support bundles for the later JTAC case.

     

    However, the logs do hint towards l2 protocol issues probably due to CPU.

    Keep us posted on the JTAC findings.