Innovators Circle

 View Only

IMPORTANT MODERATION NOTICE

This community is currently under full moderation, meaning  all posts will be reviewed before appearing in the community. Please expect a brief delay—there is no need to post multiple times. If your post is rejected, you'll receive an email outlining the reason(s). We've implemented full moderation to control spam. Thank you for your patience and participation.

  • 1.  Is there a repetitive solution to 25G Interface Up/Down?

    Posted 02-22-2022 05:50
    We are using a large amount of 25G interface.
    Most of them are used for server interworking.
    However, we are worried about the up/down of the periodic interface of these 25G interfaces.
    By any chance, 25G Interface Up/Down occurs frequently elsewhere.
    And how are you solving it?

    Additionally, most of the OS uses 18.4R3.3 and 19.3R2-S3.4 for QFX5120.
    We use FEC (Automode) and most of them are attached as FEC74.

    Please give me a solution...


  • 2.  RE: Is there a repetitive solution to 25G Interface Up/Down?

    Posted 02-23-2022 11:43
    i have several servers in a couple DC's connected to QFX5120's at 25 gbps... they have been stable for a few years.

    {master:0}
    agould@sabn-5120-bor-c5> show interfaces et-0/0/7
    Physical interface: et-0/0/7, Enabled, Physical link is Up
      Interface index: 650, SNMP ifIndex: 526
      Description: dc-server-07.phy.san-c5
      Link-level type: Ethernet, MTU: 9216, LAN-PHY mode, Speed: 25000mbps, BPDU Error: None, Loop Detect PDU Error: None, Ethernet-Switching Error: None, MAC-REWRITE Error: None,
      Loopback: Disabled, Source filtering: Disabled, Flow control: Disabled, Media type: Copper
      Device flags   : Present Running
      Interface flags: SNMP-Traps Internal: 0x4000
      Link flags     : None
      CoS queues     : 10 supported, 10 maximum usable queues
      Current address: b8:c2:53:b3:70:41, Hardware address: b8:c2:53:b3:6f:8b
      Last flapped   : 2020-04-15 13:35:09 CDT (96w6d 21:30 ago)
      Input rate     : 0 bps (0 pps)
      Output rate    : 1952 bps (2 pps)
      Active alarms  : None
      Active defects : None
      PCS statistics                      Seconds
        Bit errors                             0
        Errored blocks                         0
      Ethernet FEC Mode  :                  FEC74
      Ethernet FEC statistics              Errors
        FEC Corrected Errors           1271824644
        FEC Uncorrected Errors             104475
        FEC Corrected Errors Rate               0
        FEC Uncorrected Errors Rate             0
      PRBS Statistics : Disabled
      Interface transmit statistics: Disabled
    
      Logical interface et-0/0/7.0 (Index 588) (SNMP ifIndex 542)
        Flags: Up SNMP-Traps 0x24024000 Encapsulation: Ethernet-Bridge
        Input packets : 6006473
        Output packets: 3246677
        Protocol aenet, AE bundle: ae7.0
    ​

    {master:0}
    agould@5120-bor-c5> show system information
    Model: qfx5120-48y-8c
    Family: junos-qfx
    Junos: 18.3R1.11
    Hostname: 5120-bor-c5​


    ------------------------------
    Aaron Gould
    Senior Network Engineer
    aaron@gvtc.com
    https://www.linkedin.com/in/agould123/
    ------------------------------



  • 3.  RE: Is there a repetitive solution to 25G Interface Up/Down?

    Posted 02-26-2022 11:17
    aaron.gould님, 감사합니다 .


    I'm sorry. It's an automatic bundle from Chrome and it's entered.
    I'm writing it again and sending it to you.

    Our settings seem to be very similar.
    But it's really hard because there's a lot of Link Up/Down.


    Original Message:
    Sent: 02-23-2022 11:16
    From: AARON GOULD
    Subject: Is there a repetitive solution to 25G Interface Up/Down?

    i have several servers in a couple DC's connected to QFX5120's at 25 gbps... they have been stable for a few years.

    {master:0}agould@sabn-5120-bor-c5> show interfaces et-0/0/7Physical interface: et-0/0/7, Enabled, Physical link is Up  Interface index: 650, SNMP ifIndex: 526  Description: dc-server-07.phy.san-c5  Link-level type: Ethernet, MTU: 9216, LAN-PHY mode, Speed: 25000mbps, BPDU Error: None, Loop Detect PDU Error: None, Ethernet-Switching Error: None, MAC-REWRITE Error: None,  Loopback: Disabled, Source filtering: Disabled, Flow control: Disabled, Media type: Copper  Device flags   : Present Running  Interface flags: SNMP-Traps Internal: 0x4000  Link flags     : None  CoS queues     : 10 supported, 10 maximum usable queues  Current address: b8:c2:53:b3:70:41, Hardware address: b8:c2:53:b3:6f:8b  Last flapped   : 2020-04-15 13:35:09 CDT (96w6d 21:30 ago)  Input rate     : 0 bps (0 pps)  Output rate    : 1952 bps (2 pps)  Active alarms  : None  Active defects : None  PCS statistics                      Seconds    Bit errors                             0    Errored blocks                         0  Ethernet FEC Mode  :                  FEC74  Ethernet FEC statistics              Errors    FEC Corrected Errors           1271824644    FEC Uncorrected Errors             104475    FEC Corrected Errors Rate               0    FEC Uncorrected Errors Rate             0  PRBS Statistics : Disabled  Interface transmit statistics: Disabled  Logical interface et-0/0/7.0 (Index 588) (SNMP ifIndex 542)    Flags: Up SNMP-Traps 0x24024000 Encapsulation: Ethernet-Bridge    Input packets : 6006473    Output packets: 3246677    Protocol aenet, AE bundle: ae7.0​

    {master:0}agould@5120-bor-c5> show system informationModel: qfx5120-48y-8cFamily: junos-qfxJunos: 18.3R1.11Hostname: 5120-bor-c5​


    ------------------------------
    Aaron Gould
    Senior Network Engineer
    aaron@gvtc.com
    https://www.linkedin.com/in/agould123/



  • 4.  RE: Is there a repetitive solution to 25G Interface Up/Down?

    Posted 02-23-2022 19:13

    Hi ycdoo,

    A brief PR search has not come up with anything directly related to this issue. 

    How often do you get the interface flaps?
    Is it an individual interface or the whole PFE?
    What type of devices/servers are connected to these interfaces that flap?
    Is there a common trait to the interfaces that flap? i.e. configuration, connected device/hardware, SFP Transceiver type/brand. etc
    Is there a common trait to the switches that experience flaps?
    Are you using LACP LAG configuration?
    Do the message logs suggest anything?