Innovators Circle

 View Only
last person joined: 4 days ago 

A research-driven circle where members share feedback to help impact Juniper's direction. Members gain opportunities for rewards through e-gift cards and exclusive content. To become a member, simply click “Join Community” and follow the quick prompts.

  • 1.  Is there a repetitive solution to 25G Interface Up/Down?

    Posted 02-22-2022 05:50
    We are using a large amount of 25G interface.
    Most of them are used for server interworking.
    However, we are worried about the up/down of the periodic interface of these 25G interfaces.
    By any chance, 25G Interface Up/Down occurs frequently elsewhere.
    And how are you solving it?

    Additionally, most of the OS uses 18.4R3.3 and 19.3R2-S3.4 for QFX5120.
    We use FEC (Automode) and most of them are attached as FEC74.

    Please give me a solution...


  • 2.  RE: Is there a repetitive solution to 25G Interface Up/Down?

    Posted 02-23-2022 11:43
    i have several servers in a couple DC's connected to QFX5120's at 25 gbps... they have been stable for a few years.

    {master:0}
agould@sabn-5120-bor-c5> show interfaces et-0/0/7
Physical interface: et-0/0/7, Enabled, Physical link is Up
  Interface index: 650, SNMP ifIndex: 526
  Description: dc-server-07.phy.san-c5
  Link-level type: Ethernet, MTU: 9216, LAN-PHY mode, Speed: 25000mbps, BPDU Error: None, Loop Detect PDU Error: None, Ethernet-Switching Error: None, MAC-REWRITE Error: None,
  Loopback: Disabled, Source filtering: Disabled, Flow control: Disabled, Media type: Copper
  Device flags   : Present Running
  Interface flags: SNMP-Traps Internal: 0x4000
  Link flags     : None
  CoS queues     : 10 supported, 10 maximum usable queues
  Current address: b8:c2:53:b3:70:41, Hardware address: b8:c2:53:b3:6f:8b
  Last flapped   : 2020-04-15 13:35:09 CDT (96w6d 21:30 ago)
  Input rate     : 0 bps (0 pps)
  Output rate    : 1952 bps (2 pps)
  Active alarms  : None
  Active defects : None
  PCS statistics                      Seconds
    Bit errors                             0
    Errored blocks                         0
  Ethernet FEC Mode  :                  FEC74
  Ethernet FEC statistics              Errors
    FEC Corrected Errors           1271824644
    FEC Uncorrected Errors             104475
    FEC Corrected Errors Rate               0
    FEC Uncorrected Errors Rate             0
  PRBS Statistics : Disabled
  Interface transmit statistics: Disabled

  Logical interface et-0/0/7.0 (Index 588) (SNMP ifIndex 542)
    Flags: Up SNMP-Traps 0x24024000 Encapsulation: Ethernet-Bridge
    Input packets : 6006473
    Output packets: 3246677
    Protocol aenet, AE bundle: ae7.0
​

    {master:0}
agould@5120-bor-c5> show system information
Model: qfx5120-48y-8c
Family: junos-qfx
Junos: 18.3R1.11
Hostname: 5120-bor-c5​


    ------------------------------
    Aaron Gould
    Senior Network Engineer
    aaron@gvtc.com
    https://www.linkedin.com/in/agould123/
    ------------------------------

    Original Message


  • 3.  RE: Is there a repetitive solution to 25G Interface Up/Down?

    Posted 02-26-2022 11:17
    aaron.gould님, 감사합니다 .


    I'm sorry. It's an automatic bundle from Chrome and it's entered.
    I'm writing it again and sending it to you.

    Our settings seem to be very similar.
    But it's really hard because there's a lot of Link Up/Down.


    Original Message:
    Sent: 02-23-2022 11:16
    From: AARON GOULD
    Subject: Is there a repetitive solution to 25G Interface Up/Down?

    i have several servers in a couple DC's connected to QFX5120's at 25 gbps... they have been stable for a few years.

    {master:0}agould@sabn-5120-bor-c5> show interfaces et-0/0/7Physical interface: et-0/0/7, Enabled, Physical link is Up  Interface index: 650, SNMP ifIndex: 526  Description: dc-server-07.phy.san-c5  Link-level type: Ethernet, MTU: 9216, LAN-PHY mode, Speed: 25000mbps, BPDU Error: None, Loop Detect PDU Error: None, Ethernet-Switching Error: None, MAC-REWRITE Error: None,  Loopback: Disabled, Source filtering: Disabled, Flow control: Disabled, Media type: Copper  Device flags   : Present Running  Interface flags: SNMP-Traps Internal: 0x4000  Link flags     : None  CoS queues     : 10 supported, 10 maximum usable queues  Current address: b8:c2:53:b3:70:41, Hardware address: b8:c2:53:b3:6f:8b  Last flapped   : 2020-04-15 13:35:09 CDT (96w6d 21:30 ago)  Input rate     : 0 bps (0 pps)  Output rate    : 1952 bps (2 pps)  Active alarms  : None  Active defects : None  PCS statistics                      Seconds    Bit errors                             0    Errored blocks                         0  Ethernet FEC Mode  :                  FEC74  Ethernet FEC statistics              Errors    FEC Corrected Errors           1271824644    FEC Uncorrected Errors             104475    FEC Corrected Errors Rate               0    FEC Uncorrected Errors Rate             0  PRBS Statistics : Disabled  Interface transmit statistics: Disabled  Logical interface et-0/0/7.0 (Index 588) (SNMP ifIndex 542)    Flags: Up SNMP-Traps 0x24024000 Encapsulation: Ethernet-Bridge    Input packets : 6006473    Output packets: 3246677    Protocol aenet, AE bundle: ae7.0​

    {master:0}agould@5120-bor-c5> show system informationModel: qfx5120-48y-8cFamily: junos-qfxJunos: 18.3R1.11Hostname: 5120-bor-c5​


    ------------------------------
    Aaron Gould
    Senior Network Engineer
    aaron@gvtc.com
    https://www.linkedin.com/in/agould123/

    Original Message


  • 4.  RE: Is there a repetitive solution to 25G Interface Up/Down?

    Posted 02-23-2022 19:13

    Hi ycdoo,

    A brief PR search has not come up with anything directly related to this issue. 

    How often do you get the interface flaps?
    Is it an individual interface or the whole PFE?
    What type of devices/servers are connected to these interfaces that flap?
    Is there a common trait to the interfaces that flap? i.e. configuration, connected device/hardware, SFP Transceiver type/brand. etc
    Is there a common trait to the switches that experience flaps?
    Are you using LACP LAG configuration?
    Do the message logs suggest anything? 


    Original Message