Switching

Expand all | Collapse all

Juniper QFX5110 and Catalyst 3560 problem

  • 1.  Juniper QFX5110 and Catalyst 3560 problem

    Posted 02-05-2018 05:54

    Hi guys,

     

    So I faced a really weird problem. I have a QFX5110 switches bundled into Virtual Chassis. And I have a standalone Cisco Catalyst 3560 switch.

     

    I'm trying to setup a simple trunk between them and I just can't The biggest problem is that the interfaces doesn't even come up on both ends!

     

    I tried to do command 

    show interfaces diagnostics optics ge-0/0/26

    But it doesn't even get me any output ! 

     

    What is going on ?

     

    Any ideas what might be wrong, why even Layer 1 doesn't work ? 

     

    What is funny when I will take the cable off the Juniper and put into Cisco switch, everything between Cisco's just work.

     

    Here is the details on Cisco switch.

    Cisco IOS Software, C3560 Software (C3560-IPBASEK9-M), Version 12.2(44)SE5, RELEASE SOFTWARE (fc2)
    Copyright (c) 1986-2009 by Cisco Systems, Inc.


  • 2.  RE: Juniper QFX5110 and Catalyst 3560 problem

    Posted 02-05-2018 06:38

    BTW in log messages I can see

     

    Feb  5 11:21:03  cvc kernel: if_msg_ifd_add: l2_count in add (0), for ifd:ge-0/0/26
    Feb  5 11:21:03  cvc kernel: if_msg_ifd_add: l2_count in add (0), for ifd:ge-0/0/26
    Feb  5 11:21:03  cvc kernel: if_pfe: Error 5 (Invalid) on IF command 3 (IFD add)
    Feb  5 11:21:03  cvc kernel: if_pfe: Error 8 (No IFD) on IF command 226 (IFD HW aconfig)
    Feb  5 11:21:03  cvc kernel: if_pfe: Error 8 (No IFD) on IF command 15 (IFD aconfig)
    Feb  5 11:21:03  cvc kernel: if_pfe: Error 8 (No IFD) on IF command 13 (IFD mconfig)
    Feb  5 11:21:03  cvc kernel: if_pfe: Error 8 (No IFD) on IF command 55 (Ether set boolean)
    Feb  5 11:21:03  cvc last message repeated 2 times
    Feb  5 11:21:03  cvc kernel: if_pfe: Error 8 (No IFD) on IF command 54 (Ether set uint8)
    Feb  5 11:21:03  cvc kernel: if_pfe: Error 8 (No IFD) on IF command 55 (Ether set boolean)
    Feb  5 11:21:03  cvc last message repeated 7 times
    Feb  5 11:21:03  cvc kernel: if_pfe: Error 8 (No IFD) on IF command 54 (Ether set uint8)
    Feb  5 11:21:03  cvc kernel: if_pfe: Error 8 (No IFD) on IF command 55 (Ether set boolean)
    Feb  5 11:21:03  cvc last message repeated 2 times
    Feb  5 11:21:03  cvc kernel: if_pfe: Error 8 (No IFD) on IF command 54 (Ether set uint8)
    Feb  5 11:21:03  cvc last message repeated 2 times
    Feb  5 11:21:03  cvc kernel: if_pfe: Error 8 (No IFD) on IF command 151 (Ether set uint32)
    Feb  5 11:21:03  cvc kernel: if_pfe: Error 8 (No IFD) on IF command 54 (Ether set uint8)
    Feb  5 11:21:03  cvc last message repeated 4 times
    Feb  5 11:21:03  cvc kernel: if_pfe: Error 8 (No IFD) on IF command 151 (Ether set uint32)
    Feb  5 11:21:03  cvc kernel: if_pfe: Error 8 (No IFD) on IF command 54 (Ether set uint8)
    Feb  5 11:21:03  cvc kernel: if_pfe: Error 8 (No IFD) on IF command 263 (Unknown)
    Feb  5 11:21:03  cvc kernel: if_pfe: Error 8 (No IFD) on IF command 163 (Unknown)
    Feb  5 11:21:03  cvc kernel: if_pfe: Error 8 (No IFD) on IF command 117 (IFD queue stats)
    Feb  5 11:21:03  cvc kernel: if_pfe: Error 8 (No IFD) on IF command 56 (Ether get info)
    Feb  5 11:21:03  cvc kernel: if_pfe: Error 8 (No IFD) on IF command 5 (IFD stats)
    Feb  5 11:21:03  cvc fpc0 : dcbcm_init_port_common: Speed set failed for port 27 ret=-4
    Feb  5 11:21:03  cvc fpc0 : port command handler failed processing cmd 1 for port 27
    Feb  5 11:21:03  cvc fpc0 eth_ifd_bind: failed for (ge-0/0/26)....
    Feb  5 11:21:03  cvc fpc0 DCBCM(0/0): eth_ifd_bind failed for ge-0/0/26
    Feb  5 11:21:03  cvc fpc0 DCBCM(0/0): eth attach for ge-0/0/26 failed
    Feb  5 11:21:03  cvc fpc0 IFFPC: ifd attach returned error 22
    Feb  5 11:21:03  cvc fpc0 IFFPC: 'IFD add' (opcode 3) failed
    Feb  5 11:21:03  cvc fpc0   ifd 764; fpc ifd attach error (22)
    Feb  5 11:21:03  cvc fpc0 IFRT: 'IFD hardware address configuration' (opcode 226) failed
    Feb  5 11:21:03  cvc fpc0   ifd 764; does not exist
    Feb  5 11:21:03  cvc fpc0 IFRT: 'IFD address configuration' (opcode 15) failed
    Feb  5 11:21:03  cvc fpc0   ifd 764; does not exist
    Feb  5 11:21:03  cvc fpc0 IFRT: 'IFD media configuration' (opcode 13) failed
    Feb  5 11:21:03  cvc fpc0   ifd 764; does not exist


  • 3.  RE: Juniper QFX5110 and Catalyst 3560 problem

     
    Posted 02-06-2018 02:52

    Since this is empty

    I tried to do command 

    show interfaces diagnostics optics ge-0/0/26

    But it doesn't even get me any output ! 

     

    I suspect an issue with the optic.  Can you see if the optic shows up as inserted here:

    show chassis pic fpc-slot 0 pic-slot 0

     

    this should list all the inserted optics.  If it does not show up try remove and reinsert.

    Then try a different port, if it works there the port hardware is bad if it does not work anywhere the optic is either bad or not compatible.

     



  • 4.  RE: Juniper QFX5110 and Catalyst 3560 problem

    Posted 02-07-2018 07:43

    Optics is visible.

    FPC slot 0, PIC slot 0 information:
    Type 48x10G-4x100G
    State Online
    PIC version 3.24
    Uptime 84 days, 6 hours, 42 minutes, 32 seconds
    
    PIC port information:
    Fiber Xcvr vendor Wave- Xcvr
    Port Cable type type Xcvr vendor part number length Firmware
    ...
    26 GIGE 1000SX MM SmartOptics SFP-1GE-SX 850 nm 0.0

    I will try the milindmistry advices and let You know what is the status.

     



  • 5.  RE: Juniper QFX5110 and Catalyst 3560 problem

    Posted 02-07-2018 11:40

    Also this is output of show interfaces ge-0/0/26

     

    Physical interface: ge-0/0/26, Enabled, Physical link is Down
      Interface index: 764, SNMP ifIndex: 799
      Link-level type: Ethernet, MTU: 1514, LAN-PHY mode, Speed: 1000mbps, BPDU Error: None, Loop Detect PDU Error: None, Ethernet-Switching Error: None, Source filtering: Disabled
      Ethernet-Switching Error: None, MAC-REWRITE Error: None, Loopback: Disabled, Flow control: Disabled, Auto-negotiation: Disabled, Remote fault: Online, Media type: Fiber,
      IEEE 802.3az Energy Efficient Ethernet: Disabled, Auto-MDIX: Enabled
      Device flags   : Present Running
      Interface flags: Hardware-Down SNMP-Traps Internal: 0x4000
      Link flags     : None
      CoS queues     : 12 supported, 12 maximum usable queues
      Current address: d0:07:ca:44:b8:dd, Hardware address: d0:07:ca:44:b8:dd
      Last flapped   : Never
        Input packets : 0
        Output packets: 0
      Active alarms  : None
      Active defects : None
      PCS statistics                      Seconds
        Bit errors                             0
        Errored blocks                         0
      Ethernet FEC statistics              Errors
        FEC Corrected Errors                    0
        FEC Uncorrected Errors                  0
        FEC Corrected Errors Rate               0
        FEC Uncorrected Errors Rate             0
      PRBS Statistics : Disabled
      Interface transmit statistics: Disabled
    
      Logical interface ge-0/0/26.0 (Index 586) (SNMP ifIndex 800)
        Flags: Device-Down SNMP-Traps 0x24024000 Encapsulation: Ethernet-Bridge
        Input packets : 0
        Output packets: 0
        Protocol eth-switch, MTU: 1514
          Flags: Trunk-Mode
    


  • 6.  RE: Juniper QFX5110 and Catalyst 3560 problem

    Posted 02-07-2018 21:02

    Did you physically loop the cables as i mentioned?

     

    It will tell you if there is anything wrong with cables, optics (sfps) or port..



  • 7.  RE: Juniper QFX5110 and Catalyst 3560 problem

    Posted 02-15-2018 10:35

    OK so I started fresh on new Cisco port Gi0/51 

     

    Here is the results

     

    On Cisco side the port is configured in such a way

    interface GigabitEthernet0/51
     switchport trunk encapsulation dot1q
     switchport mode trunk
     switchport nonegotiate

    On Juniper side the port is configured in that way

    ge-0/0/26 {
    	speed 1g;
    	ether-options {
    		no-auto-negotiation;
    		}
    	unit 0 {
    		family ethernet-switching {
    			interface-mode trunk;
    			vlan {
    				members [ 1 999 ];
    				}
    			}
    		}

    Effect is that:

     

    - when I connect Cisco switch to other Cisco switch (with trunk configured) the port goes up and LED is going amber and later green (which is expected behavior)

     

    Now using the same cable.

    - when I connect Cisco switch to Juniper on Cisco side the port is just dead (LED completely off), what is interesting on Juniper side the LEDs are on, the left one is stable green which mieans according to documentation that Link is established but there is no link activity, and right one is blinking green which means that 1 Gig transceiver is inserted and the the is established.

     

    So why the hell on Cisco side it is completely dead ??

     

    This is really ridiculuos case. 



  • 8.  RE: Juniper QFX5110 and Catalyst 3560 problem

    Posted 03-14-2018 12:52

    Did you get this fixed?

     

    Is it something like auto-neg failing?

     

    the switchport nonegotiate on the cisco side is related to determine the trunking mode rather than auto-neg, yet on the juniper side you have auto-neg disabled.

     

    I have had issues in the past between cisco and juniper with this issue.



  • 9.  RE: Juniper QFX5110 and Catalyst 3560 problem

    Posted 11-26-2018 20:34

    I'll post a response just to make it correct on this thread.

     

    The 

    switchport nonegotiate

    does not equal 

    ether-options {
    		no-auto-negotiation;
    		}

    The equivalent cisco on this platform might be,  speed nonegotiate, or specifying a speed with can disable autoneg.
    You shouldn't be turning this off unless you have a specific requirement.
    switchport nonnegoitate has to do with the ability to automatically detect and switch between an access or trunk port. (or to remove the ability in this case)

    Remove the below and all should be fine.

    speed 1g;
    	ether-options {
    		no-auto-negotiation;
    		}

    The poor Cisco is still trying to complete autonegotiation and correctly holding the port down.



  • 10.  RE: Juniper QFX5110 and Catalyst 3560 problem

    Posted 02-06-2018 13:40
    Coupl of tests u may perform as follows...
    1. physicially loop the ethernet cable between two ports of qfx 5110..
    2. if the ports came up, then do similar exercise with cisco (i believe u seem to have done cisco part).
    3. if port does not come up, check show chassis hardward and look out if the optics are unsupported on qfx.

    4. if the ports came up ij 2nd step, proceed with connecting a cables between cisco and juniper. check the physical interface status. if using same cables, ports do not come up.
    5. Then try fixing the speed, duplex and no autonegotiation on both sides.