Labs

 View Only
last person joined: 5 days ago 

Discover how to get the most of Juniper labs and share what you've built.
  • 1.  vJunosEvolved EVPN-MPLS Anycast IRB gateway not working

    Posted 07-11-2023 16:12
      |   view attached

    I have been testing the new vJunosEvolved in a lab, taking a first-time-pass at configuring EVPN with the mac-vrf.  I have EVPN-MPLS (BGP-RR, ISIS-SR, MPLS) setup between two vJunosEvolved (vJE) nodes and two mac-vrf instances of type vlan-based, one for VLAN 10 and another for VLAN 20.  I setup the IRBs with the same MAC and IP Address for each VLAN (IRB10 and IRB20)  I have an L3VPN instance where I have placed the IRBs.  I am not using all-active ESIs, just an interface on each PE node associated to an anycast IRB in the EVPN bridge-domain, attached to a switch and two hosts on each switch in VLAN 10 and 20.

    I've been using the following links for reference:

    EVPN User Guide

    EVPN E-LAN on PTX10k Platforms

    I am unable to ping between hosts on VLAN 10 and VLAN 20.  However, hosts on VLAN 10 or VLAN 20, can ping hosts on the same VLAN, even between vJE nodes.  Just unable to ping the IRB gateway which is likely the primary issue.   I think I've configured EVPN correctly for both the mac-vrf and vrf instances, but the layer3 IRB piece seems disconnected.  No ARP entries in the L3VPN and EVPN MAC-IP Table, except for the IRB interfaces.


    What is interesting is that I can see ARP requests from clients for the IRB gateway arrive, but don't seem to be answered.  If I ping from the IRB to a client, the client sees the initial ARP request and responds, but the response doesn't seem to make it to the IRB as it never proceeds to then ping.  

    If I move the vlans (bridge-domain) configuration to the top level configuration, out of the mac-vrf, and then disable the mac-vrf's, the IRBs work and the L3 VRF config allows pinging between VLAN 10 and VLAN 20 hosts on the same or different nodes.

    Not sure what I missed, though the configuration is new to me.  Also, possible there is a limitation of this virtual device or the OS?  I understand it has a single virtual-switch instance shared across the node, so no VLAN overlap.

    Thank you in advance for any insight, been going a little crazy on this one.  Configuration follows.

    - DBH

    ==========================================================================================
    R1
    ==========================================================================================
    set interfaces et-0/0/0 description "TO SW2"
    set interfaces et-0/0/0 flexible-vlan-tagging
    set interfaces et-0/0/0 encapsulation flexible-ethernet-services
    set interfaces et-0/0/0 unit 10 encapsulation vlan-bridge
    set interfaces et-0/0/0 unit 10 vlan-id 10

    set interfaces irb unit 10 family inet address 10.0.0.1/24 primary
    set interfaces irb unit 10 family inet address 10.0.0.1/24 preferred
    set interfaces irb unit 10 mac 00:10:10:10:10:10

    set interfaces irb unit 20 family inet address 20.0.0.1/24 primary
    set interfaces irb unit 20 family inet address 20.0.0.1/24 preferred
    set interfaces irb unit 20 mac 00:20:20:20:20:20

    set routing-options forwarding-table chained-composite-next-hop ingress evpn

    set routing-instances EVPN-IRB instance-type vrf
    set routing-instances EVPN-IRB protocols evpn default-gateway do-not-advertise
    set routing-instances EVPN-IRB protocols evpn ip-prefix-routes advertise direct-nexthop
    set routing-instances EVPN-IRB protocols evpn ip-prefix-routes encapsulation mpls
    set routing-instances EVPN-IRB protocols evpn ip-prefix-routes import PERMIT-ANY
    set routing-instances EVPN-IRB protocols evpn ip-prefix-routes export PERMIT-ANY
    set routing-instances EVPN-IRB interface irb.10
    set routing-instances EVPN-IRB interface irb.20
    set routing-instances EVPN-IRB route-distinguisher 192.168.0.34:65002
    set routing-instances EVPN-IRB vrf-target target:65002:10
    set routing-instances EVPN-IRB vrf-table-label

    set routing-instances MAC-VRF-10 instance-type mac-vrf
    set routing-instances MAC-VRF-10 protocols evpn encapsulation mpls
    set routing-instances MAC-VRF-10 protocols evpn label-allocation per-instance
    set routing-instances MAC-VRF-10 service-type vlan-aware
    set routing-instances MAC-VRF-10 interface et-0/0/0.10
    set routing-instances MAC-VRF-10 route-distinguisher 192.168.0.34:10
    set routing-instances MAC-VRF-10 vrf-target target:10:1
    set routing-instances MAC-VRF-10 vlans BD10 description VLAN-10-TESTING
    set routing-instances MAC-VRF-10 vlans BD10 vlan-id 10
    set routing-instances MAC-VRF-10 vlans BD10 interface et-0/0/0.10
    set routing-instances MAC-VRF-10 vlans BD10 l3-interface irb.10

    set routing-instances MAC-VRF-20 instance-type mac-vrf
    set routing-instances MAC-VRF-20 protocols evpn encapsulation mpls
    set routing-instances MAC-VRF-20 protocols evpn label-allocation per-instance
    set routing-instances MAC-VRF-20 service-type vlan-aware
    set routing-instances MAC-VRF-20 interface et-0/0/0.20
    set routing-instances MAC-VRF-20 route-distinguisher 192.168.0.34:20
    set routing-instances MAC-VRF-20 vrf-target target:20:2
    set routing-instances MAC-VRF-20 vlans BD20 description VLAN-20-TESTING
    set routing-instances MAC-VRF-20 vlans BD20 vlan-id 20
    set routing-instances MAC-VRF-20 vlans BD20 interface et-0/0/0.20
    set routing-instances MAC-VRF-20 vlans BD20 l3-interface irb.20

    admin@JUNOS.R1# run show route table EVPN-IRB.inet.0

    EVPN-IRB.inet.0: 4 destinations, 12 routes (4 active, 0 holddown, 0 hidden)
    + = Active Route, - = Last Active, * = Both

    10.0.0.0/24        *[Direct/0] 00:21:25
                        >  via irb.10
                        [BGP/170] 00:32:18, localpref 100, from 192.168.0.32
                          AS path: I, validation-state: unverified
                        >  to 172.17.1.10 via et-0/0/1.100, Push 18
                        [BGP/170] 00:32:18, localpref 100, from 192.168.0.33
                          AS path: I, validation-state: unverified
                        >  to 172.17.1.10 via et-0/0/1.100, Push 18
                        [EVPN/170] 00:32:18
                        >  to 172.17.1.10 via et-0/0/1.100, Push 18
    10.0.0.1/32        *[Local/0] 00:21:25
                           Local via irb.10
                        [EVPN/170] 00:32:18
                        >  to 172.17.1.10 via et-0/0/1.100, Push 18
    20.0.0.0/24        *[Direct/0] 00:21:25
                        >  via irb.20
                        [BGP/170] 00:21:18, localpref 100, from 192.168.0.32
                          AS path: I, validation-state: unverified
                        >  to 172.17.1.10 via et-0/0/1.100, Push 18
                        [BGP/170] 00:21:18, localpref 100, from 192.168.0.33
                          AS path: I, validation-state: unverified
                        >  to 172.17.1.10 via et-0/0/1.100, Push 18
                        [EVPN/170] 00:21:18
                        >  to 172.17.1.10 via et-0/0/1.100, Push 18
    20.0.0.1/32        *[Local/0] 00:21:25
                           Local via irb.20
                        [EVPN/170] 00:21:18
                        >  to 172.17.1.10 via et-0/0/1.100, Push 18

    [edit]
    admin@JUNOS.R1# run show evpn instance extensive
    Instance: MAC-VRF-10
      Route Distinguisher: 192.168.0.34:10
      VLAN ID: 10
      Per-instance MAC route label: 59
      Control word enabled
      Duplicate MAC detection threshold: 5
      Duplicate MAC detection window: 180
      MAC database status                     Local  Remote
        MAC advertisements:                       3       3
        MAC+IP advertisements:                    1       1
        Default gateway MAC advertisements:       1       1
      Number of local interfaces: 2 (2 up)
        Interface name  ESI                            Mode             Status     AC-Role
        .local..51      00:00:00:00:00:00:00:00:00:00  single-homed     Up         Root
        et-0/0/0.10     00:00:00:00:00:00:00:00:00:00  single-homed     Up         Root
      Number of IRB interfaces: 1 (1 up)
        Interface name  VLAN   VNI    Status  L3 context
        irb.10          10             Up     EVPN-IRB
      Number of protect interfaces: 0
      Number of bridge domains: 1
        VLAN  Domain-ID Intfs/up   IRB-intf  Mode            MAC-sync v4-SG-sync v6-SG-sync
        10                 1  1    irb.10    Extended        Enabled  Disabled   Disabled
      Number of neighbors: 1
        Address               MAC    MAC+IP        AD        IM        ES Leaf-label Remote-DCI-Peer Flow-label
        192.168.0.35            3         1         0         1         0                            NO
      Number of ethernet segments: 1
        ESI: 05:00:00:fd:ea:00:00:00:0a:00
          Local interface: irb.10, Status: Up/Forwarding
      SMET Forwarding: Disabled
    Instance: MAC-VRF-20
      Route Distinguisher: 192.168.0.34:20
      VLAN ID: 20
      Per-instance MAC route label: 62
      Control word enabled
      Duplicate MAC detection threshold: 5
      Duplicate MAC detection window: 180
      MAC database status                     Local  Remote
        MAC advertisements:                       3       3
        MAC+IP advertisements:                    1       1
        Default gateway MAC advertisements:       1       1
      Number of local interfaces: 2 (2 up)
        Interface name  ESI                            Mode             Status     AC-Role
        .local..54      00:00:00:00:00:00:00:00:00:00  single-homed     Up         Root
        et-0/0/0.20     00:00:00:00:00:00:00:00:00:00  single-homed     Up         Root
      Number of IRB interfaces: 1 (1 up)
        Interface name  VLAN   VNI    Status  L3 context
        irb.20          20             Up     EVPN-IRB
      Number of protect interfaces: 0
      Number of bridge domains: 1
        VLAN  Domain-ID Intfs/up   IRB-intf  Mode            MAC-sync v4-SG-sync v6-SG-sync
        20                 1  1    irb.20    Extended        Enabled  Disabled   Disabled
      Number of neighbors: 1
        Address               MAC    MAC+IP        AD        IM        ES Leaf-label Remote-DCI-Peer Flow-label
        192.168.0.35            3         1         0         1         0                            NO
      Number of ethernet segments: 1
        ESI: 05:00:00:fd:ea:00:00:00:14:00
          Local interface: irb.20, Status: Up/Forwarding
      SMET Forwarding: Disabled
    Instance: __default_evpn__
      Route Distinguisher: 192.168.0.34:0
      Number of bridge domains: 0
      Number of neighbors: 0

    [edit]
    admin@JUNOS.R1# run show evpn database
    Instance: MAC-VRF-10
    VLAN  DomainId  MAC address        Active source                  Timestamp        IP address
    10              00:10:10:10:10:10  irb.10                         Jul 07 13:58:47  10.0.0.1
    10              00:50:79:66:68:01  et-0/0/0.10                    Jul 07 14:00:14
    10              00:50:79:66:68:02  192.168.0.35                   Jul 07 13:58:45
    10              0c:0d:aa:00:00:00  et-0/0/0.10                    Jul 07 13:58:55
    10              0c:82:f3:7f:00:00  192.168.0.35                   Jul 07 13:58:45

    Instance: MAC-VRF-20
    VLAN  DomainId  MAC address        Active source                  Timestamp        IP address
    20              00:20:20:20:20:20  irb.20                         Jul 07 13:58:47  20.0.0.1
    20              00:50:79:66:68:03  192.168.0.35                   Jul 07 14:16:26
    20              00:50:79:66:68:05  et-0/0/0.20                    Jul 07 14:18:06
    20              0c:0d:aa:00:00:00  et-0/0/0.20                    Jul 07 14:17:12
    20              0c:82:f3:7f:00:00  192.168.0.35                   Jul 07 13:58:55

    admin@JUNOS.R1# run show mac-vrf forwarding mac-ip-table

    MAC IP flags  (S - Static, D - Dynamic, L - Local , R - Remote, Lp - Local Proxy,
                   Rp - Remote Proxy, K - Kernel, RT - Dest Route, (N)AD - (Not) Advt to remote,
                   RE - Re-ARP/ND, RO - Router, OV - Override, Ur - Unresolved,
                   RTS - Dest Route Skipped, RGw - Remote Gateway, GBP - Group Based Policy,
                   RTF - Dest Route Forced)
     Routing instance : MAC-VRF-10
     Bridging domain : BD10
       IP                           MAC                  Flags              GBP    Logical            Active
       address                      address                                 Tag    Interface          source
       10.0.0.1                     00:10:10:10:10:10    S,K                       irb.10

    MAC IP flags  (S - Static, D - Dynamic, L - Local , R - Remote, Lp - Local Proxy,
                   Rp - Remote Proxy, K - Kernel, RT - Dest Route, (N)AD - (Not) Advt to remote,
                   RE - Re-ARP/ND, RO - Router, OV - Override, Ur - Unresolved,
                   RTS - Dest Route Skipped, RGw - Remote Gateway, GBP - Group Based Policy,
                   RTF - Dest Route Forced)
     Routing instance : MAC-VRF-20
     Bridging domain : BD20
       IP                           MAC                  Flags              GBP    Logical            Active
       address                      address                                 Tag    Interface          source
       20.0.0.1                     00:20:20:20:20:20    S,K                       irb.20


    ==========================================================================================
    R2
    ==========================================================================================

    set interfaces et-0/0/0 description "TO SW3"
    set interfaces et-0/0/0 flexible-vlan-tagging
    set interfaces et-0/0/0 encapsulation flexible-ethernet-services
    set interfaces et-0/0/0 unit 10 encapsulation vlan-bridge
    set interfaces et-0/0/0 unit 10 vlan-id 10
    set interfaces et-0/0/0 unit 20 encapsulation vlan-bridge
    set interfaces et-0/0/0 unit 20 vlan-id 20

    set interfaces irb unit 10 family inet address 10.0.0.1/24 primary
    set interfaces irb unit 10 family inet address 10.0.0.1/24 preferred
    set interfaces irb unit 10 mac 00:10:10:10:10:10

    set interfaces irb unit 20 family inet address 20.0.0.1/24 primary
    set interfaces irb unit 20 family inet address 20.0.0.1/24 preferred
    set interfaces irb unit 20 mac 00:20:20:20:20:20

    set routing-options forwarding-table chained-composite-next-hop ingress evpn

    set routing-instances EVPN-IRB instance-type vrf
    set routing-instances EVPN-IRB protocols evpn interface irb.10
    set routing-instances EVPN-IRB protocols evpn interface irb.20
    set routing-instances EVPN-IRB protocols evpn default-gateway do-not-advertise
    set routing-instances EVPN-IRB protocols evpn ip-prefix-routes advertise direct-nexthop
    set routing-instances EVPN-IRB protocols evpn ip-prefix-routes encapsulation mpls
    set routing-instances EVPN-IRB protocols evpn ip-prefix-routes import PERMIT-ANY
    set routing-instances EVPN-IRB protocols evpn ip-prefix-routes export PERMIT-ANY
    set routing-instances EVPN-IRB interface irb.10
    set routing-instances EVPN-IRB interface irb.20
    set routing-instances EVPN-IRB route-distinguisher 192.168.0.35:65002
    set routing-instances EVPN-IRB vrf-target target:65002:10
    set routing-instances EVPN-IRB vrf-table-label

    set routing-instances MAC-VRF-10 instance-type mac-vrf
    set routing-instances MAC-VRF-10 protocols evpn encapsulation mpls
    set routing-instances MAC-VRF-10 protocols evpn label-allocation per-instance
    set routing-instances MAC-VRF-10 service-type vlan-aware
    set routing-instances MAC-VRF-10 interface et-0/0/0.10
    set routing-instances MAC-VRF-10 route-distinguisher 192.168.0.35:10
    set routing-instances MAC-VRF-10 vrf-target target:10:1
    set routing-instances MAC-VRF-10 vlans BD10 description VLAN-10-TESTING
    set routing-instances MAC-VRF-10 vlans BD10 vlan-id 10
    set routing-instances MAC-VRF-10 vlans BD10 interface et-0/0/0.10
    set routing-instances MAC-VRF-10 vlans BD10 l3-interface irb.10

    set routing-instances MAC-VRF-20 instance-type mac-vrf
    set routing-instances MAC-VRF-20 protocols evpn encapsulation mpls
    set routing-instances MAC-VRF-20 protocols evpn label-allocation per-instance
    set routing-instances MAC-VRF-20 service-type vlan-aware
    set routing-instances MAC-VRF-20 interface et-0/0/0.20
    set routing-instances MAC-VRF-20 route-distinguisher 192.168.0.35:20
    set routing-instances MAC-VRF-20 vrf-target target:20:2
    set routing-instances MAC-VRF-20 vlans BD20 description VLAN-20-TESTING
    set routing-instances MAC-VRF-20 vlans BD20 vlan-id 20
    set routing-instances MAC-VRF-20 vlans BD20 interface et-0/0/0.20
    set routing-instances MAC-VRF-20 vlans BD20 l3-interface irb.20


    admin@JUNOS.R2# run show route table EVPN-IRB.inet.0

    EVPN-IRB.inet.0: 4 destinations, 12 routes (4 active, 0 holddown, 0 hidden)
    + = Active Route, - = Last Active, * = Both

    10.0.0.0/24        *[Direct/0] 00:32:51
                        >  via irb.10
                        [BGP/170] 00:21:57, localpref 100, from 192.168.0.32
                          AS path: I, validation-state: unverified
                        >  to 172.17.1.9 via et-0/0/1.100, Push 18
                        [BGP/170] 00:21:57, localpref 100, from 192.168.0.33
                          AS path: I, validation-state: unverified
                        >  to 172.17.1.9 via et-0/0/1.100, Push 18
                        [EVPN/170] 00:21:57
                        >  to 172.17.1.9 via et-0/0/1.100, Push 18
    10.0.0.1/32        *[Local/0] 00:32:51
                           Local via irb.10
                        [EVPN/170] 00:21:57
                        >  to 172.17.1.9 via et-0/0/1.100, Push 18
    20.0.0.0/24        *[Direct/0] 00:21:51
                        >  via irb.20
                        [BGP/170] 00:21:57, localpref 100, from 192.168.0.32
                          AS path: I, validation-state: unverified
                        >  to 172.17.1.9 via et-0/0/1.100, Push 18
                        [BGP/170] 00:21:57, localpref 100, from 192.168.0.33
                          AS path: I, validation-state: unverified
                        >  to 172.17.1.9 via et-0/0/1.100, Push 18
                        [EVPN/170] 00:21:57
                        >  to 172.17.1.9 via et-0/0/1.100, Push 18
    20.0.0.1/32        *[Local/0] 00:21:51
                           Local via irb.20
                        [EVPN/170] 00:21:57
                        >  to 172.17.1.9 via et-0/0/1.100, Push 18

    [edit]
    admin@JUNOS.R2# run show evpn instance extensive
    Instance: MAC-VRF-10
      Route Distinguisher: 192.168.0.35:10
      VLAN ID: 10
      Per-instance MAC route label: 46
      Control word enabled
      Duplicate MAC detection threshold: 5
      Duplicate MAC detection window: 180
      MAC database status                     Local  Remote
        MAC advertisements:                       3       3
        MAC+IP advertisements:                    1       1
        Default gateway MAC advertisements:       1       1
      Number of local interfaces: 2 (2 up)
        Interface name  ESI                            Mode             Status     AC-Role
        .local..57      00:00:00:00:00:00:00:00:00:00  single-homed     Up         Root
        et-0/0/0.10     00:00:00:00:00:00:00:00:00:00  single-homed     Up         Root
      Number of IRB interfaces: 1 (1 up)
        Interface name  VLAN   VNI    Status  L3 context
        irb.10          10             Up     EVPN-IRB
      Number of protect interfaces: 0
      Number of bridge domains: 1
        VLAN  Domain-ID Intfs/up   IRB-intf  Mode            MAC-sync v4-SG-sync v6-SG-sync
        10                 1  1    irb.10    Extended        Enabled  Disabled   Disabled
      Number of neighbors: 1
        Address               MAC    MAC+IP        AD        IM        ES Leaf-label Remote-DCI-Peer Flow-label
        192.168.0.34            3         1         0         1         0                            NO
      Number of ethernet segments: 1
        ESI: 05:00:00:fd:ea:00:00:00:0a:00
          Local interface: irb.10, Status: Up/Forwarding
      SMET Forwarding: Disabled
    Instance: MAC-VRF-20
      Route Distinguisher: 192.168.0.35:20
      VLAN ID: 20
      Per-instance MAC route label: 67
      Control word enabled
      Duplicate MAC detection threshold: 5
      Duplicate MAC detection window: 180
      MAC database status                     Local  Remote
        MAC advertisements:                       3       3
        MAC+IP advertisements:                    1       1
        Default gateway MAC advertisements:       1       1
      Number of local interfaces: 2 (2 up)
        Interface name  ESI                            Mode             Status     AC-Role
        .local..51      00:00:00:00:00:00:00:00:00:00  single-homed     Up         Root
        et-0/0/0.20     00:00:00:00:00:00:00:00:00:00  single-homed     Up         Root
      Number of IRB interfaces: 1 (1 up)
        Interface name  VLAN   VNI    Status  L3 context
        irb.20          20             Up     EVPN-IRB
      Number of protect interfaces: 0
      Number of bridge domains: 1
        VLAN  Domain-ID Intfs/up   IRB-intf  Mode            MAC-sync v4-SG-sync v6-SG-sync
        20                 1  1    irb.20    Extended        Enabled  Disabled   Disabled
      Number of neighbors: 1
        Address               MAC    MAC+IP        AD        IM        ES Leaf-label Remote-DCI-Peer Flow-label
        192.168.0.34            3         1         0         1         0                            NO
      Number of ethernet segments: 1
        ESI: 05:00:00:fd:ea:00:00:00:14:00
          Local interface: irb.20, Status: Up/Forwarding
      SMET Forwarding: Disabled
    Instance: __default_evpn__
      Route Distinguisher: 192.168.0.35:0
      Number of bridge domains: 0
      Number of neighbors: 0

    [edit]
    admin@JUNOS.R2# run show evpn database
    Instance: MAC-VRF-10
    VLAN  DomainId  MAC address        Active source                  Timestamp        IP address
    10              00:10:10:10:10:10  irb.10                         Jul 07 13:49:27  10.0.0.1
    10              00:50:79:66:68:01  192.168.0.34                   Jul 07 14:00:14
    10              00:50:79:66:68:02  et-0/0/0.10                    Jul 07 13:55:42
    10              0c:0d:aa:00:00:00  192.168.0.34                   Jul 07 13:58:55
    10              0c:82:f3:7f:00:00  et-0/0/0.10                    Jul 07 13:49:27

    Instance: MAC-VRF-20
    VLAN  DomainId  MAC address        Active source                  Timestamp        IP address
    20              00:20:20:20:20:20  irb.20                         Jul 07 13:58:54  20.0.0.1
    20              00:50:79:66:68:03  et-0/0/0.20                    Jul 07 14:16:25
    20              00:50:79:66:68:05  192.168.0.34                   Jul 07 14:18:06
    20              0c:0d:aa:00:00:00  192.168.0.34                   Jul 07 14:17:12
    20              0c:82:f3:7f:00:00  et-0/0/0.20                    Jul 07 13:58:54

    admin@JUNOS.R2# run show mac-vrf forwarding mac-ip-table

    MAC IP flags  (S - Static, D - Dynamic, L - Local , R - Remote, Lp - Local Proxy,
                   Rp - Remote Proxy, K - Kernel, RT - Dest Route, (N)AD - (Not) Advt to remote,
                   RE - Re-ARP/ND, RO - Router, OV - Override, Ur - Unresolved,
                   RTS - Dest Route Skipped, RGw - Remote Gateway, GBP - Group Based Policy,
                   RTF - Dest Route Forced)
     Routing instance : MAC-VRF-10
     Bridging domain : BD10
       IP                           MAC                  Flags              GBP    Logical            Active
       address                      address                                 Tag    Interface          source
       10.0.0.1                     00:10:10:10:10:10    S,K                       irb.10

    MAC IP flags  (S - Static, D - Dynamic, L - Local , R - Remote, Lp - Local Proxy,
                   Rp - Remote Proxy, K - Kernel, RT - Dest Route, (N)AD - (Not) Advt to remote,
                   RE - Re-ARP/ND, RO - Router, OV - Override, Ur - Unresolved,
                   RTS - Dest Route Skipped, RGw - Remote Gateway, GBP - Group Based Policy,
                   RTF - Dest Route Forced)
     Routing instance : MAC-VRF-20
     Bridging domain : BD20
       IP                           MAC                  Flags              GBP    Logical            Active
       address                      address                                 Tag    Interface          source
       20.0.0.1                     00:20:20:20:20:20    S,K                       irb.20



  • 2.  RE: vJunosEvolved EVPN-MPLS Anycast IRB gateway not working

    Posted 07-11-2023 16:27

    I'll have one of our folks check this ...



    ------------------------------
    Art Stine
    ------------------------------



  • 3.  RE: vJunosEvolved EVPN-MPLS Anycast IRB gateway not working

    Posted 07-13-2023 11:08

    Thank you!

    Two additional items.  

    First, in my config above, the mac-vrf service-type is vlan-aware, which is a setting I tried unsuccessfully.  Most all of my testing otherwise is with service-type vlan-based.

    Second, I tried to add a static ARP to the IRB, with the locally connected host ARP.  This actually worked.  I added another ARP for a node across the EVPN, and even though the MAC was in the mac-vrf mac-table, it was not reachable by ping.  Possibly because it's not straight-forward to indicate the related l2-interface for the ARP entry.  Or, I did it incorrectly :) 

    set interfaces irb unit 10 family inet address 10.0.0.1/24 arp 10.0.0.10 mac 00:50:79:66:68:01

    Ethernet switching table : 5 entries, 5 learned
    Routing instance : MAC-VRF-10
        Vlan                MAC                 MAC         Age   GBP     Logical                NH        RTR
        name                address             flags             Tag     interface              Index     ID
        BD10                00:50:79:66:68:01   D             -            et-0/0/0.10            0         0

    (etc..)

    admin@JUNOS.R1# run ping instance EVPN-IRB 10.0.0.10
    PING 10.0.0.10 (10.0.0.10) 56(84) bytes of data.
    64 bytes from 10.0.0.10: icmp_seq=1 ttl=64 time=579 ms
    64 bytes from 10.0.0.10: icmp_seq=2 ttl=64 time=17.3 ms
    64 bytes from 10.0.0.10: icmp_seq=3 ttl=64 time=40.7 ms
    64 bytes from 10.0.0.10: icmp_seq=4 ttl=64 time=26.8 ms
    64 bytes from 10.0.0.10: icmp_seq=5 ttl=64 time=27.5 ms
    64 bytes from 10.0.0.10: icmp_seq=6 ttl=64 time=26.1 ms
    ^C
    --- 10.0.0.10 ping statistics ---
    6 packets transmitted, 6 received, 0% packet loss, time 5007ms

    So it appears to be something with broadcast traffic reaching the IRB when the VLAN is configured in a mac-vrf.  ARP does seem to pass from IRB to LAN, but not LAN to IRB.,




  • 4.  RE: vJunosEvolved EVPN-MPLS Anycast IRB gateway not working

    Posted 08-21-2023 13:56

    Updating this thread after upgrading the vJunos-evolved nodes to 23.2R1.15-EVO.

    With vlan-based MAC-VRF for VLANs 10 & 20 + L3VPN for IRBs, I can now ping the gateway from each VPCS test node, which I previously could not do.  Possibly resolved with PR1723756.  So, local ARP appears to work now.  I can also ping the directly attached test nodes from the attached routers (R1 & R2). 

    What is now not working, but was before, is the ability to ping between nodes in the same VLAN connected to different PEs (R1 & R2), over EVPN.  While pinging 10.0.0.10 to 10.0.0.20, a PCAP shows the ICMP packet crossing the backbone from R1 to R2, but the packet does not exit the CE interface  on R2 (et-0/0/0.10).  It is also not possible to ping a node connected to an adjacent router (i.e. cannot ping 10.0.0.10 from R2, but can from R1).

    The MAC-VRF mac-ip-table looks correct.

    admin@JUNOS.R1# run show mac-vrf forwarding mac-ip-table

    MAC IP flags  (S - Static, D - Dynamic, L - Local , R - Remote, Lp - Local Proxy,
                   Rp - Remote Proxy, K - Kernel, RT - Dest Route, (N)AD - (Not) Advt to remote,
                   RE - Re-ARP/ND, RO - Router, OV - Override, Ur - Unresolved,
                   RTS - Dest Route Skipped, RGw - Remote Gateway, GBP - Group Based Policy,
                   RTF - Dest Route Forced)
     Routing instance : MAC-VRF-10
     Bridging domain : BD10
       IP                           MAC                  Flags              GBP    Logical            Active
       address                      address                                 Tag    Interface          source
       10.0.0.1                     00:10:10:10:10:10    S,K                       irb.10
       10.0.0.10                    00:50:79:66:68:01    DL,K,RT,AD                et-0/0/0.10
       10.0.0.20                    00:50:79:66:68:02    DR,K,RT                                      192.168.0.35

    admin@JUNOS.R2# run show mac-vrf forwarding mac-ip-table

    MAC IP flags  (S - Static, D - Dynamic, L - Local , R - Remote, Lp - Local Proxy,
                   Rp - Remote Proxy, K - Kernel, RT - Dest Route, (N)AD - (Not) Advt to remote,
                   RE - Re-ARP/ND, RO - Router, OV - Override, Ur - Unresolved,
                   RTS - Dest Route Skipped, RGw - Remote Gateway, GBP - Group Based Policy,
                   RTF - Dest Route Forced)
     Routing instance : MAC-VRF-10
     Bridging domain : BD10
       IP                           MAC                  Flags              GBP    Logical            Active
       address                      address                                 Tag    Interface          source
       10.0.0.1                     00:10:10:10:10:10    S,K                       irb.10
       10.0.0.10                    00:50:79:66:68:01    DR,K,RT                                      192.168.0.34
       10.0.0.20                    00:50:79:66:68:02    DL,K,RT,AD                et-0/0/0.10

    Also interesting is that I see 10.0.0.10 ARP for 10.0.0.20 in VLAN 10 and receive an ARP reply, but ICMP then doesn't successfully reach the remote node, never leaving the remote CE interface (et-0/0/0.10) of R2 towards 10.0.0.20.




  • 5.  RE: vJunosEvolved EVPN-MPLS Anycast IRB gateway not working

    Posted 08-25-2023 17:15

    Hi, We got the below info from our Test team.

    Can you please re-check ?

    Hi,

    I quickly looked at the config provided in the below link,

    vJunosEvolved EVPN-MPLS Anycast IRB gateway not working | Labs (juniper.net)

    I see that EVPN IRB is added to EVPN T-5 L3VRF instance EVPN-IRB and in that T-5 instance we have an export policy "PERMIT_ANY" configured, which I am not sure if it is exporting host routes also.

    We have not yet supported EVPN-MPLS IRB on EVPNT-5 instance[EVPN-IRB] as part of IRB L3 GW support on PTX which is a Non-Goal in the release. So please remove EVPN T-5 config from the L3 VRF EVPN-IRB.

    Also, I see that "protocols evpn default-gateway do-not-advertise" is configured on T-5 L3 VRF EVPN-IRB which is wrong, it should be configured on the EVPN L2 mac-vrf instance[MAC-VRF-10 && MAC-VRF-20].

    set routing-instances EVPN-IRB instance-type vrf

    set routing-instances EVPN-IRB protocols evpn interface irb.10

    set routing-instances EVPN-IRB protocols evpn interface irb.20

    set routing-instances EVPN-IRB protocols evpn default-gateway do-not-advertise  <<< this needs to be configured on mac-vrf instance

    set routing-instances EVPN-IRB protocols evpn ip-prefix-routes advertise direct-nexthop

    set routing-instances EVPN-IRB protocols evpn ip-prefix-routes encapsulation mpls

    set routing-instances EVPN-IRB protocols evpn ip-prefix-routes import PERMIT-ANY

    set routing-instances EVPN-IRB protocols evpn ip-prefix-routes export PERMIT-ANY

    set routing-instances EVPN-IRB interface irb.10

    set routing-instances EVPN-IRB interface irb.20

    set routing-instances EVPN-IRB route-distinguisher 192.168.0.35:65002

    set routing-instances EVPN-IRB vrf-target target:65002:10

    set routing-instances EVPN-IRB vrf-table-label

    Thanks

    Soumyodeep



    ------------------------------
    Vignesh Shanmugaraju
    ------------------------------



  • 6.  RE: vJunosEvolved EVPN-MPLS Anycast IRB gateway not working

    Posted 20 days ago

    Hello,

    I have a similar setup. A mac-vrf with two hosts on separate PE devices that can not ping each other but are able to ping the gateway. Both ips show up in the evpn-arp-table on each device. I have the "default-gateway do-not-advertise" statement in my mac-vrf.

    When pcapping the ports I see the vxlan-encapsulated ping sent from Host1 > Leaf 1 > Spine > Leaf 2 but Leaf 2 never sends the ping to Host 2.

    Was anybody able to resolve this issue?



    ------------------------------
    AUSTIN LEWIS
    ------------------------------