Routing

Hello,

We are facing internet speed issue with customers whose last mile are connected on MX104. Let me indicate that, we have migrated those customers from Cisco 6500 as PE to Juniper MX104 as PE, since this migration, all customers with last mile link bandwidth is 1Gbit/s are unable to reach 500Mbit/s download on their internet link, the upload internet has not problem.

Customers CPE<--Link 1Gbit/s-->SWITCH <--10Gbit/s-->PE (MX104)<--20Gbit/s-->Internet

The switch is cisco one handle 9216 as MTU, the Customer CPE wan interface has 1500 as MTU

Wa are not any bandwidth limitation setup on MX104, no CoS customization.

We are running junos 15.1R6.7, I have also the same results with junos 17.1R2.7

Note that, interface facing customer is handle sub interfaces corresponding to customers vlans, below a snippet config  of that interfaces

set interfaces xe-0/0/0 description "Customers collect"
set interfaces xe-0/0/0 per-unit-scheduler
set interfaces xe-0/0/0 flexible-vlan-tagging
set interfaces xe-0/0/0 mtu 9192
set interfaces xe-0/0/0 encapsulation flexible-ethernet-services
set interfaces xe-0/0/0 unit 1031 description "Customer 1"
set interfaces xe-0/0/0 unit 1031 vlan-id 1031
set interfaces xe-0/0/0 unit 1031 family inet address XX.XX.XX.XX/31

set interfaces xe-0/0/0 unit 1070 description "Customer 2"
set interfaces xe-0/0/0 unit 1070 vlan-id 1070
set interfaces xe-0/0/0 unit 1070 family inet address YY.YY.YY.YY/31

At this step of investigation, I'm not seeing what is the root cause of this issue, do someone has already meet this issue with juniper MX ? and how to solve this issue ?

thanks in advance for your reply.

Hello,

Check if You are getting PAUSE frames from the switch :

show interfaces xe-0/0/0 media detail | grep paus

HTH

Thx

Alex

Hello,

Thank you for your reoly.

I checked pause parameters on MX104 and switch, I find 0 counter on pause parameter.

MX104>show interfaces xe-0/0/0 media detail | match paus

    MAC pause frames                         0                0

Do traceoptions enable can be the root cause of this poor performance ?

Any ideas will be wellcome.

Best regards

Hello,

Is the customer who has speed problems connected to this port (xe-0/0/0)?

What about other customers with speed problems, what port(s) they are connected to?

Can You collect same printout from other ports where customers with speed problems reside?

HTH

Thx

Alex

Hello Alex,

Thanks for taking time to reply me.

---

@aarseniev wrote:

Hello,

Is the customer who has speed problems connected to this port (xe-0/0/0)?

---

Customers are connected directly on SWITCH then SWITCH are connected to xe-0/0/0 (10Gbit/s) on MX104, as below

Customers CPE <---Link 1Gbit/s----->SWITCH<----xe-0/0/0----->MX104<----20Gbit/s----->INTERNET

---

@aarseniev

What about other customers with speed problems, what port(s) they are connected to?

 

---

This internet speed issue is only observed for customers who have 1Gbit/s link bandwidth and impacted only their download traffic, what I don't understand is, if I replace the MX104 by the cisco 6500, customers can get 1Gbit/s with their download traffic even upload.

---

@aarseniev

Can You collect same printout from other ports where customers with speed problems reside?

 

---

I have collect statistics on interfaces, there are no errors, no pause, etc

MX was running traceoptions debug on OSPF, I have stop this task, but not really improvement observe.

Is there anything I have to check on MX104 ?

Best regards

Hi,

Can you get the output of "show interfaces queue xe-0/0/0". Are there any chassis alarms in "show chassis alarms" output? What is the interface name for the core-facing interface? Could you include that config as well?

Can you provide following output - 

show class-of-service interface xe-0/0/0

show class-of-service interface xe-0/0/0.0

Can you also provide output of "show chassis hardware command". Please scrub all serial numbers.

Hello;

Thanks for your reply, find below the output you requested.
Note I have tested also without class-of-service setup on edge interface (xe-0/0/0), the result was the same, all customers with bandwidth 1Gbit/s can't reach it on their down traffic.

Currently all customers with 1Gbit/s internet bandwidth are connected on Cisco 6500, their will be migrate back once I find a solution.

Let me know if you need others informations.

-------------------OUTPUT REQUEST-----------------------------------

CLASS-OF-SERVICE
--------------------------------------------------------------------------------
user@mx104> show class-of-service interface xe-0/0/0
Physical interface: xe-0/0/0, Index: 145
Maximum usable queues: 8, Queues in use: 4
  Scheduler map: <default>, Index: 2
  Congestion-notification: Disabled

  Logical interface: xe-0/0/0.1031, Index: 346
Object                  Name                   Type                    Index
Traffic-control-profile LINK_100Mbps_Default   Output                   6855
Classifier              ipprec-compatibility   ip                         13

  Logical interface: xe-0/0/0.1070, Index: 347
Object                  Name                   Type                    Index
Traffic-control-profile LINK_100Mbps_Default   Output                   6855
Classifier              ipprec-compatibility   ip                         13

  Logical interface: xe-0/0/0.1211, Index: 348
Object                  Name                   Type                    Index
Traffic-control-profile LINK_100Mbps_Default   Output                   6855
Classifier              ipprec-compatibility   ip                         13

  Logical interface: xe-0/0/0.1307, Index: 340
Object                  Name                   Type                    Index
Traffic-control-profile LINK_100Mbps_Default   Output                   6855
Classifier              ipprec-compatibility   ip                         13

  Logical interface: xe-0/0/0.1502, Index: 349
Object                  Name                   Type                    Index
Traffic-control-profile LINK_100Mbps_Default   Output                   6855
Classifier              ipprec-compatibility   ip                         13

  Logical interface: xe-0/0/0.1503, Index: 350
Object                  Name                   Type                    Index
Traffic-control-profile LINK_100Mbps_Default   Output                   6855
Classifier              ipprec-compatibility   ip                         13

  Logical interface: xe-0/0/0.2005, Index: 351
Object                  Name                   Type                    Index
Traffic-control-profile LINK_100Mbps_Default   Output                   6855
Classifier              ipprec-compatibility   ip                         13

  Logical interface: xe-0/0/0.2625, Index: 358
Object                  Name                   Type                    Index
Scheduler-map           <default>              Output                      2
Classifier              dscp-ipv6-compatibility dscp-ipv6                  9
Classifier              ipprec-compatibility   ip                         13

  Logical interface: xe-0/0/0.2674, Index: 359
Object                  Name                   Type                    Index
Traffic-control-profile LINK_100Mbps_Default   Output                   6855
Classifier              ipprec-compatibility   ip                         13

  Logical interface: xe-0/0/0.271, Index: 345
Object                  Name                   Type                    Index
Traffic-control-profile LINK_100Mbps_Default   Output                   6855
Classifier              ipprec-compatibility   ip                         13

  Logical interface: xe-0/0/0.3007, Index: 360
Object                  Name                   Type                    Index
Traffic-control-profile LINK_100Mbps_Default   Output                   6855
Classifier              dscp-ipv6-compatibility dscp-ipv6                  9
Classifier              ipprec-compatibility   ip                         13

  Logical interface: xe-0/0/0.3008, Index: 361
Object                  Name                   Type                    Index
Traffic-control-profile LINK_100Mbps_Default   Output                   6855
Classifier              dscp-ipv6-compatibility dscp-ipv6                  9
Classifier              ipprec-compatibility   ip                         13

  Logical interface: xe-0/0/0.3012, Index: 362
Object                  Name                   Type                    Index
Traffic-control-profile LINK_100Mbps_Default   Output                   6855
Classifier              ipprec-compatibility   ip                         13

  Logical interface: xe-0/0/0.3017, Index: 363
Object                  Name                   Type                    Index
Traffic-control-profile LINK_200Mbps_Default   Output                   6663
Classifier              ipprec-compatibility   ip                         13

  Logical interface: xe-0/0/0.3018, Index: 364
Object                  Name                   Type                    Index
Traffic-control-profile LINK_100Mbps_Default   Output                   6855
Classifier              ipprec-compatibility   ip                         13

  Logical interface: xe-0/0/0.3023, Index: 365
Object                  Name                   Type                    Index
Traffic-control-profile LINK_100Mbps_Default   Output                   6855
Classifier              ipprec-compatibility   ip                         13

  Logical interface: xe-0/0/0.3024, Index: 366
Object                  Name                   Type                    Index
Traffic-control-profile LINK_100Mbps_Default   Output                   6855
Classifier              ipprec-compatibility   ip                         13
                                        
  Logical interface: xe-0/0/0.3031, Index: 367
Object                  Name                   Type                    Index
Traffic-control-profile LINK_100Mbps_Default   Output                   6855
Classifier              ipprec-compatibility   ip                         13

  Logical interface: xe-0/0/0.3061, Index: 368
Object                  Name                   Type                    Index
Traffic-control-profile LINK_100Mbps_Default   Output                   6855
Classifier              ipprec-compatibility   ip                         13

  Logical interface: xe-0/0/0.3063, Index: 369
Object                  Name                   Type                    Index
Traffic-control-profile LINK_100Mbps_Default   Output                   6855
Classifier              dscp-ipv6-compatibility dscp-ipv6                  9
Classifier              ipprec-compatibility   ip                         13

  Logical interface: xe-0/0/0.3064, Index: 370
Object                  Name                   Type                    Index
Traffic-control-profile LINK_100Mbps_Default   Output                   6855
Classifier              ipprec-compatibility   ip                         13

  Logical interface: xe-0/0/0.3065, Index: 371
Object                  Name                   Type                    Index
Traffic-control-profile LINK_200Mbps_Default   Output                   6663
Classifier              ipprec-compatibility   ip                         13

  Logical interface: xe-0/0/0.3066, Index: 372
Object                  Name                   Type                    Index
Traffic-control-profile LINK_100Mbps_Default   Output                   6855
Classifier              ipprec-compatibility   ip                         13

  Logical interface: xe-0/0/0.3067, Index: 373
Object                  Name                   Type                    Index
Traffic-control-profile LINK_100Mbps_Default   Output                   6855
Classifier              ipprec-compatibility   ip                         13

  Logical interface: xe-0/0/0.3068, Index: 374
Object                  Name                   Type                    Index
Traffic-control-profile LINK_100Mbps_Default   Output                   6855
Classifier              ipprec-compatibility   ip                         13

  Logical interface: xe-0/0/0.3069, Index: 375
Object                  Name                   Type                    Index
Traffic-control-profile LINK_100Mbps_Default   Output                   6855
Classifier              ipprec-compatibility   ip                         13
                                        
  Logical interface: xe-0/0/0.3113, Index: 376
Object                  Name                   Type                    Index
Traffic-control-profile LINK_200Mbps_Default   Output                   6663
Classifier              ipprec-compatibility   ip                         13

  Logical interface: xe-0/0/0.3131, Index: 377
Object                  Name                   Type                    Index
Traffic-control-profile LINK_1Gbps_Default     Output                  48636
Classifier              ipprec-compatibility   ip                         13

  Logical interface: xe-0/0/0.3148, Index: 352
Object                  Name                   Type                    Index
Scheduler-map           <default>              Output                      2
Classifier              dscp-ipv6-compatibility dscp-ipv6                  9
Classifier              ipprec-compatibility   ip                         13

  Logical interface: xe-0/0/0.3150, Index: 353
Object                  Name                   Type                    Index
Scheduler-map           <default>              Output                      2
Classifier              ipprec-compatibility   ip                         13

  Logical interface: xe-0/0/0.3152, Index: 355
Object                  Name                   Type                    Index
Traffic-control-profile LINK_100Mbps_Default   Output                   6855
Classifier              ipprec-compatibility   ip                         13

  Logical interface: xe-0/0/0.3154, Index: 344
Object                  Name                   Type                    Index
Traffic-control-profile LINK_1Gbps_Default     Output                  48636
Classifier              ipprec-compatibility   ip                         13

  Logical interface: xe-0/0/0.3159, Index: 354
Object                  Name                   Type                    Index
Scheduler-map           <default>              Output                      2
Classifier              ipprec-compatibility   ip                         13

  Logical interface: xe-0/0/0.3160, Index: 342
Object                  Name                   Type                    Index
Traffic-control-profile LINK_100Mbps_Default   Output                   6855
Classifier              ipprec-compatibility   ip                         13

  Logical interface: xe-0/0/0.3162, Index: 341
Object                  Name                   Type                    Index
Traffic-control-profile LINK_100Mbps_Default   Output                   6855
Classifier              dscp-ipv6-compatibility dscp-ipv6                  9
Classifier              ipprec-compatibility   ip                         13

  Logical interface: xe-0/0/0.3172, Index: 339
Object                  Name                   Type                    Index
Scheduler-map           <default>              Output                      2
Classifier              ipprec-compatibility   ip                         13

  Logical interface: xe-0/0/0.32767, Index: 378
Object                  Name                   Type                    Index
Traffic-control-profile __control_tc_prof      Output                  45866

  Logical interface: xe-0/0/0.3806, Index: 356
Object                  Name                   Type                    Index
Traffic-control-profile LINK_100Mbps_Default   Output                   6855
Classifier              ipprec-compatibility   ip                         13

  Logical interface: xe-0/0/0.3820, Index: 357
Object                  Name                   Type                    Index
Traffic-control-profile LINK_100Mbps_Default   Output                   6855
Classifier              ipprec-compatibility   ip                         13

------------------------------------------------------------------------------------
user@mx104> show class-of-service interface xe-0/0/0.0  

user@mx104>

------------------------------------------------------------------------------------

user@mx104> show interfaces queue xe-0/0/0
Physical interface: xe-0/0/0, Enabled, Physical link is Up
  Interface index: 145, SNMP ifIndex: 512
  Description: xxxxxxxxxx
Forwarding classes: 16 supported, 4 in use
Egress queues: 8 supported, 4 in use
Queue: 0, Forwarding classes: best-effort
  Queued:
    Packets              :            9867985782                 65989 pps
    Bytes                :        10031094884772             597259392 bps
  Transmitted:
    Packets              :            9867929268                 65989 pps
    Bytes                :        10031014864081             597259392 bps
    Tail-dropped packets :                 56514                     0 pps
    RL-dropped packets   :                     0                     0 pps
    RL-dropped bytes     :                     0                     0 bps
    RED-dropped packets  :                     0                     0 pps
     Low                 :                     0                     0 pps
     Medium-low          :                     0                     0 pps
     Medium-high         :                     0                     0 pps
     High                :                     0                     0 pps
    RED-dropped bytes    :                     0                     0 bps
     Low                 :                     0                     0 bps
     Medium-low          :                     0                     0 bps
     Medium-high         :                     0                     0 bps
     High                :                     0                     0 bps
Queue: 1, Forwarding classes: expedited-forwarding
  Queued:
    Packets              :               1759850                     2 pps
    Bytes                :            2023730647                  5888 bps
  Transmitted:
    Packets              :               1759850                     2 pps
    Bytes                :            2023730647                  5888 bps
    Tail-dropped packets :                     0                     0 pps
    RL-dropped packets   :                     0                     0 pps
    RL-dropped bytes     :                     0                     0 bps
    RED-dropped packets  :                     0                     0 pps
     Low                 :                     0                     0 pps
     Medium-low          :                     0                     0 pps
     Medium-high         :                     0                     0 pps
     High                :                     0                     0 pps
    RED-dropped bytes    :                     0                     0 bps
     Low                 :                     0                     0 bps
     Medium-low          :                     0                     0 bps
     Medium-high         :                     0                     0 bps
     High                :                     0                     0 bps
Queue: 2, Forwarding classes: assured-forwarding
  Queued:
    Packets              :               3431312                   201 pps
    Bytes                :            1187556138                396800 bps
  Transmitted:
    Packets              :               3431312                   201 pps
    Bytes                :            1187556138                396800 bps
    Tail-dropped packets :                     0                     0 pps
    RL-dropped packets   :                     0                     0 pps
    RL-dropped bytes     :                     0                     0 bps
    RED-dropped packets  :                     0                     0 pps
     Low                 :                     0                     0 pps
     Medium-low          :                     0                     0 pps
     Medium-high         :                     0                     0 pps
     High                :                     0                     0 pps
    RED-dropped bytes    :                     0                     0 bps
     Low                 :                     0                     0 bps
     Medium-low          :                     0                     0 bps
     Medium-high         :                     0                     0 bps
     High                :                     0                     0 bps
Queue: 3, Forwarding classes: network-control
  Queued:
    Packets              :              25491790                   102 pps
    Bytes                :            2803164968                115200 bps
  Transmitted:
    Packets              :              25491790                   102 pps
    Bytes                :            2803164968                115200 bps
    Tail-dropped packets :                     0                     0 pps
    RL-dropped packets   :                     0                     0 pps
    RL-dropped bytes     :                     0                     0 bps
    RED-dropped packets  :                     0                     0 pps
     Low                 :                     0                     0 pps
     Medium-low          :                     0                     0 pps
     Medium-high         :                     0                     0 pps
     High                :                     0                     0 pps
    RED-dropped bytes    :                     0                     0 bps
     Low                 :                     0                     0 bps
     Medium-low          :                     0                     0 bps
     Medium-high         :                     0                     0 bps
     High                :                     0                     0 bps

user@mx104>

-----------------------------------------------------------------------------------------------

user@mx104> show chassis alarms
No alarms currently active

user@mx104>  

------------------------------------------------------------------------------------------------

INTERFACES CORE FACING

user@mx104> show mpls interface
Interface        State       Administrative groups (x: extended)
xe-0/1/0.0       Up         <none>
xe-2/0/0.0       Up         <none>


user@mx104> show configuration | display set | match xe-0/1/0
set interfaces xe-0/1/0 description xxxxxxxxx
set interfaces xe-0/1/0 mtu 9192
set interfaces xe-0/1/0 unit 0 family inet address xx.xx.xx.xx/31
set interfaces xe-0/1/0 unit 0 family inet6 address yy:yy:yy:yy/127
set interfaces xe-0/1/0 unit 0 family mpls
set protocols mpls interface xe-0/1/0.0
set protocols ospf area 0.0.0.0 interface xe-0/1/0.0 interface-type p2p
set protocols ospf3 area 0.0.0.0 interface xe-0/1/0.0 interface-type p2p
set protocols ldp interface xe-0/1/0.0

user@mx104> show configuration | display set | match xe-2/0/0    
set interfaces xe-2/0/0 description xxxxxxx
set interfaces xe-2/0/0 mtu 9192
set interfaces xe-2/0/0 unit 0 family inet address xx.xx.xx.xx/31
set interfaces xe-2/0/0 unit 0 family inet6 address yy:yy:yy:yy/127
set interfaces xe-2/0/0 unit 0 family mpls
set protocols mpls interface xe-2/0/0.0
set protocols ospf area 0.0.0.0 interface xe-2/0/0.0 interface-type p2p
set protocols ospf3 area 0.0.0.0 interface xe-2/0/0.0 interface-type p2p
set protocols ldp interface xe-2/0/0.0

user@mx104>

-----------------------------------------------------------------------------------------

user@mx104> show chassis hardware
Hardware inventory:
Item             Version  Part number  Serial number     Description
Chassis                                XXXXX             MX104
Midplane         REV 46   750-044219   XXXXXXXX          MX104
PEM 0            REV 03   740-045933   XXXXXXXXXXX       AC Power Entry Module
PEM 1            REV 03   740-045933   XXXXXXXXXXX       AC Power Entry Module
Routing Engine 0 REV 07   750-053342   XXXXXXXX          RE-MX-104
AFEB 0                    BUILTIN      BUILTIN           Forwarding Engine Processor
FPC 0                     BUILTIN      BUILTIN           MPC BUILTIN
  MIC 0          REV 25   750-028380   XXXXXXXX          3D 2x 10GE XFP
    PIC 0                 BUILTIN      BUILTIN           1x 10GE XFP
      Xcvr 0              NON-JNPR     XXXXXXXXXXX       XFP-10G-ER
    PIC 1                 BUILTIN      BUILTIN           1x 10GE XFP
      Xcvr 0     n        NON-JNPR     XXXXXXXXXXX       XFP-10G-LR
  MIC 1          REV 11   750-049846   XXXXXXXX          3D 20x 1GE(LAN)-E,SFP
    PIC 2                 BUILTIN      BUILTIN           10x 1GE(LAN) -E  SFP
    PIC 3                 BUILTIN      BUILTIN           10x 1GE(LAN) -E  SFP
      Xcvr 8              NON-JNPR     XXXXXXXXXXXXX     SFP-LX10
      Xcvr 9              NON-JNPR     XXXXXXXXXXXX      SFP-LX10
FPC 1                     BUILTIN      BUILTIN           MPC BUILTIN
FPC 2                     BUILTIN      BUILTIN           MPC BUILTIN
  MIC 0                   BUILTIN      BUILTIN           4x 10GE(LAN) SFP+
    PIC 0                 BUILTIN      BUILTIN           4x 10GE(LAN) SFP+
      Xcvr 0              NON-JNPR     XXXXXXXXXXX       SFP+-10G-LR
Fan Tray 0       REV 03   711-049570   XXXXXXXX          Fan Tray

user@mx104>



Thanks

Hello;

I come back to you, regarding what we observe once internet speed test sur running on firefox browser and chrome browser.

What, we remark, is when our customers with 1Gbit/s link is doing internet test speed over firefox, they can't reach above 500Mbit/s on their download traffic, but if the test with chrome, we have reached arround 800Mbit/s in download.

So, the problem was the browser used by the customer.

Thanks for the time you take in order to try understanding this issue.

Thanks a lot