Routing

Expand all | Collapse all

[MX480] apply three-color-policer/shaping to ae interface (19.3R2.9)

  • 1.  [MX480] apply three-color-policer/shaping to ae interface (19.3R2.9)

    Posted 28 days ago

    Hello,

     

    I come here because I can't make a  three-color-policer works on an aggregate interface... The ae interface is an LACP of 2x40G interfaces

    Here is our configuration on this interface :

    # show interfaces ae109
    per-unit-scheduler;
    flexible-vlan-tagging;
    mtu 9216;
    encapsulation flexible-ethernet-services;
    aggregated-ether-options {
        lacp {
            active;
            periodic slow;
        }
    }
    unit 1012 {
        filter {
            input FILTER_SHAPING;
            output FILTER_SHAPING;
        }
        family bridge {
            interface-mode trunk;
            vlan-id-list 1012;
        }
    }
    
    # show firewall family any filter FILTER_SHAPING
    interface-specific;
    term SHAPING {
        then {
            three-color-policer {
                single-rate PO3C_SHAPING;
            }
            count COUNT_FILTER;
        }
    }
    # show firewall three-color-policer PO3C_SHAPING
    logical-interface-policer;
    action {
        loss-priority high then discard;
    }
    single-rate {
        color-blind;
        committed-information-rate 100m;
        committed-burst-size 5m;
        excess-burst-size 5m;
    }
    
    

    When I'm testing this configuration, we cannot get throuput higher tha, 65Mbps in both direction with TCP or UDP. Even if we test with higher bandwidth, we cannoit reach the configuration and the bandwidth is ~35% smaller than the configured value...

    We are testing with iperf which is a VM connected to this AE with VLAN 1012.

    I really don't understand this behavior because the configuration is not that complex.

     

    Do you have any idea why it does not working as expected or proposition for simply put a shaping on input/ouput of an ae interface ?

     

    Thanks for your help.



  • 2.  Re: [MX480] apply three-color-policer/shaping to ae interface (19.3R2.9)

    Posted 25 days ago

    Hello again,

     

    Does somebody has any ideas ?

     

    Thanks,

     



  • 3.  Re: [MX480] apply three-color-policer/shaping to ae interface (19.3R2.9)

    Posted 21 days ago

    Hello,

     

    A little up please.

     

    Regards



  • 4.  Re: [MX480] apply three-color-policer/shaping to ae interface (19.3R2.9)

    Posted 21 days ago

    Hello,

    What packet size is used for the iperf test, please?

    HTH

    Thx

    Alex



  • 5.  Re: [MX480] apply three-color-policer/shaping to ae interface (19.3R2.9)

    Posted 21 days ago

    Hello,

     

    Ok, my messages are deleted (4 times already) - so I will try to post it part by part to check what is the issue.

     

    BR,
    Andrei

    Accept as Solution = cool !
    Accept as Solution+Kudo = You are a Star !



  • 6.  Re: [MX480] apply three-color-policer/shaping to ae interface (19.3R2.9)

    Posted 21 days ago

    Part 1.

    Theory 

    Practical methodology for measuring end-to-end TCP Throughput in a managed IP network can be looked up in RFC6349 (https://tools.ietf.org/html/rfc6349).

    As throughput is essentially bound to the Bandwidth-Delay Product (BDP), you can calculate the TCP throughput very nice on the following website:
    https://www.switch.ch/network/tools/tcp_throughput/


    Another good resource about the whole topic can be found on eduPERT by GÉANT (GÉANT is the pan-European data network for the research and education community. It interconnects national research and education networks across Europe)

    https://wiki.geant.org/display/public/EK/Network

     

    BR,
    Andrei

    Accept as Solution = cool !
    Accept as Solution+Kudo = You are a Star !



  • 7.  Re: [MX480] apply three-color-policer/shaping to ae interface (19.3R2.9)

    Posted 21 days ago

    Part 2

     

    1st was the "perfect world test", with 2x Windows-based Notebooks directly connected

     

    Test failed: as I was unable to reach 1G (or any closer results I had with our “production” Unix/based IPerf server)

    Few examples:

    iperf3.exe -c 10.199.105.158 -p 5201 -w 536870912 -N -l 1048576 -M 9000

    [ ID] Interval Transfer Bandwidth

    [ 4] 0.00-10.00 sec 1.23 GBytes 1.06 Gbits/sec sender

    [ 4] 0.00-10.00 sec 748 MBytes 627 Mbits/sec receiver

     


    iperf-3.1.3-win64>iperf3.exe -c 10.199.105.158 -p 5201 -u -b 0 -l 65507 -w 10m

    [ ID] Interval Transfer Bandwidth Jitter Lost/Total Datagrams

    [ 4] 0.00-10.01 sec 865 MBytes 725 Mbits/sec 0.000 ms 0/0 (0%)



    Accept as Solution = cool !
    Accept as Solution+Kudo = You are a Star !



  • 8.  Re: [MX480] apply three-color-policer/shaping to ae interface (19.3R2.9)

    Posted 21 days ago

    Part 3

     

    2nd once I found more or less wanted parameters I tested the Juniper policers:

     

    Empirically was proved that 1x stream will cover all our needs (however under some conditions you can increase the number of flows) , increasing the number of flows did not improve the situation.

     

    The following was considered the “best results” setup

    -b - target bandwidth in bits/sec (0 for unlimited), in my case I was using 10, 100, 300, 500, 700 Mbps to test different values

     

    iperf3.exe -c A.B.C.D -p 5201 -w 640k -N -l 640k -b XXX

    10Mbps Ethernet test
    Recommended burst-size-limit 6250
    set firewall policer 10m-bw-limit if-exceeding bandwidth-limit 10m

    set firewall policer 10m-bw-limit if-exceeding burst-size-limit 6250

    set firewall policer 10m-bw-limit then discard

     

    The tested values were around 1-2Mbps and I did not save the results for this.

     

    set firewall policer 10m-bw-limit if-exceeding bandwidth-limit 10m

    set firewall policer 10m-bw-limit if-exceeding burst-size-limit 10m

    set firewall policer 10m-bw-limit then discard

     

    [ 4] local 10.199.105.158 port 59429 connected to 10.199.105.157 port 5201

    [ ID] Interval Transfer Bandwidth

    [ 4] 0.00-1.00 sec 1.88 MBytes 15.7 Mbits/sec

    [ 4] 1.00-2.00 sec 1.25 MBytes 10.5 Mbits/sec

    [ 4] 2.00-3.00 sec 1.25 MBytes 10.5 Mbits/sec

    [ 4] 3.00-4.00 sec 640 KBytes 5.24 Mbits/sec

    [ 4] 4.00-5.00 sec 1.88 MBytes 15.7 Mbits/sec

    [ 4] 5.00-6.00 sec 640 KBytes 5.24 Mbits/sec

    [ 4] 6.00-7.00 sec 1.25 MBytes 10.5 Mbits/sec

    [ 4] 7.00-8.00 sec 1.25 MBytes 10.5 Mbits/sec

    [ 4] 8.00-9.00 sec 640 KBytes 5.24 Mbits/sec

    [ 4] 9.00-10.00 sec 1.25 MBytes 10.5 Mbits/sec

    - - - - - - - - - - - - - - - - - - - - - - - - -

    [ ID] Interval Transfer Bandwidth

    [ 4] 0.00-10.00 sec 11.9 MBytes 9.96 Mbits/sec sender

    [ 4] 0.00-10.00 sec 11.0 MBytes 9.21 Mbits/sec receiver


    burst-size-limit 1m
    set firewall policer 10m-bw-limit if-exceeding bandwidth-limit 10m

    set firewall policer 10m-bw-limit if-exceeding burst-size-limit 1m

    set firewall policer 10m-bw-limit then discard

     

    [ ID] Interval Transfer Bandwidth

    [ 4] 0.00-1.00 sec 1.88 MBytes 15.7 Mbits/sec

    [ 4] 1.00-2.00 sec 1.25 MBytes 10.5 Mbits/sec

    [ 4] 2.00-3.00 sec 1.25 MBytes 10.5 Mbits/sec

    [ 4] 3.00-4.00 sec 1.25 MBytes 10.5 Mbits/sec

    [ 4] 4.00-5.00 sec 1.25 MBytes 10.5 Mbits/sec

    [ 4] 5.00-6.00 sec 640 KBytes 5.24 Mbits/sec

    [ 4] 6.00-7.00 sec 1.25 MBytes 10.5 Mbits/sec

    [ 4] 7.00-8.00 sec 1.25 MBytes 10.5 Mbits/sec

    [ 4] 8.00-9.00 sec 1.25 MBytes 10.5 Mbits/sec

    [ 4] 9.00-10.00 sec 640 KBytes 5.24 Mbits/sec

    - - - - - - - - - - - - - - - - - - - - - - - - -

    [ ID] Interval Transfer Bandwidth

    [ 4] 0.00-10.00 sec 11.9 MBytes 9.96 Mbits/sec sender

    [ 4] 0.00-10.00 sec 11.1 MBytes 9.33 Mbits/sec receiver

     

    burst-size-limit 100g <<< yes 100G - this was done to prove the effect of burst-size
    set firewall policer 10m-bw-limit if-exceeding bandwidth-limit 10m

    set firewall policer 10m-bw-limit if-exceeding burst-size-limit 100g

    set firewall policer 10m-bw-limit then discard

     

    [ 4] local 10.199.105.158 port 59450 connected to 10.199.105.157 port 5201

    [ ID] Interval Transfer Bandwidth

    [ 4] 0.00-1.00 sec 1.88 MBytes 15.7 Mbits/sec

    [ 4] 1.00-2.00 sec 1.25 MBytes 10.5 Mbits/sec

    [ 4] 2.00-3.00 sec 1.25 MBytes 10.5 Mbits/sec

    [ 4] 3.00-4.00 sec 1.25 MBytes 10.5 Mbits/sec

    [ 4] 4.00-5.00 sec 1.25 MBytes 10.5 Mbits/sec

    [ 4] 5.00-6.00 sec 640 KBytes 5.24 Mbits/sec

    [ 4] 6.00-7.00 sec 1.25 MBytes 10.5 Mbits/sec

    [ 4] 7.00-8.00 sec 1.25 MBytes 10.5 Mbits/sec

    [ 4] 8.00-9.00 sec 640 KBytes 5.25 Mbits/sec

    [ 4] 9.00-10.00 sec 1.25 MBytes 10.5 Mbits/sec

    - - - - - - - - - - - - - - - - - - - - - - - - -

    [ ID] Interval Transfer Bandwidth

    [ 4] 0.00-10.00 sec 11.9 MBytes 9.96 Mbits/sec sender

    [ 4] 0.00-10.00 sec 11.1 MBytes 9.29 Mbits/sec receiver

     

     

    100Mbps Ethernet test:
    This time I will provide only test results as they are self-explanatory:

     

    set firewall policer 100m-bw-limit if-exceeding bandwidth-limit 100m

    set firewall policer 100m-bw-limit if-exceeding burst-size-limit 65k

    set firewall policer 100m-bw-limit then discard

     

    [ ID] Interval Transfer Bandwidth

    [ 4] 0.00-10.00 sec 11.9 MBytes 9.96 Mbits/sec sender

    [ 4] 0.00-10.00 sec 10.9 MBytes 9.15 Mbits/sec receiver

     

    set firewall policer 100m-bw-limit if-exceeding bandwidth-limit 100m

    set firewall policer 100m-bw-limit if-exceeding burst-size-limit 650k

    set firewall policer 100m-bw-limit then discard

     

    [ ID] Interval Transfer Bandwidth

    [ 4] 0.00-10.00 sec 25.0 MBytes 21.0 Mbits/sec sender

    [ 4] 0.00-10.00 sec 24.1 MBytes 20.2 Mbits/sec receiver

     

    set firewall policer 100m-bw-limit if-exceeding bandwidth-limit 100m

    set firewall policer 100m-bw-limit if-exceeding burst-size-limit 1m

    set firewall policer 100m-bw-limit then discard

     

    [ ID] Interval Transfer Bandwidth

    [ 4] 0.00-10.00 sec 34.4 MBytes 28.8 Mbits/sec sender

    [ 4] 0.00-10.00 sec 33.6 MBytes 28.2 Mbits/sec receiver

     

    set firewall policer 100m-bw-limit if-exceeding bandwidth-limit 100m

    set firewall policer 100m-bw-limit if-exceeding burst-size-limit 10m

    set firewall policer 100m-bw-limit then discard

     

    [ 4] local 10.199.105.158 port 59232 connected to 10.199.105.157 port 5201

    [ ID] Interval Transfer Bandwidth

    [ 4] 0.00-1.00 sec 13.8 MBytes 115 Mbits/sec

    [ 4] 1.00-2.00 sec 10.6 MBytes 89.1 Mbits/sec

    [ 4] 2.00-3.00 sec 12.5 MBytes 105 Mbits/sec

    [ 4] 3.00-4.00 sec 9.38 MBytes 78.6 Mbits/sec

    [ 4] 4.00-5.00 sec 13.1 MBytes 110 Mbits/sec

    [ 4] 5.00-6.00 sec 8.75 MBytes 73.4 Mbits/sec

    [ 4] 6.00-7.00 sec 13.1 MBytes 110 Mbits/sec

    [ 4] 7.00-8.00 sec 12.5 MBytes 105 Mbits/sec

    [ 4] 8.00-9.00 sec 9.38 MBytes 78.8 Mbits/sec

    [ 4] 9.00-10.00 sec 12.5 MBytes 105 Mbits/sec

    - - - - - - - - - - - - - - - - - - - - - - - - -

    [ ID] Interval Transfer Bandwidth

    [ 4] 0.00-10.00 sec 116 MBytes 97.0 Mbits/sec sender

    [ 4] 0.00-10.00 sec 115 MBytes 96.3 Mbits/sec receiver

     

    BR,
    Andrei

    Accept as Solution = cool !
    Accept as Solution+Kudo = You are a Star !



  • 9.  Re: [MX480] apply three-color-policer/shaping to ae interface (19.3R2.9)

    Posted 21 days ago

    Part 4

     

    Summary

     

    - As you can see there is a big impact on how to do you test + what is the burst size.

     

    BR,
    Andrei

    Accept as Solution = cool !
    Accept as Solution+Kudo = You are a Star !