Fast Path, Fast Track and ISP Network

Design

sekuritim.com
Telefon: 0216 302 22 21
E-Mail: himmet.turkan@sekuritim.com
Youtube: MikroTik Türkiye
Facebook: /mikrotikturkiye

Türkiye - 2018
 Himmet TÜRKAN
MTCNA, MTCTCE, MTCRE
MikroTik Danışmanı
Network Admin
 Interframe Spacing

Does the interface rate affect transmission times?

●
Ethernet cables do not transmit data continuously, data is transmitted
periodically.
●
Interframe spacing is the waiting time between two ports of Ethernet ports.
●
Waiting time between two Frames determines Interface Rate
9.6 µs for 10 Mbit/s Ethernet
0.96 µs for 100 Mbit/s Ethernet
96 ns for Gigabit Ethernet
9.6 ns for 10 Gigabit Ethernet

1 second =1,000 ms
1 ms = 1,000 µs mikrosaniye
https://en.wikipedia.org/wiki/Interpacket_gap
Interframe Spacing
 Interframe Spacing
Interface Rate =10Mbps

https://en.wikipedia.org/wiki/Interpacket_gap
 Interframe Spacing
Interface Rate =100Mbps

https://en.wikipedia.org/wiki/Interpacket_gap
 Interframe Spacing
Interface Rate =1Gbps

https://en.wikipedia.org/wiki/Interpacket_gap
 Interframe Spacing
Interface Rate =10Gbps

https://en.wikipedia.org/wiki/Interpacket_gap
 Interframe Spacing

Minimum Average Maximum Traffic Performance

10Mbit 2.52ms 2.53ms 3.75ms 1mbps X

100Mbit 291us 295us 415us 1mbps 8.6x
1Gbit 68.2us 72.7us 174us 1mbps 4.2x
10Gbit 24us 44.9us X 1mbps 2.8x

1 second =1,000 ms
1 ms = 1,000 µs
https://en.wikipedia.org/wiki/Interpacket_gap
Fast Path
 Slow Path

“SlowPath”
 Slow Path

“SlowPath”
 Slow Path

“SlowPath”
 Slow Path

●
Slow Path RouterOS is the normal behavior.
●
RouterOS checks individual packages along the way.
●
In some cases this process may be extended.
●
Slow Path consumes more resources than Fast Path.
 Slow Path

●
The Routera Package will enter through Ether1 and exit through Ether3.
●
Ether1 can be considered Internet, Ether3 user (customer).
●
When the user starts browsing the web page, what stages does the package go
through in the router?
 Slow Path

Ether1

Ether3
Slow Path
Slow Path
Fast Path & Fast Track

“SlowPath”
Fast Path & Fast Track

“SlowPath”
Fast Path & Fast Track

“SlowPath”
 Fast Path & Fast Track
Fast Path
●
Fast Path is a feature of the Linux kernel. RouterOS uses the Linux kernel.

●
It interferes directly to the Fast Path Router Interfaces and shortens the packet

flow and leads the package directly to the output.

●
Implemented MikroTik Fast Path with 6.29.

●
Fast Path requirements;
●
Interface driver support
●
Must be enabled on the Fast Path Router
●
No special configuration
 Fast Path
What are Fast Path Supporting Devices?
All products in MicroTik or Interfaceler may not support Fast Path. Products supporting
Fast Path;

●
CCR, CRS, RB7xx, RB9xx, hEX, hAP, wAP,cAP, mAP, SXT, Metal,
Groove, DynaDish, OmniTIK series - all ports
●
RB1100 series – ether1-11 (RB 1100x4 ALL port)
●
RB6xx series and RB800 - ether1,2
●
RB1000, RB3011, RB2011 - all ports
●
Tüm Wireless Interfaceleri (6.37)
 Fast Path
Fast Path Handlers

●
Ipv4
●
Bridge
●
Ipv4 Fast Track
 Fast Path
Ipv4 Fast Path
The IPv4 Fast Path runs automatically when the following conditions are met.
- Firewall rules ve address list yapılandırılmamış olmalı.
- Simple Queue, Queue Trees ve Parent=global kullanılmamalı.
- Mesh, metarouter, sniffer, torch ve Traffic Generator kullanılmamalı.
- Connection Tracking aktif olmamalı.
- ip accounting kapalı olmalı (/ip accounting enabled=no);
- VRFs are not set (/ip route vrf is empty);
- Hotspot is not used (/ip hotspot has no interfaces);
- IpSec policies are not configured (ROS v6.8);
- Tool Mac-Scan, ip-scan aktif olmamalı.
- Ip Route Cache açık olmalı.
 Fast Path

Ipv4 Fast Path

●
The Routera Package will enter through Ether1 and exit through Ether3.
●
Ether1 can be considered Internet, Ether3 user (customer).
●
When the user starts browsing the web page, what stages does the package go
through in the router?
 Fast Path

Ether1

Ether3
Fast Path
Fast Path
 Ipv4 Fast Path & Slow Path Versus

Lost Rate Minimum Average Maximum Traffic CPU

Slow Path %0.76 69.8us 212.us 19.9ms Tx 903Mbps %99

Rx 903Mbps

Fast Path %0.39 66.0us 170.us 10.4ms TX 911Mbps % 49

RX 911Mbps

Performance %95 %5 %25 %91 X %51

 Fast Path
RB2011 Capasity & Performance Test($129)

Products using the same Chipset as RB2011;

●
OmniTIK (L4)
●
Omnitik PoE(L5)
●
SXT SA5(L4)
●
SXT 2(L4)
●
SXT Lite5(L3)
●
DISC Lite5(L3)
●
LDF 5(L3)
●
CRS125-24G-1S-2HnD-IN (L5)
●
CRS109-8G-1S-2HnD-IN(L5)
●
RB2011 (L4)
●
RB2011UiAS-2HnD-IN(L5)
 Fast Path
RB2011 Capasity & Performance Test($129)

Trafik Statistics
 Fast Path
RB2011 Capasity & Performance Test($129)

Trafik statistics
 Ipv4 Fast Path & Slow Path Versus

MikroTik RB2011

Minimum Average Maximum Traffic CPU

Slow Path 91.4us 660.us 30ms 501Mbps %97

Fast Path 82.us 428.us 22.7ms 853Mbps %78

%14 %54 %32 %70 %24

 Fast Path
Virtual Interface Fast Path
Ethernet, Wireless, Bridge, PPPoE, VLAN, VRRP and Bonding Interface Fast Path
uses automatically if it is available to use Fast Path.

L2TP, EoIP, IPIP, GRE Tunnel Manual Starting Fast Path!

●
1- Use IPsec no
●
2- Allow Fast Path=yes.
●
3- No Packet Fragmentation
●
4- Selected profile should not be encryption.
 Fast Track
Fast Path + Connection Tracking = Fast Track
●
The MikroTik Fast Path and Conntrack's work together gave the name Fast Track.
●
Fast Track Fast Path extentions
●
Only Ipv4 TCP/UDP (Total Traffic %99)
●
FastTrack management is left to network admin
●
FastTrack can be used on devices with Fast Path support.
●
After the first packet of the connection passing through the router is marked as Fast
Track, the other packages of the connection are FastTrack. A single connection can
exceed 10,000 packets.
 Fast Track
Fast Track Performance effects; (What MikroTik
said?)
●
Firewall CPU Consumerdrops 20/1

●
Router Performance 5x improve
●
FastTrack, Full NAT(SRC ve DSTNAT) support!!!
Fast Track
 Fast Track
How to enable Fast Track?

/ip firewall filter add chain=forward connection-state=established,related action=fasttrack-connection

/ip firewall filter add chain=forward connection-state=established,related action=accept

●
Fast Track does not work depending on conditions
such as Fast path.
●
Fast Track automatically fulfills the requirements
when you enable Fast Track.
Fast Track (Allow Fast Path =No)
Fast Track (Allow Fast Path =Yes)
 Fast Track

FastTrack off FastTrack on

 Fast Track

Fast Track Versus;

Traffic Lost Rate Average Maximum CPU

Fast Track No 294Mbps %0.06 1.23ms 21.8 %100

Fast Track Yes 839Mbps %0.001 921.us 12.8ms % 72

Performans 3X 60X %33 %70 %28

 Fast Path & Fast Track
ALL Interface Fast Path active
Ipv4 Fast Track Active
Firewall Filter and Nat used!
ISP network Planning, Design And Installation

●
Capacity Planning

●
Productivity

●
Performance

●
Cost

●
Scalability

https://wiki.mikrotik.com/wiki/Manual:License
ISP network Planning, Design And Installation

https://wiki.mikrotik.com/wiki/Manual:License
ISP network Planning, Design And Installation
 ISP network Planning, Design And Installation
RB1100x4 Kapasite & Performans Testi
CPU core 4 https://mikrotik.com/product/RB1100Dx4
CPU 1.4 GHz (Overclock 2Ghz)
Routing FastPath 7.35Gbit
RAM 1 GB
License level 6
Ipsec Hardware acceleration 2.2Gbps AES128).
 ISP network Planning, Design And Installation
RB1100x4 Block Diagram

https://i.mt.lv/cdn/rb_files/RB1100AHx4v5-180110082518.png
ISP network Planning, Design And Installation
 ISP network Planning, Design And Installation

interface pppoe-server server add authentication=mschap2 interface=ether5

keepalive-timeout=disabled max-mtu=1500 max-mru=1500 disabled=no
default-profile=pppoetest max-sessions=5000

/ip neighbor discovery-settings set discover-interface-list=!dynamic

1
3

/interface pppoe-client add interface=ether2 disabled=no add-default-route=yes default-route-

distance=1 user=testuser password=testpass max-mtu=1500 max-mru=1500 allow=mschap2
name=PPPoEClient profile=default
 ISP network Planning, Design And Installation

/system package uninstall [find]

/ip firewall connection tracking set enabled=no
/system package unschedule system,ppp,security,routing

5
4

6
 ISP network Planning, Design And Installation

What have we changed for router performance?

●
1- PPPoE Server MTU, MRU and Keep-alive-timeout setting change.
●
2- PPPoE Client için MTU, MRU ve Keep-alive-timeout setting change.
●
3- IP Neighborsh ayarlarını !=Dynamic
●
4- PPPoE Server only requirement packet installing. Any Other packages
unistall.
●
5- PPPoE Server Connection Tracking Setting=No .
 ISP network Planning, Design And Installation
What happened after the router performance changes?
●
PPPoE Server FULL MTU Support (1500) Any to Any package No fragmentation!
Fragmentation packet no Fast path!!!!
●
Keep-Alive-Timeout disabled=yes (PPPoE Concentrator Router only Internet Traffıc)
●
PPPoE Client FULL MTU Support (1500) and Keep-alive-timeout Disabled=yes
Keep-alive-timeout on the client will improve performance on the server side!
●
PPPoE output MNDP packet drop, Only !=Dynamic packaget Yes.
●
We've removed all the packages we don't need to use resources efficiently on PPPoE
Concentrator
●
PPPoE Concentrator set ConnTrack=NO No Nat State and other (mangle,Firewal
Filter vb disabled=yes)
ISP network Planning, Design And Installation
ISP network Planning, Design And Installation
ISP network Planning, Design And Installation
ISP network Planning, Design And Installation
 ISP network Planning, Design And Installation
Carrier-Grade NAT (CGNAT) or NAT444

PPPoE Concentrator

PPPoE Concentrator

https://wiki.mikrotik.com/wiki/Manual:IP/Firewall/NAT#Carrier-Grade_NAT_.28CGNAT.29_or_NAT444
 ISP network Planning, Design And Installation
Carrier-Grade NAT (CGNAT) or NAT444

https://wiki.mikrotik.com/wiki/Manual:IP/Firewall/NAT#Carrier-Grade_NAT_.28CGNAT.29_or_NAT444
 ISP network Planning, Design And Installation
Carrier-Grade NAT (CGNAT) or NAT444

https://wiki.mikrotik.com/wiki/Manual:IP/Firewall/NAT#Carrier-Grade_NAT_.28CGNAT.29_or_NAT444
 ISP network Planning, Design And Installation
Carrier-Grade NAT (CGNAT) or NAT444

https://wiki.mikrotik.com/wiki/Manual:IP/Firewall/NAT#Carrier-Grade_NAT_.28CGNAT.29_or_NAT444
 ISP network Planning, Design And Installation
Carrier-Grade NAT (CGNAT) or NAT444

https://wiki.mikrotik.com/wiki/Manual:IP/Firewall/NAT#Carrier-Grade_NAT_.28CGNAT.29_or_NAT444
 Type and tricks

●
network MTUi MRU planning and package to prevent fragmentation
●
Overall Performance Using Fast Path and Fast Track Increased Average 4X
●
Large gain in delay times and packet losses
●
Internet Traffic Only on Routers
●
User peer Gigabit rate!
●
FULL MTU Support and Overcoming MTU-related problems
●
Change MSS is using on PPPoE Server! We may no longer need Change MSS.
 Fast Path
Guarantee Interface Fast Path

Warranty fast path for Interface Queue Queue Type =“Only-hardware-queue” .

 Question & answer
Resources;
FastPath Overview (MuM Europe, 2016)
https://mum.mikrotik.com/presentations/EU16/presentation_2901_1456413105.pdf
FastPath Overview (MuM Ukranie, 2015)
https://mum.mikrotik.com/presentations/UA15/presentation_3077_1449654925.pdf
Linux Forwarding Stack Fastpath
https://netdevconf.org/1.2/slides/oct7/03_Linux_Forwarding_Stack_Fastpath.pdf
Open FastPath
https://openfastpath.org/wp-content/uploads/2018/01/OpenFastPath_Overview.pdf
MikroTİk Wiki Fast Path
https://wiki.mikrotik.com/wiki/Manual:Fast_Path
MikroTİk wiki Fast Track
https://wiki.mikrotik.com/wiki/Manual:IP/Fasttrack
MikroTik Newsletter #65
https://download2.mikrotik.com/news/news_65.pdf
Most underused MikroTik hardwareand software featuresOR“The path between fastpath andadvanced features”
https://mum.mikrotik.com/presentations/MX18/presentation_5286_1524556369.pdf
Janis-Megis New Product !
http://www.mikrotik.co.id/download/MOS-ID-2015/Introduction_Janis-Megis.pdf
Wiki MikroTik Scripting
https://wiki.mikrotik.com/wiki/Manual:Scripting
Interframe spacing
https://en.wikipedia.org/wiki/Interpacket_gap
https://www.embedded.com/design/operating-systems/4403058/Accelerating-network-packet-processing-in-Linux
https://www.embedded.com/design/programming-languages-and-tools/4425631/Using-fastpath-software-to-boost-performance-of-Linux-based-home-network-routers
http://netsecinfo.blogspot.com/2010/03/linux-based-fast-path-why-is-this.html
https://slideplayer.com/slide/9469203/
support@mikrotik.com