Having two gateways on the same host, where some processes send outgoing traffic over one gateway while the rest use the other gateway, requires a virtual network interface to be set up, and have a separate routing table so that all traffic to/from this virtual interface uses the secondary
routing table where the other gateway is in the default route.
First, I'll describe the steps one by one and later I'll explain how to make this setup persistent so that the system boots correctly the next time. Let's assume we have two gateways:
gw1 : 172.26.2.100
gw2 : 172.26.3.100
Create a virtual interface which will be used by processes that need to send traffic to gateway gw2:
$ ifconfig eth0:1 172.26.3.209
Create a definition and give a name to the new routing table (index 1, name 'test'):
$ echo "1 test" >> /etc/iproute2/rt_tables
Show the main routing table:
$ ip route show table main
172.26.0.0/16 dev eth0 proto kernel scope link src 172.26.3.206
169.254.0.0/16 dev eth0 scope link metric 1002
default via 172.26.2.100 dev eth0
Clear the secondary routing table:
$ ip route flush table test
Copy all rules from main table to secondary table, but the default gateway
$ ip route show table main | egrep -Ev "^default" | while read route; do
ip route add table test $route
done
Add the gateway for the secondary routing table:
$ ip route add table test default via 172.26.3.100
List the secondary routing table:
$ ip route show table test
172.26.0.0/16 dev eth0 proto kernel scope link src 172.26.3.206
169.254.0.0/16 dev eth0 scope link metric 1002
default via 172.26.3.100 dev eth0
Add a rule so that for any packet to/from the virtual interface, the secondary routing table is applied:
$ ip rule add from 172.267.3.209 lookup test
$ ip rule add to 172.267.3.209 lookup test
At this point, traffic originated from interface eth0:1 will use gateway gw2 (172.26.3.100) and traffic from interface eth0 enroutes via the default gateway gw1 (172.26.2.100). Try and compare:
$ traceroute -s 172.26.3.206 www.google.com
$ traceroute -s 172.26.3.209 www.google.com
In order to make the changes above persistent, edit/create the following files:
1. Add a description for the 'test' routing table (already done):
$ echo "1 test" >> /etc/iproute2/rt_tables
2. Create file '/etc/sysconfig/network-scripts/ifcfg-eth0:1' containing the
configuration of the virtual interface:
DEVICE=eth0:1
ONBOOT=yes
SEARCH="mydomain.biz"
DOMAIN="mydomain.biz"
DNS1=172.26.2.200
DNS2=172.26.2.201
BOOTPROTO=none
NETMASK=255.255.0.0
IPADDR=172.26.3.209
TYPE=Ethernet
USERCTL=no
PEERDNS=yes
IPV6INIT=no
NM_CONTROLLED=no
3. Create file '/etc/sysconfig/network-scripts/route-eth0:1' containing the 'test' routing table:
table test 172.26.0.0/16 dev eth0 proto kernel scope link src 172.26.3.206
table test 169.254.0.0/16 dev eth0 scope link metric 1002
table test default via 172.26.3.100
4. Create file '/etc/sysconfig/network-scripts/rule-eth0:1' containing the rules for the virtual interface:
from 172.26.3.209 lookup test
to 172.26.3.209 lookup test
The above explanations have been tested on a Fedora 10 distribution.
Subscribe to:
Post Comments (Atom)
3 comments:
Thanks you for this very useful post,
You saved my day. I was writing a daemon that changes the default gateway by testing the FUNCTIONALITY of multiple gateways ... and with your setup I can now benchmark multiple gateways and prefer the best (fastest)!
Here is my script:
###############################
#!/bin/bash
GW1="192.168.10.100"
GW2="192.168.10.200"
OUR_GWS="$GW1 $GW2"
IFACE1_DEV="eth0"
COUNTER=0
FAILCOUNT_LIMIT=2
# wee need ad traceroute or routine for GW priorising!
# ping -I 192.168.100.221 google.com
# ping -I 192.168.100.222 google.com
#
while true ; do
# Get gateway
DEFAULT_GW=$(ip r |grep "^default via"|awk '{print $3}')
#
# If no default gateway is set, then
# delete all foreign routes and
# set GW1 as default.
if [ -z $DEFAULT_GW ] ; then
for i in $(ip r|egrep -v ''"$GW1"'|'"$GW2"''|grep "dev[[:space:]]*eth0[[:space:]]*scope[[:space:]]*link[[:space:]]*$"|awk '{print $1}'); do
ip r d $i dev eth0 scope link
done
ip r a default via $GW1
fi
#
# Check if we use OUR_GWS, and if not then,
# delete all foreign routes,
# add our routes to routing table and
# set GW1 as default if possible, else set GW2 as default
if ! echo "$OUR_GWS"|grep -q "$DEFAULT_GW" ; then
for i in $(ip r|egrep -v ''"$GW1"'|'"$GW2"''|grep "dev[[:space:]]*eth0[[:space:]]*scope[[:space:]]*link[[:space:]]*$"|awk '{print $1}'); do
ip r d $i dev eth0 scope link
done
ip r d $(ip r|grep "^default via")
ip r a $GW1 dev eth0
ip r a $GW2 dev eth0
ip r chg default via $GW1 || ip r chg default via $GW2
fi
#
# Check if we succeeded setting the GW
DEFAULT_GW=$(ip r |grep "^default via"|awk '{print $3}')
if ! echo "$OUR_GWS"|grep -q $DEFAULT_GW ; then
echo "ERROR: Could not set any GW!"
fi
#
# Check if our GW is routing properly.
if ping -W 2 -w 1 -c 1 google.com > /dev/null 2>&1 ; then
COUNTER=0
sleep 30
else
sleep 1
let COUNTER++
fi
#
# If routing fails, then switch GW.
if [ $COUNTER -ge $FAILCOUNT_LIMIT ] ; then
FAILED_GW=$(ip r|grep "^default via"|awk '{print $3}')
if [ "$FAILED_GW" == "$GW1" ] ; then
HEALTHY_GW=$GW2
else
HEALTHY_GW=$GW1
fi
ip r a $HEALTHY_GW dev eth0
ip r chg default via $HEALTHY_GW
fi
#
sleep 1
done
###############################
I am glad the post was useful, Saman.
Thanks to you as well for contributing with the script.
Thanks for posting. just looking RSS Feeds.
Post a Comment