Re: [Xen-users] Networking with more NIC's

[jez <jez@xxxxxxxxxx>]

On Sat, Mar 17, 2007 at 12:32:03AM +0100, Peter Fastré wrote:
> On 3/16/07, jez <jez@xxxxxxxxxx> wrote:
> >On Fri, Mar 16, 2007 at 07:33:31PM +0100, Peter Fastré wrote:
> >>
> >
> >What is the output of ifconfig and "route -n" before you start xend?
> 
> before start:
> Destination     Gateway         Genmask         Flags Metric Ref    Use
> Iface
> 10.200.1.0      0.0.0.0         255.255.255.0   U     0      0        0 eth0
> 127.0.0.0       0.0.0.0         255.0.0.0       U     0      0        0 lo
> 0.0.0.0         10.200.1.1      0.0.0.0         UG    1      0        0 eth0
> 
> after start:
> Destination     Gateway         Genmask         Flags Metric Ref    Use
> Iface
> 10.200.1.0      0.0.0.0         255.255.255.0   U     0      0        0 eth0
> 127.0.0.0       0.0.0.0         255.0.0.0       U     0      0        0 lo
> 

Re-read Peter. I also asked for the output of *ifconfig* before. Better
yet, please post the output of "ip addr list" before starting xend.

>
> > What is it that you actually want xen to do with these three cards?
> 
> The server has  3 intel cards. For the moment, I just want to use two of
> them, one for the public addresses (195.x.x.x) which is different for each
> vm, and one for a private network which would be used to mirror some things
> between servers.
> 

Are you saying you want each DomU to have two interfaces eth0 and eth1.
One of those interfaces, eth0, should be connected to a bridge that 
contains Dom0's public nic. The other one, eth1, should be connected to a 
bridge that contains Dom0s private nic?

Or is it that only Dom0 needs to have access to two networks but the DomUs
only need to have access to the public network - and so only need one
interface each?

Also, which nic is which - what do you want to do with eth0? eth1? eth2?


> >Okay, this is not the cause of your problem, but I suggest that you
> >don't use dhcp, ip, netmask, and gateway settings in your configuration
> >file. AFAIK this puts all your networking configuration on the kernel
> >command line. It doesn't belong there - you should configure your DomUs
> >through their normal networking configuration files.
> 
> 
> Removed all the ip settings (dhcp/ip/netmask/gateway). Error I get now is:
> 
> root@vm01:~# xm create vm_base.cfg
> Using config file "/etc/xen/vm_base.cfg".
> Error: Device 0 (vif) could not be connected. Hotplug scripts not working.
> 

Yeah, I said this wasn't going to solve your problem. I was just throwing
in some extra advice for free.

> Hotplug -> do they mean udev? Udev is not changed compared to the normal
> installation, I think it's working normally as it should. I did disable it
> for the test domU's on my test machines (after I succesffully booted them).
> But on this server I can't boot any domain.
> 

The scripts in /etc/xen/scripts are called via the udev system. When xen
is installed it puts a set of rules in /etc/udev/ in a file called
xen-backend.rules and then adds a symlink to that file in
/etc/udev/rules.d. At least that is how it's done in the Debian
installation. I don't know how you copied accross your xen system from
your test server, but you should probably check that there are some xen
rules somewhere under /etc/udev.

However, I really doubt this is your problem. TBH I really can't see how
the xen scripts could be expected to do the right thing with your 
present configuration as it stands. If you can answer my question above 
about what exactly you want to do with eth0, eth1, and eth2, then we 
can try and get you a configuration that works.


> >>
> >> xenbr0    Link encap:Ethernet  HWaddr 00:00:00:00:00:00
> >>          UP BROADCAST RUNNING NOARP  MTU:1500  Metric:1
> >>          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
> >>          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
> >>          collisions:0 txqueuelen:0
> >>          RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)
> >>
> >> xenbr1    Link encap:Ethernet  HWaddr FE:FF:FF:FF:FF:FF
> >>          UP BROADCAST RUNNING NOARP  MTU:1500  Metric:1
> >>          RX packets:1184 errors:0 dropped:0 overruns:0 frame:0
> >>          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
> >>          collisions:0 txqueuelen:0
> >>          RX bytes:67438 (65.8 KiB)  TX bytes:0 (0.0 b)
> >>
<snip/> 
> root@vm01:~# brctl show
> bridge name     bridge id               STP enabled     interfaces
> xenbr1          8000.feffffffffff       no              vif0.1
>                                                         peth0


Your ifconfig says you've got two bridges xenbr0 and xenbr1 but the
output of 'brctl show' says you only have one bridge. Can you double
check this, thanks.


_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users