[xcat-user] Does 'nodeset' change boot device and server IP ?
John Griffin-Wiesner
johngw at msi.umn.edu
Thu Feb 19 08:00:20 MST 2009
The client will always be set to dhcp boot first. Once it's
installed, the xCAT server (via tftp) will tell it to boot from
harddrive on successive reboots. So you do that rbootseq once
and never have to change it.
Your dynamicrange in the networks table below starts with the
server ipaddress: 9.3.110.179-9.3.110.183. So the dhcp server is
being told to serve it's own address to clients.
That dynamic range is best not even being a range that includes the
addresses that you want to permanently be the client's addresses.
The addresses in that range are used just to get the client node up
and booting/installing. Then xCAT gives it it's real address later.
I'm not entirely clear on the magic of how that happens. I think
what you put in the xcat server's /etc/hosts file, and then when
you "makedns", those are the parts that xcat uses to get what
it needs.
For example in our setup, our compute nodes use addresses in the
ranges 172.[20,21].10?.* for their eth0 and eth1 adresses. But my
dynamicrange value in the networks table for those networks are
"172.20.201.1-172.20.203.253" for the eth0 vlan, and
"172.21.201.1-172.21.203.253" for the eth1 vlan. Nothing ever
uses a 172.2?.20?.* address except for a few minutes during
installation.
>From my networks table:
#netname,net,mask,mgtifname,gateway,dhcpserver,tftpserver,nameservers,dynamicrange,nodehostname,comments,disable
"compute","172.20.0.0","255.255.0.0","vlan20",,,"172.20.0.2","172.20.0.2","172.20.201.1-172.20.203.253",,,
"storage","172.21.0.0","255.255.0.0","vlan21",,,"172.21.0.2","172.21.0.2","172.21.201.1-172.21.203.253",,,
[From my xCAT server]# grep blade100 /etc/hosts
172.21.102.44 blade100-eth1
172.20.102.44 blade100
On Thu, Feb 19, 2009 at 11:36:45AM -0300, Rafael Folco wrote:
>
> Thanks for all responses, I'm almost there.
>
> The only way I could make it boot from network was to manually change
> boot device order using: rbootseq cluster-3 net,hd. I think this is
> permanent, that is, after the installation completes, I'll have to
> change it back to boot from hd.
>
> Besides that, the major problem now is that cluster-3 is getting wrong
> client ip, the same as management node (cluster-1) -- 9.3.110.179. All
> services are up and running, including dhcpd, named, tftpd, nfsserver
> and apache2.
>
> >From my understanding dynamicrange is responsible for giving client ips,
> through dhcpd.
>
> # tabdump networks
> #netname,net,mask,mgtifname,gateway,dhcpserver,tftpserver,nameservers,dynamicrange,nodehostname,comments,disable
> "eth","9.3.110.0","255.255.255.0","eth0","9.3.110.1","9.3.110.179","9.3.110.179","9.3.110.179","9.3.110.179-9.3.110.183",,,
>
>
> TFTP BOOT ---------------------------------------------------
> Server IP.....................9.3.110.179
>
> Client IP.....................9.3.110.179
>
> Gateway IP....................9.3.110.1
>
> Subnet Mask...................255.255.255.0
> ( 1 ) Filename................./yaboot
> TFTP Retries..................5
> Block Size....................512
>
>
> # lsdef cluster-3
>
> Object name: cluster-3
> arch=ppc64
> cons=blade
> conserver=9.3.110.179
> currchain=boot
> currstate=install sles10.2-ppc64-compute
> groups=all,compute,blade
> hostnames=cluster-3.ltc.austin.ibm.com
> id=3
> installnic=eth0
> ip=9.3.110.181
> kcmdline=autoyast=http://9.3.110.179/install/autoinst/cluster-3
> install=http://9.3.110.179/install/sles10.2/ppc64/1 netdevice=eth0
> kernel=xcat/sles10.2/ppc64/inst64
> mac=00:1A:64:44:AC:46
> mgt=blade
> mpa=js22-cluster
> netboot=yaboot
> nfsserver=9.3.110.179
> nodetype=osi
> os=sles10.2
> primarynic=eth0
> profile=compute
> serialflow=hard
> serialport=1
> serialspeed=19200
> status=installing
> tftpserver=9.3.110.179
> xcatmaster=9.3.110.179
>
>
> So, basically my quations are:
>
> 1) Is 'rbootseq' really necessary before rinstall ? (or it should be
> automatic) ?
>
> 2) I have setup /etc/hosts, hosts table, and dhcp. Why is it getting
> wrong client ip ?
>
> Thanks,
>
> Rafael
>
>
>
>
>
> On Thu, 2009-02-19 at 08:40 -0500, Lissa Valletta wrote:
> > Try adding this line to the nodehm table
> >
> > "compute",,"blade","blade",,,"9.3.110.179","1","19200","hard",,,
> >
> > Lissa K. Valletta
> > 414/3-8
> > Poughkeepsie, NY 12601
> > (tie 293) 433-3102
> >
> >
> > Inactive hide details for Rafael Folco
> > <rfolco at linux.vnet.ibm.com>Rafael Folco <rfolco at linux.vnet.ibm.com>
> >
> >
> > Rafael Folco <rfolco at linux.vnet.ibm.com>
> > Sent by: xcat-user-bounces at lists.xcat.org
> >
> > 02/18/2009 03:40 PM
> > Please respond to
> > xCAT Users Mailing list <xcat-user at lists.xcat.org>
> >
> >
> > To
> >
> > xCAT Users
> > Mailing list
> > <xcat-user at lists.xcat.org>
> >
> > cc
> >
> >
> >
> > Subject
> >
> > Re: [xcat-user]
> > Does 'nodeset'
> > change boot
> > device and server
> > IP ?
> >
> >
> >
> >
> > # lsdef cluster-3
> >
> > Object name: cluster-3
> > arch=ppc64
> > cons=blade
> > currchain=boot
> > currstate=install sles10.2-ppc64-compute
> > groups=all,compute,blade
> > id=3
> > installnic=eth0
> > kcmdline=autoyast=http://9.3.110.179/install/autoinst/cluster-3
> > install=http://9.3.110.179/install/sles10.2/ppc64/1 netdevice=eth0
> > kernel=xcat/sles10.2/ppc64/inst64
> > mac=00:1A:64:44:AC:46
> > mgt=blade
> > mpa=js22-cluster
> > netboot=yaboot
> > nfsserver=9.3.110.179
> > nodetype=blade
> > os=sles10.2
> > primarynic=eth0
> > profile=compute
> > servicenode=9.3.110.179
> > status=installing
> > tftpserver=9.3.110.179
> > xcatmaster=9.3.110.179
> >
> >
> >
> >
> >
> > On Wed, 2009-02-18 at 15:17 -0500, Lissa Valletta wrote:
> > > Should be automatic. Can you run lsdef mynode and give us the output
> > >
> > > Lissa K. Valletta
> > > 414/3-8
> > > Poughkeepsie, NY 12601
> > > (tie 293) 433-3102
> > >
> > >
> > > Inactive hide details for Rafael Folco
> > > <rfolco at linux.vnet.ibm.com>Rafael Folco <rfolco at linux.vnet.ibm.com>
> > >
> > >
> > > Rafael Folco
> > <rfolco at linux.vnet.ibm.com>
> > > Sent by:
> > xcat-user-bounces at lists.xcat.org
> > >
> > > 02/18/2009 01:57 PM
> > > Please respond to
> > > xCAT Users Mailing list
> > <xcat-user at lists.xcat.org>
> > >
> > >
> > > To
> > >
> > > xCAT Users
> > > Mailing list
> > > <xcat-user at lists.xcat.org>
> > >
> > > cc
> > >
> > >
> > >
> > > Subject
> > >
> > > [xcat-user] Does
> > > 'nodeset' change
> > > boot device and
> > > server IP ?
> > >
> > >
> > >
> > > Hi,
> > >
> > > Do I need to manually change primary boot device and server IP on
> > SMS
> > > after running nodeset install command ?
> > >
> > > nodeset mynode install
> > > rpower mynode boot
> > >
> > > If I don't do anything else, 'mynode' boots from hd instead of
> > network
> > > (bootp), unless I go to SMS and manually change boot device and
> > server
> > > IP.
> > >
> > > Shouldn't it be automatic ?
> > >
> > > Please, any help is appreciated.
> > >
> > > Thanks in advance,
> > >
> > > Rafael
> > >
> > > --
> > > Rafael Folco
> > > Brazil Test Lead
> > > IBM Linux Technology Center
> > > E-Mail: rfolco at linux.vnet.ibm.com
> > >
> > > _______________________________________________
> > > xcat-user mailing list
> > > xcat-user at lists.xcat.org
> > > http://www.xcat.org/mailman/listinfo/xcat-user
> > >
> > >
> > >
> > > _______________________________________________
> > > xcat-user mailing list
> > > xcat-user at lists.xcat.org
> > > http://www.xcat.org/mailman/listinfo/xcat-user
> >
> > --
> > Rafael Folco
> > Brazil Test Lead
> > IBM Linux Technology Center
> > E-Mail: rfolco at linux.vnet.ibm.com
> >
> > _______________________________________________
> > xcat-user mailing list
> > xcat-user at lists.xcat.org
> > http://www.xcat.org/mailman/listinfo/xcat-user
> >
> >
> >
> > _______________________________________________
> > xcat-user mailing list
> > xcat-user at lists.xcat.org
> > http://www.xcat.org/mailman/listinfo/xcat-user
>
> --
> Rafael Folco
> Brazil Test Lead
> IBM Linux Technology Center
> E-Mail: rfolco at linux.vnet.ibm.com
>
> _______________________________________________
> xcat-user mailing list
> xcat-user at lists.xcat.org
> http://www.xcat.org/mailman/listinfo/xcat-user
--
John Griffin-Wiesner
Linux Cluster/Unix Systems Administrator
Univ. MN Supercomputing Institute
http://www.msi.umn.edu
johngw at msi.umn.edu
More information about the xcat-user
mailing list