[xcat-user] few dx360M2 questions
Gilad Berman
GILADB at il.ibm.com
Thu Aug 20 09:21:49 MDT 2009
I have one machine with dedicated management port and one in shared mode,
they both work the same, except that i get better console (which i had to
configure manually) performance on the dedicated machine. i have no output
of the loop, but i'm starting to suspect network issues since i get
problems getting DHCP response (installation even hangs due to that) and
although rpower do not work xCAT sometimes can power on/off the nodes (when
i use rinstall).
i'm using BC switch so there's might be a loop, one more indication of that
is that i loose the console during the DHCP requests by the nodes.
i will try bypass the network issues, although i have no idea why rpower do
not work,
thanks for you advise.
Regards,
Gilad Berman
System x Technical Specialist
IBM System & Technology Group. Israel
E-mail: giladb at il.ibm.com
Tel: 972-3-9188262
Mobile: 972-52-2554262
From: Jarrod B Johnson <jbjohnso at us.ibm.com>
To: xCAT Users Mailing list <xcat-user at lists.xcat.org>
Cc: xCAT Users Mailing list <xcat-user at lists.xcat.org>, xcat-user-bounces at lists.xcat.org
Date: 08/20/2009 05:22 PM
Subject: Re: [xcat-user] few dx360M2 questions>
Sent by: xcat-user-bounces at lists.xcat.org
I'm unclear, is the cable plugged into the dedicated bmc port or are you
wanted to share the connection? Do you have the output of the loop?
(Embedded image moved to file: pic20080.gif)Inactive hide details for Gilad
Berman ---08/20/2009 05:13:07---first, thanks for your help!Gilad Berman
---08/20/2009 05:13:07---first, thanks for your help!
(Embedded image (Embedded image moved to file: pic03328.gif)
moved to file: Gilad Berman <GILADB at il.ibm.com>
pic08366.gif)
From:
(Embedded image (Embedded image moved to file: pic03728.gif)
moved to file: xCAT Users Mailing list <xcat-user at lists.xcat.org>
pic29221.gif)
To:
(Embedded image (Embedded image moved to file: pic16114.gif)
moved to file: 08/20/2009 05:13
pic25964.gif)
Date:
(Embedded image (Embedded image moved to file: pic27094.gif)
moved to file: Re: [xcat-user] few dx360M2 questions
pic06190.gif)
Subject:
first, thanks for your help!
second, i followed the instructions (otherwise the nodes would not have
been discovered correctly), the problem is that bmcsetup is a never ending
loop on the node (until nodeset idp01 standby) and does only part of the
work - the right ip assigned to the imm, however, none of the SOL settings
is set and i also i can't rpower the nodes.
should i add the idp01-imm as a node as well? should i add it to the switch
table? i don't see the logic of doing so, but just to make sure.
Lissa, the ':' after the entries was probably a cat and paste format
issues, this is how my tables look -
[root at lab-xcat2 ~]# lsdef idp01
Object name: idp01
arch=x86_64
bmc=idp01-imm
bmcpassword=PASSW0RD
bmcport=1
bmcusername=USERID
currstate=runcmd=bmcsetup
groups=all,idp
initrd=xcat/nbfs.x86_64.gz
installnic=eth0
kcmdline=quiet console=ttyS0,115200n8r xcatd=lab-xcat2:3001
kernel=xcat/nbk.x86_64
mac=00:1A:64:F1:28:96!idp01|,
mgt=ipmi
mtm=7321AC1
netboot=pxe
nfsserver=192.168.1.1!
ondiscover=runcmd=bmcsetup
serial= 0629437
serialflow=hard
serialport=0
serialspeed=115200
status=configuring
xcatmaster=lab-xcat2
[root at lab-xcat2 ~]# tabdump nodehm
#node,power,mgt,cons,termserver,termport,conserver,serialport,serialspeed,serialflow,getmac,comments,disable
"amm",,"blade",,,,,,,,,,
"compute",,"blade","blade",,,,,"19200",,,,
"blades",,"blade","blade",,,"lab-xcat2",,,,,,
"blade1",,"blade","blade",,,"192.168.1.1","1","19200","hard",,,
"blade3",,"blade","blade",,,,"|^.*$||","|^.*$||","|^.*$||",,,,,
"blade2",,"blade","blade",,,,"1","19200","hard",,,
"blade4",,"blade","blade",,,,"1","19200","hard",,,
"idp",,"ipmi",,,,,"0","115200","hard",,,,
#node,servicenode,netboot,tftpserver,nfsserver,monserver,nfsdir,installnic,primarynic,cmdinterface,xcatmaster,current_osimage,next_osimage,nimserver,comments,disable
"blades",,"pxe",,"192.168.1.1",,,"eth0","eth0",,"lab-xcat2",,,,,
"idp",,"pxe",,"192.168.1.1",,,"eth0",,,"lab-xcat2",,,,,
"idp02",,"pxe",,"192.168.1.1",,,"eth0","eth0",,"lab-xcat2",,,,,,
[root at lab-xcat2 ~]# tabdump mac,
#node,interface,mac,comments,disable
"blade1",,"00:14:5E:EC:DD:BE",,
"blade3",,"00:14:5E:D8:57:06",,
"blade2",,"00:1A:64:CF:1A:18",,
"blade4",,"00:1A:64:8A:41:0C",,
"idp01",,"00:1A:64:F1:28:96!idp01|",,
"idp02",,"00:1A:64:F1:20:C8!idp02|",,
[root at lab-xcat2 ~]# tabdump switch
#node,switch,port,vlan,interface,comments,disable
"idp01","bc-switch1","EXT4",,,,
"idp02","bc-switch1","EXT6",,,,
[root at lab-xcat2 ~]# rpower idp01,
Unsupported command: rpower
ping to idp-imm works.
thanks!
Regards,
Gilad Berman
System x Technical Specialist
IBM System & Technology Group. Israel
E-mail: giladb at il.ibm.com
Tel: 972-3-9188262
Mobile: 972-52-2554262
From: Lissa Valletta <lissav at us.ibm.com>
To: xCAT Users Mailing list <xcat-user at lists.xcat.org>
Date: 08/19/2009 11:06 PM
Subject: Re: [xcat-user] few dx360M2 questions
Sent by: xcat-user-bounces at lists.xcat.org
I don't like the colons ":" after the following entries in the output of
your lsdef command below , that may be your problem. mac address seem
strange also, Can you tabdump nodehm, noderes, mac tables
mgt=ipmi:
mtm=7321AC1:
netboot=pxe:
Lissa K. Valletta
414/3-8
Poughkeepsie, NY 12601
(tie 293) 433-3102
From: Thomas Alandt/Raleigh/IBM at IBMUS
To: xCAT Users Mailing list <xcat-user at lists.xcat.org>
Date: 08/19/2009 02:51 PM
Subject: Re: [xcat-user] few dx360M2 questions
Sent by: xcat-user-bounces at lists.xcat.org
xCAT2 doesn't require getmacs. If set up properly, the first sequence will
perform auto discovery (consider it an Auto-getmacs!!!). I didn't see your
"tabdump mac" out put. but if your discovery worked you should see the node
and its mac in that file.
your lsdef indicates discovery worked fine:
mac=00:1A:64:F1:28:96!idp01|. /var/log/messages should show indication that
idp01 was discovered.
After discovery, the node should pxe to the next stage "runcmd=bmcsetup".
During this step, if you are watching the node with a console you should
see indications that the bmc/imm is getting set up. You would see
indication of ipmi commands and such. For dx360-m2 the blue beacon LED will
be lit until you reboot to standby or your o/s installation.
If you want to run bmc setup manually after the node is discovered, then
from your mgt node type: "nodeset <node> runcmd=bmcsetup".
If your bmc is set up correctly you should be able to ping it and run
commands such as rpower (rpower <node> off/on/stat....etc).
Looking at your def's you should be able to use wcons once your bmc is set
up to monitor your node.
Also if nodeset <node> stat shows standby condition, you should be able to
ssh to the node. That would be a good indication of these 1st two steps
being successful.
(Embedded image moved to file: pic15584.gif)Inactive hide details for Gilad
Berman ---08/19/2009 01:36:38 PM---Hello list, I just configured my two iDP
demo nodes to work Gilad Berman ---08/19/2009 01:36:38 PM---Hello list, I
just configured my two iDP demo nodes to work with xCAT, i followed the
(Embedded (Embedded image moved to file: pic26796.gif)
image moved Gilad Berman <GILADB at il.ibm.com>
to file:
pic10360.gi
f)
From:
(Embedded (Embedded image moved to file: pic00151.gif)
image moved xCAT Users Mailing list <xcat-user at lists.xcat.org>
to file:
pic16204.gi
f)
To:
(Embedded (Embedded image moved to file: pic15115.gif)
image moved 08/19/2009 01:36 PM
to file:
pic05318.gi
f)
Date:
(Embedded (Embedded image moved to file: pic01045.gif)
image moved [xcat-user] few dx360M2 questions
to file:
pic30164.gi
f)
Subject:
(Embedded (Embedded image moved to file: pic27832.gif)
image moved xcat-user-bounces at lists.xcat.org
to file:
pic05325.gi
f)
Sent by:
Hello list,
I just configured my two iDP demo nodes to work with xCAT, i followed the
instructions (probably not all of them..), however i'm running into some
issues-
- although the node get discovered and assigned the right IP address,
getmacs does not work. the mac filed looks kind of strange to me.
- runbmcsetup on the node result in never-ending loop. does runbmcsetup
should work on dx360M2 or should i use the ASU in runimage to automate
this?
I should mention i'm using BNT BC switch (no other available).
[root at lab-xcat2 ~]# getmacs idp01
idp01: Error: unsupported command getmacs
[root at lab-xcat2 ~]# lsdef idp01
Object name: idp01
arch=x86_64
bmc=idp01-imm
bmcpassword=PASSW0RD
bmcport=1
bmcusername=USERID
currstate=standby
groups=all,idp
initrd=xcat/nbfs.x86_64.gz
installnic=eth0
kcmdline=quiet console=ttyS0,11520n8r xcatd=lab-xcat2:3001
kernel=xcat/nbk.x86_64
mac=00:1A:64:F1:28:96!idp01|
mgt=ipmi:
mtm=7321AC1:
netboot=pxe:
nfsserver=192.168.1.1
primarynic=eth0
serial= 0629437
serialflow=hard
serialport=0
serialspeed=11520.
status=configuring
xcatmaster=lab-xcat2
[root at lab-xcat2 ~]# tabdump ipmi
#node,bmc,bmcport,username,password,comments,disable
"idp","/\z/-imm/","1","USERID","PASSW0RD",,
[root at lab-xcat2 ~]# tabdump switch
#node,switch,port,vlan,interface,comments,disable
"idp01","bc-switch1","EXT4",,,,
[root at lab-xcat2 ~]# more /etc/hosts
# Do not remove the following line, or various programs
# that require network functionality will fail.
127.0.0.1 localhost.localdomain localhost
::1 localhost6.localdomain6 localhost6
192.168.1.1 lab-xcat2.cluster lab-xcat2
192.168.1.125 amm
192.168.1.127 bc-switch1
192.168.1.128 bc-switch2
192.168.1.11 blade1
192.168.1.12 blade2
192.168.1.13 blade3
192.168.1.14 blade4
192.168.1.15 blade5
192.168.1.30 idp01
192.168.1.40 idp01-imm
192.168.1.31 idp02
192.168.1.41 idp02-imm
What am i doing wrong?
thanks in advance!
Regards,
Gilad Berman
System x Technical Specialist
IBM System & Technology Group. Israel
E-mail: giladb at il.ibm.com
Tel: 972-3-9188262
Mobile: 972-52-2554262
_______________________________________________
xcat-user mailing list
xcat-user at lists.xcat.org
http://www.xcat.org/mailman/listinfo/xcat-user
_______________________________________________
xcat-user mailing list
xcat-user at lists.xcat.org
http://www.xcat.org/mailman/listinfo/xcat-user
_______________________________________________
xcat-user mailing list
xcat-user at lists.xcat.org
http://www.xcat.org/mailman/listinfo/xcat-user
[attachment "pic15584.gif" deleted by Jarrod B Johnson/Raleigh/IBM]
[attachment "pic10360.gif" deleted by Jarrod B Johnson/Raleigh/IBM]
[attachment "pic26796.gif" deleted by Jarrod B Johnson/Raleigh/IBM]
[attachment "pic16204.gif" deleted by Jarrod B Johnson/Raleigh/IBM]
[attachment "pic00151.gif" deleted by Jarrod B Johnson/Raleigh/IBM]
[attachment "pic05318.gif" deleted by Jarrod B Johnson/Raleigh/IBM]
[attachment "pic15115.gif" deleted by Jarrod B Johnson/Raleigh/IBM]
[attachment "pic30164.gif" deleted by Jarrod B Johnson/Raleigh/IBM]
[attachment "pic01045.gif" deleted by Jarrod B Johnson/Raleigh/IBM]
[attachment "pic05325.gif" deleted by Jarrod B Johnson/Raleigh/IBM]
[attachment "pic27832.gif" deleted by Jarrod B Johnson/Raleigh/IBM]
_______________________________________________
xcat-user mailing list
xcat-user at lists.xcat.org
http://www.xcat.org/mailman/listinfo/xcat-user
_______________________________________________
xcat-user mailing list
xcat-user at lists.xcat.org
http://www.xcat.org/mailman/listinfo/xcat-user
-------------- next part --------------
A non-text attachment was scrubbed...
Name: pic20080.gif
Type: image/gif
Size: 105 bytes
Desc: not available
Url : http://www.xcat.org/pipermail/xcat-user/attachments/20090820/4c99d65b/pic20080.gif
-------------- next part --------------
A non-text attachment was scrubbed...
Name: pic08366.gif
Type: image/gif
Size: 45 bytes
Desc: not available
Url : http://www.xcat.org/pipermail/xcat-user/attachments/20090820/4c99d65b/pic08366.gif
-------------- next part --------------
A non-text attachment was scrubbed...
Name: pic03328.gif
Type: image/gif
Size: 45 bytes
Desc: not available
Url : http://www.xcat.org/pipermail/xcat-user/attachments/20090820/4c99d65b/pic03328.gif
-------------- next part --------------
A non-text attachment was scrubbed...
Name: pic29221.gif
Type: image/gif
Size: 45 bytes
Desc: not available
Url : http://www.xcat.org/pipermail/xcat-user/attachments/20090820/4c99d65b/pic29221.gif
-------------- next part --------------
A non-text attachment was scrubbed...
Name: pic03728.gif
Type: image/gif
Size: 45 bytes
Desc: not available
Url : http://www.xcat.org/pipermail/xcat-user/attachments/20090820/4c99d65b/pic03728.gif
-------------- next part --------------
A non-text attachment was scrubbed...
Name: pic25964.gif
Type: image/gif
Size: 45 bytes
Desc: not available
Url : http://www.xcat.org/pipermail/xcat-user/attachments/20090820/4c99d65b/pic25964.gif
-------------- next part --------------
A non-text attachment was scrubbed...
Name: pic16114.gif
Type: image/gif
Size: 45 bytes
Desc: not available
Url : http://www.xcat.org/pipermail/xcat-user/attachments/20090820/4c99d65b/pic16114.gif
-------------- next part --------------
A non-text attachment was scrubbed...
Name: pic06190.gif
Type: image/gif
Size: 45 bytes
Desc: not available
Url : http://www.xcat.org/pipermail/xcat-user/attachments/20090820/4c99d65b/pic06190.gif
-------------- next part --------------
A non-text attachment was scrubbed...
Name: pic27094.gif
Type: image/gif
Size: 45 bytes
Desc: not available
Url : http://www.xcat.org/pipermail/xcat-user/attachments/20090820/4c99d65b/pic27094.gif
More information about the xcat-user
mailing list