Home » Server Options » RAC & Failsafe » One node reboots frequently. (AIX 5.3.0)
icon5.gif  One node reboots frequently. [message #472372] Fri, 20 August 2010 04:16 Go to next message
lonely_lion
Messages: 5
Registered: November 2008
Location: Hanoi
Junior Member

We are using RAC 10.2, with 2 nodes on AIX 5L. Two nodes has the same configuration except node 2 has installed the OEM.
Attach with the log file. Pls tell me the way to verify the reason why node 2 reboots frequently succeddently.
Thanks alot.
Re: One node reboots frequently. [message #472374 is a reply to message #472372] Fri, 20 August 2010 04:28 Go to previous messageGo to next message
John Watson
Messages: 8922
Registered: January 2010
Location: Global Village
Senior Member
If you are having node evictions, it is the clusterware alert logs (both nodes, please) that you should be looking at, not the instance alert log. It is your $CRS_HOME/log/nodename/alert<nodename>.log file.
(edit - typo)

[Updated on: Fri, 20 August 2010 04:33]

Report message to a moderator

Re: One node reboots frequently. [message #472376 is a reply to message #472374] Fri, 20 August 2010 04:37 Go to previous messageGo to next message
lonely_lion
Messages: 5
Registered: November 2008
Location: Hanoi
Junior Member

Thank you for your quick reply.
Attach herewith 2 logs. There's smt wrong with ocssd.log.
Now investigate ocssd.log.

[Updated on: Fri, 20 August 2010 04:41]

Report message to a moderator

Re: One node reboots frequently. [message #472388 is a reply to message #472376] Fri, 20 August 2010 05:42 Go to previous messageGo to next message
John Watson
Messages: 8922
Registered: January 2010
Location: Global Village
Senior Member
Have you set your diagwait css parameter? If not, you'd better do so now, then you might get better information in your logs next time. It's described in metalink note 559365.1.
And by the way, no-one can help you with this sort of problem if you don't give the exact release number of your products, "10.2" is not precise enough.
Re: One node reboots frequently. [message #472447 is a reply to message #472388] Fri, 20 August 2010 10:16 Go to previous messageGo to next message
lonely_lion
Messages: 5
Registered: November 2008
Location: Hanoi
Junior Member

Thank you for your information. I'll take a look at metalink note right now. Will upload more diag file.
My oracle version is 10.2.0.4.0, sorry for my mistake.
Should I take care to anything else? After looking at the ocssd.log, I found nothing cos I don't understand this log.
Re: One node reboots frequently. [message #472540 is a reply to message #472447] Sat, 21 August 2010 16:05 Go to previous messageGo to next message
babuknb
Messages: 1736
Registered: December 2005
Location: NJ
Senior Member

post your CRS,CSS logs from both node, as well as your operating system logs before/after reboot

Babu

[Updated on: Sat, 21 August 2010 16:05]

Report message to a moderator

Re: One node reboots frequently. [message #472645 is a reply to message #472540] Mon, 23 August 2010 02:25 Go to previous messageGo to next message
lonely_lion
Messages: 5
Registered: November 2008
Location: Hanoi
Junior Member

Hi Babu,
Herewith attached is the errpt log till this time, crsd and cssd log.
There's something wrong with the _mutex_lo when one node went down and rebooted.
Re: One node reboots frequently. [message #472722 is a reply to message #472645] Mon, 23 August 2010 08:39 Go to previous messageGo to next message
babuknb
Messages: 1736
Registered: December 2005
Location: NJ
Senior Member

I am not able to open your attached log

Babu
Re: One node reboots frequently. [message #472781 is a reply to message #472722] Mon, 23 August 2010 20:02 Go to previous message
lonely_lion
Messages: 5
Registered: November 2008
Location: Hanoi
Junior Member

Hi Babu,
We can't upload .rar file in this forum, therefore I change .rar file to .log file.
Once download, please remove .log file in the end and it becomes the .rar file. Unzip this file and pls check the log.
Thank for your help.
Previous Topic: Upgrade from 10r2 to 11r2
Next Topic: OLTP and OLAP configuration on RAC database
Goto Forum:
  


Current Time: Thu Mar 28 18:11:17 CDT 2024