Oracle Validated Configuration
View all Validated Configurations
| Configuration Summary: |
Oracle Database 10g Release 2 Single Instance and Oracle Real Application Clusters (RAC)
on Oracle Enterprise Linux 4 Update 4 and Red Hat Enterprise Linux 4 Update 4 AS/ES4 for Linux x86-64 using ASM |
| Publication Date: |
Aug. 10, 2007 |
| Version: |
1.0 |
| Server Platform: |
HP Proliant DL380 |
| Storage: |
HP StorageWorks XP10000 Disk Array |
| Oracle Software: |
Oracle Database 10g Release 2 (10.2.0.3) for Linux x86-64 |
| Linux Distribution: |
Oracle Enterprise Linux 4 Update 4 x86-64 / Red Hat Enterprise Linux 4 Update 4 x86-64 |
Server and Storage Platform Details
Two HP ProLiant DL380 G4
Each node:
Processors: 2 x 2.80GHz 4M Quad Xeon
Memory: 6GB RAM
Network/Interconnect: Dual Port Embedded Ethernet NICs 10/100/1000BaseT
HBAs: 2 x FCA2214 2Gb Fibre Channel HBA
Storage Details:
HP StorageWorks XP10000 Disk Array (OPEN-V RAID5)
FC Switch: 2 x Cisco MDS9140 2Gb Fibre Channel Switches
Additional Storage Arrays covered by this configuration:
HP StorageWorks XP12000 and XP24000 Disk Arrays
Linux Distribution Details:
OEL4 Update 4 x86_64
kernel-smp-2.6.9-42.0.0.0.1.EL.x86_64.rpm or higher
RHEL 4 AS Update 4 x86-64
kernel-smp-2.6.9-42.EL.x86_64.rpm or higher
All Packages from distribution were installed including:
binutils-2.15.92.0.2-21.x86_64.rpm
compat-db-4.1.25-9.x86_64.rpm
compat-libstdc++-33-3.2.3-47.3.x86_64.rpm
control-center-2.8.0-12.rhel4.5.x86_64.rpm
gcc-3.4.6-3.x86_64.rpm
gcc-c++-3.4.6-3.x86_64.rpm
glibc-2.3.4-2.25.i686.rpm
glibc-2.3.4-2.25.x86_64.rpm
glibc-devel-2.3.4-2.25.i386.rpm
glibc-devel-2.3.4-2.25.x86_64.rpm
glibc-common-2.3.4-2.25.x86_64.rpm
glibc-headers-2.3.4-2.25.x86_64.rpm
glibc-kernheaders-2.4-9.1.98.EL.x86_64.rpm
gnome-libs-1.4.1.2.90-44.1.x86_64.rpm
libgcc-3.4.6-3.x86_64.rpm
libstdc++-3.4.6-3.x86_64.rpm
libstdc++-devel-3.4.6-3.x86_64.rpm
libaio-0.3.105-2.x86_64.rpm
make-3.80-6.EL4.x86_64.rpm
pdksh-5.2.14-30.3.x86_64.rpm
sysstat-5.0.5-11.rhel4.x86_64.rpm
xorg-x11-deprecated-libs-6.8.2-1.EL.13.36.x86_64.rpm
xorg-x11-deprecated-libs-6.8.2-1.EL.13.36.i386.rpm
xscreensaver-4.18-5.rhel4.11.x86_64.rpm
Additional packages from Oracle:
# This package automatically pulls in package dependencies and sets
# system parameters recommended above. It is not required but is
# recommended in order to save time in getting the system setup. It is
# available from ULN by subscribing to the "Oracle Software" channel and
# then using up2date to install it. The dependent packages will be
# installed and parameters will be adjusted as part of this up2date process.
oracle-validated-1.0.0-4.el4.x86_64.rpm [ Optional package,but recommended ]
Required for DB on ASM
oracleasmlib-2.0.2-1.x86_64.rpm
oracleasm-support-2.0.3-1.x86_64.rpm or higher
OEL4 Update 4 x86_64
oracleasm-2.6.9-42.0.0.0.1.ELsmp-2.0.3-2.x86_64.rpm or higher (corresponding to the kernel version)
RHEL4 AS/ES Update 4 x86-64
oracleasm-2.6.9-42.ELsmp-2.0.3-1.x86_64.rpm or higher (corresponding to the kernel version)
/etc/modprobe.conf:
options qla2xxx ql2xmaxqdepth=16 qlport_down_retry=30 ql2xloginretrycount=16 ql2xfailover=1 ql2xlbType=0 ql2xautorestore=0x0
remove qla2xxx /sbin/modprobe -r --first-time --ignore-remove qla2xxx && { /sbin/modprobe -r --ignore-remove qla2xxx_conf; }
options e1000 FlowControl=1
options hangcheck-timer hangcheck_tick=30 hangcheck_margin=180 hangcheck_reboot=1
/etc/sysctl.conf:
fs.file-max = 327679
fs.aio-max-nr= 3145728
kernel.msgmni=2878
kernel.msgmax=8192
kernel.msgmnb=65536
kernel.sem=250 32000 100 142
kernel.shmmni=4096
kernel.shmall=3279547
kernel.shmmax=3097020416
kernel.sysrq=1
net.core.rmem_default=262144
net.core.rmem_max=2097152
net.core.wmem_default=262144
net.core.wmem_max=262144
net.ipv4.ip_local_port_range = 1024 65000
vm.lower_zone_protection=100
/etc/security/limits.conf:
oracle soft nofile 131072
oracle hard nofile 131072
oracle soft nproc 131072
oracle hard nproc 131072
oracle soft core unlimited
oracle hard core unlimited
oracle soft memlock 50000000
oracle hard memlock 50000000
Filesystems Tested:
ASM - using asmlib
Raw devices for OCR and vote disks.
Driver Modules:
The HBA driver is the HP branded Qlogic driver hp_qla2x00 8.01.03p5-21 configured with hp_fibreutils-2.0-5 (downloadable at hp.com)
Network driver module used tg3 is the version supplied with OEL4 Update 4 x86-64 and RHEL4 Update 4 x86-64.
Hangcheck-timer module used is the version supplied with OEL4 Update 4 x86-64 and RHEL4 Update 4 x86-64.
Miscellaneous:
2 gigabit networks configured: public and cluster_interconnect
The swap partition is the size of physical RAM.
Timeout Settings:
css misscount was set to 360.
Oracle Software Details:
Oracle Database 10g Release 2 (10.2.0.3) Single Instance and Oracle Real Application Cluster (RAC) for Linux x86-64.
patch 5452672
Configuration Feedback:
Bug Number Summary
4593892 repeated warnings in dmesg about lost ticks (Redhat bugzilla 139376/it 80129)
affects: usually seen on x86-64, both Intel and Opteron based systems
symptom: dmesg will have errors like: warning: many lost ticks. Your time source seems to be
instable or some driver is hogging interupts rip __do_softirq+0x4d/0xd0
workaround: none at the moment
5041764 CFQ io scheduler can delay/hang io (Redhat bugzilla 184535/it 88208)
affects: heavy io access to raw/block devices
symptom: io requests will start to hang or take a long to complete RAC node could be evicted
workaround: Fixed in U4. Pre-U4, boot w/ elevator=deadline.
5058952 e1000 flow control defaults to none in the 2.6 kernel
affects: e1000 network interfaces with heavy traffic
symptom: RAC interconnect may get lost blocks
solution: Fixed in U4. Pre-U4, load e1000 with FlowControl=1 (Rx)
5093059 netdump doesn't load with bonding configured (it 85145)
affects: bringing up netdump over a bonded interface
symptom: /var/log/messages will have an error: netlog: bond0 doesn't support polling, aborting.
workaround: Fixed in U4
5136660 bonding primary=ethX doesn't take effect
affects: bonding doesn't take effect
symptom: If we make a bond of eth5 and eth6, where eth6 is primary, on reboot eth5 will become
active which makes server inaccessible.
workaround: Use kernel-smp-2.6.9-42.0.3.0.2.EL.x86_64.rpm or higher (available from ULN)
5333606 rpm throws errors if selinux is disabled at OS installation andis enabled at runtime
affects: error at rpm packages installs
symptom: during packages installation, errors indicate the scriplet failures
workaround: relabel the filesystems through 'touch /.autorelabel' or 'fixfilesrelabel'
5593995 proc compilation causes machines to run out of memory
affects: Causes the system to hang if selinux is enabled
symptom: The system hangs
workaround: Remove references to pathnames that do not exist onyour system in pcscfg.cfg
5693201 Application does not detect EL4 as RHEL4
affects: Installation of HP PSP on EL4
symptoms: PSP installation fails with error "Please check /etc/redhat-release for correctness"
workaround: echo "Red Hat Enterprise Linux AS release 4 (NahantUpdate 4)" > /etc/redhat-release
Redhat Bugzilla 202027: Clear_kernel_mapping: mapping has been split. will leak memory
affects: Seen on x86-64 Opteron based systems
symptoms: /var/log/messages will have errors like "clear_kernel_mapping: mapping has been split. will leak memory"
solution: Fixed in U5
Oracle Bugzilla 3015: ASM Instance could not detect IO path failure due to incorrect multipath.conf setting
Affects: all applictions using multipath devices
Symptom: On simulating a controller failure, the multipath device queues all the IOs issued to the
failed IO path and does not report the failure to its user. In this case, the ASM instance is
unable to detect the failure and continues to issue IOs, causing the instance to hang waiting
for the IOs to complete.
Solution: In configuration file /etc/multipath.conf, find and comment out the "queue_if_no_path"
feature definition.Equivalently, queue_if_no_path option can be defined as "no_path_retry queue",
Set no_path_retry option to default(null), by not having this option specified in
/etc/multipath.conf file
5041394 relink errors after upgrading from 10.1 to 10.2
affects: 10.1 -> 10.2 upgrade process
symptom: during 10.2 upgrade, relink step will fail with 'undefined reference' errors
workaround: after doing 10.2 prereq steps, rename
$ORACLE_HOME/lib/stubs to $ORACLE_HOME/lib/stubs.10.1
$ORACLE_HOME/lib32/stubs to $ORACLE_HOME/lib32/stubs.10.1
then start installing 10.2.0.1
5215593 unable to start RAC with db_cache_size > 4gb
affects: RAC instances with > 4gb db_cache_size
symptom: nodes that started up correctly with 10.2.0.1 may failto startup with ORA-4031 errors in 10.2.0.2
workaround: set _ksmg_granule_size=33554432 in the init.ora.Larger sga sizes may need a higher value.
5240928 warning messages in trace files during certain workloads with async io turned on
affects: performance
symptom: Following warning in trace files WARNING: ORACLE PROCESS RUNNING OUT OF OS KERNEL I/O RESOURCESs
workaround: apply patch 5452672.
6057703 ORA-00600:[kclchkblkdma_3] in RAC instance
affects: 10.2.0.3 RAC
symptom: the user process may terminate leaving the above mentioned traces in alert/trace files
solution: None at the moment
|