Oracle Validated Configuration
 View all Validated Configurations
| Configuration Summary: |
Oracle Database 10g Release 2 Single Instance and RAC on on Red Hat Enterprise Linux 4 AS/ES x86-64
using OCFS2 and Automatic Storage Management (ASM) |
| Publication Date: |
August 14, 2006 |
| Version: |
1.0 |
| Server Platform: |
IBM BladeCenter HS20 |
| Storage: |
IBM TotalStorage DS4800 |
| Oracle Software: |
Oracle Database 10g Release 2 (10.2.0.2) for Linux x86-64 |
| Linux Distribution: |
RHEL 4 Update 3 x86-64 |
Server and Storage Platform Details
2 x IBM BladeCenter HS20
2 x Intel(R) Xeon(TM) with Extended Memory 64 Technology (EM64T) 3.0 GHz
8 GB RAM
1 x 40 GB IDE HD
2 x integrated Gigabit Ethernet ports (Broadcom)
1 x addon BladeCenter Fibre Channel Expansion Card (2 ports, QLogic)
Additional Server models covered by this configuration
IBM System x
x3400 (x226)
x3500 (x236)
x3800 (x260)
x3550 (x336)
x3650 (x346)
x3850 (x366)
1 x IBM TotalStorage DS4800
14 x 146 GB 10K RPM HD
Additional Storage models covered by this configuration
IBM System Storage DS4000 Family
DS4100
DS4200
DS4300 and DS4300 Turbo
DS4500
DS4700
DS4800
Linux Distribution Details
RHEL 4 Update 3 x86-64 default install
kernel-2.6.9-34.ELsmp (Update 3)
Additional packages needed from distribution
binutils-2.15.92.0.2-18.x86_64.rpm
compat-db-4.1.25-9.i386.rpm
compat-db-4.1.25-9.x86_64.rpm
compat-libstdc33-3.2.3-47.3.i386.rpm
compat-libstdc33-3.2.3-47.3.x86_64.rpm
control-center-2.8.0-12.x86_64.rpm
gcc-3.4.3-22.1.x86_64.rpm
gcc-c3.4.3-22.1.x86_64.rpm
glibc-2.3.4-2.9.i686.rpm
glibc-2.3.4-2.9.x86_64.rpm
glibc-common-2.3.4-2.9.x86_64.rpm
glibc-devel-2.3.4-2.9.i386.rpm
glibc-devel-2.3.4-2.9.x86_64.rpm
glibc-headers-2.3.4-2.9.x86_64.rpm
glibc-kernheaders-2.4-9.1.87.x86_64.rpm
gnome-libs-1.4.1.2.90-44.1.i386.rpm
gnome-libs-1.4.1.2.90-44.1.x86_64.rpm
libaio-0.3.103-3.i386.rpm
libaio-0.3.103-3.x86_64.rpm
libgcc-3.4.3-22.1.i386.rpm
libstdc3.4.3-22.1.x86_64.rpm
libstdcdevel-3.4.3-22.1.x86_64.rpm
make-3.80-5.x86_64.rpm
ORBit-0.5.17-14.i386.rpm
pdksh-5.2.14-30.x86_64.rpm
sysstat-5.0.5-1.x86_64.rpm
xorg-x11-deprecated-libs-6.8.2-1.EL.13.6.i386.rpm
xscreensaver-4.18-5.rhel4.2.x86_64.rpm
Additional packages needed from IBM
IBM FAStT FC-2 and DS4000 FC2-133 Host Bus Adapter non-failover device
driver for Linux Kernel 2.6 IA-32, IA-64, AMD-64 Version 8
IBM TotalStorage DS4000 Linux RDAC for 2.6.x kernel Version 9
Additional packages from Oracle
Required for DB on ASM
oracleasm-2.6.9-34.ELsmp-2.0.2-1.x86_64.rpm
oracleasmlib-2.0.2-1.x86_64.rpm
oracleasm-support-2.0.2-1.x86_64.rpm
Required for DB on OCFS2
ocfs2-2.6.9-34.ELsmp-1.2.1-1.x86_64.rpm
ocfs2console-1.2.1-1.x86_64.rpm
ocfs2-tools-1.2.1-1.x86_64.rpm
ocfs2-tools-debuginfo-1.2.1-1.x86_64.rpm
Boot options
selinux=0 elevator=deadline
/etc/modprobe.conf (additional statements)
options qla2xxx displayConfig=1 ql2xfailover=0
options hangcheck_timer hangcheck_reboot=1
/etc/sysctl.conf (additional settings)
fs.file-max=327679
fs.aio-max-nr=3145728
kernel.msgmni=2878
kernel.msgmax=8192
kernel.sem=250 32000 100 142
kernel.shmmni=4096
kernel.shmall=3279547
# set to a value half the size of physical memory
kernel.shmmax=3700000000
# rmem_max can be tuned based on workload to balance performance vs lowmem usage
net.core.rmem_max=2097152
net.core.rmem_default=262144
net.core.wmem_default=262144
net.core.wmem_max=262144
net.ipv4.ip_local_port_range=1024 65000
vm.lower_zone_protection=100
kernel.msgmnb=65536
kernel.sysrq=1
# needed to enable hugepage usage
vm.nr_hugepages=512
vm.lower_zone_protection=100
/etc/selinux/config
SELINUX=disabled
/etc/security/limits.conf:
# depending on size of db, these may need to be larger
oracle soft nofile 131072
oracle hard nofile 131072
oracle soft nproc 131072
oracle hard nproc 131072
oracle soft core unlimited
oracle hard core unlimited
# set memlock greater than or equal to the sga size to allow
# oracle to use hugepages if configured
oracle soft memlock 50000000
oracle hard memlock 50000000
/etc/sysconfig/o2cb
#Note: If the database is on OCFS2, timeouts need to be adjusted.
Set O2CB_HEARTBEAT_THRESHOLD to a value which takes into consideration
the underlying storage and the workload to avoid timeouts
( E.g: O2CB_HEARTBEAT_THRESHOLD=31 )
Filesystems tested:
Database Files:
ext3
ASM using block devices and ASMLib
ocfs2
RAC ocr and voting disk files
raw devices
ocfs2
Mount options for ocfs2 filesystem:
_netdev,datavolume,nointr
Driver Modules
The network driver module used (tg3) is the version supplied with RHEL4 U3 x86-64
The hangcheck-timer module used is the version supplied with RHEL4 U3 x86-64
Miscellaneous
The swap partition is the size of physical RAM.
2 gigabit networks configured: public and interconnect
Additional Parameters:
Changed Oracle Clusterware VIP timeout parameters:
CHECK_INTERVAL to 120 and SCRIPT_TIMEOUT to 120
Oracle Software Details
Oracle 10gR2 Single Instance and Real Application Cluster for Linux x86-64 (10.2.0.2)
patch 5071492
patch 4639236
patch 4690794
patch 5036588
Configuration Feedback
Bug Description
Number
5041764 CFQ io scheduler can delay/hang io (bz 151368)
affects: heavy io access to raw/block devices
symptom: io requests will start to hang or take a long to complete
RAC node could be evicted
workaround: boot w/ elevator=deadline
5071492 LMS crash with ORA-00600: internal error code, arguments: [kclastf_1], [2], [],
affects: 10.2.0.2 RAC
symptom: the instance could terminate
solution: apply patch 5071492
4639236 ORA-600 [kclcls_5] in RAC instance
affects: 10.2.0.2 RAC
symptom: the instance could terminate
solution: apply patch 4639236
4690794 "ERROR IN KQLMBIVG SEE LCK TRACE FILE" [LT] [LB] KJUSERCLIENTLOCK
affects: 10.2.0.2 RAC
symptom: Error messages in the alert logs
solution: apply patch 4690794
5036588 LMD0 PROCESS RECEIVED OS SIGNAL #11
affects: 10.2.0.2 RAC
symptom: the instance could terminate
solution: apply patch 5036588
5058952 e1000 flow control defaults to none in the 2.6 kernel
affects: e1000 network interfaces with heavy traffic
symptom: RAC interconnect may get lost blocks
solution: load e1000 with FlowControl=1 (Rx)
5093059 netdump doesn't load with bonding configured (it 85145)
affects: bringing up netdump over a bonded interface
symptom: /var/log/messages will have an error:
netlog: bond0 doesn't support polling, aborting.
workaround: none at the moment
4593892 repeated warnings in dmesg about lost ticks (it 80129/bz 139376)
affects: usually seen on x86-64, both Intel and Opteron based systems
symptom: dmesg will have errors like:
warning: many lost ticks.
Your time source seems to be instable or some driver is hogging interupts
rip __do_softirq+0x4d/0xd0
workaround: none at the moment
5215593 unable to start RAC with db_cache_size > 4gb
affects: RAC instances with > 4gb db_cache_size
symptom: nodes that started up correctly with 10.2.0.1
may fail to startup with ORA-4031 errors in 10.2.0.2
workaround: set _ksmg_granule_size=33554432 in the init.ora.
Larger sga sizes may need a higher value.
5215622 libknlopt.a not relinked
affects: 10.2.0.2 RAC (did not occur in 10.1)
symptom: may get ORA-7445 errors during startup
workaround: manually relink on each node
5041394 relink errors after upgrading from 10.1 to 10.2
affects: 10.1 -> 10.2 upgrade process
symptom: during 10.2 upgrade, relink step will fail
with 'undefined reference' errors
workaround: after doing 10.2 prereq steps, rename
$ORACLE_HOME/lib/stubs to $ORACLE_HOME/lib/stubs.10.1
$ORACLE_HOME/lib32/stubs to $ORACLE_HOME/lib32/stubs.10.1
then start installing 10.2.0.1
5021707 CSS should open block device voting disk with o_direct
affects: 10.2.0.2 RAC when voting or ocr disk is a block device
symptom: RAC reconfiguration may not occur properly
solution: use raw devices for ocr and voting disks
5219517 failing RAC interconnect causes ASM to hang
affects: 10.2.0.2 RAC using ASM (2-node)
symptom: ifconfig down of RAC interconnect on node 1 causes
surviving node 2 ASM instance to hang. This may
occur during testing to simulate interconnect failure.
solution: RAC properly handles this failure case when the
interconnect is physically disconnected vs. ifconfig down
which is simulating the failure
5298421 asmlib ORA-15183 ASMLIB initialization error
affects: 10.2 when using asmlib
symptom: ORA-15183 could occur while starting an asm instance
workaround: a reboot is needed
5333606 rpm throws errors if selinux is disabled at OS installation and is enabled at runtime
affects: error at rpm packages installs
symptom: during packages installation, errors indicate the scriplet failures
workaround: do not change selinux mode from disable to enable or visa versa at runtime
5017352 warning messages in trace files during certain workloads with async io turned on
affects: performance
symptom: Following warning in trace files
WARNING: ORACLE PROCESS RUNNING OUT OF OS KERNEL I/O RESOURCES
workaround: none so far
|
Bookmark
