Scribd
Upload
73 views4 pages

HA System Configuration Log Analysis

The document describes the log files of a script that configures a system for high availability (HA). The script copies HA configuration files to a peer system, configures networking and services, starts the keepalived daemon, and transitions a MySQL database to a primary state on the local system. When the system later changes to a fault state, the script disables ARP, stops local services, and changes the system hostname.

Uploaded by

Ajit
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as TXT, PDF, TXT or read online on Scribd
73 views4 pages

HA System Configuration Log Analysis

The document describes the log files of a script that configures a system for high availability (HA). The script copies HA configuration files to a peer system, configures networking and services, starts the keepalived daemon, and transitions a MySQL database to a primary state on the local system. When the system later changes to a fault state, the script disables ARP, stops local services, and changes the system hostname.

Uploaded by

Ajit
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as TXT, PDF, TXT or read online on Scribd
You are on page 1/ 4

-- Wed May 13 03:45:43 IST 2009 script to check connectivity called --

/usr/local/scripts/ha/configha.sh: /etc/ha.d/hamode or /etc/ha.d/hadetails missing

==> ha.log <==

==> clusterha.log <==

-- Wed May 13 04:17:12 IST 2009 script to check connectivity called --


checkconnectivity.sh: result is same version
checkconnectivity.sh: no. of interfaces same
-- Wed May 13 04:17:12 IST 2009 check connectivity over with status success --

-- Wed May 13 04:17:12 IST 2009 systemhasetup: is called --


systemhasetup.sh: ********* Configuring System For HA ***********
systemhasetup.sh: SSH Negotiation done
systemhasetup.sh: Generated timestamp for event syncing
systemhasetup.sh: Copying files to peer
copyfiletopeer.sh: file /etc/ha.d/hamode to peer 10.10.3.2
copyfiletopeer.sh: file /etc/ha.d/hadetails to peer 10.10.3.2
copyfiletopeer.sh: file /etc/ha.d/hadetails.peer to peer 10.10.3.2
copyfiletopeer.sh: file /etc/ha.d/ha_vmaclist to peer 10.10.3.2
copyfiletopeer.sh: file /etc/sysconfig/clock to peer 10.10.3.2
changeuname.sh:: Wed May 13 04:17:14 IST 2009 Changing uname for status=1
with hostname=manage1
changehostsfile.sh:: Wed May 13 04:17:14 IST 2009 /etc/hosts file is
updated
systemhasetup.sh: Start configuration on peer system
systemhasetup.sh: Changing date on peer and disable arp on peer
systemhasetup.sh: Applying HA_TRAFFIC rules
Wed May 13 04:17:18 IST 2009 apply_ha_rules.sh -m local_config
-------------
systemhasetup.sh: Wed May 13 04:17:18 IST 2009 Stopping services on peer
system
systemhasetup.sh: Wed May 13 04:17:30 IST 2009 Stopping services on peer
system over
keepalived: Wed May 13 04:17:31 IST 2009 stopping keepalived daemon
systemhasetup.sh: Creating ctsyncd and keepalived configuration files
copyfiletopeer.sh: file /etc/ha.d/hasyncstamp to peer 10.10.3.2
copyfiletopeer.sh: file /etc/ha.d/hasyncstamp_console to peer 10.10.3.2
Wed May 13 04:17:31 IST 2009 event_executer -m start -------------
systemhasetup.sh: Starting keepalived daemon on this system
Wed May 13 04:17:35 IST 2009 keepdstate.sh standalone -------------
state=standalone mode=config
***********************************************************************************
**************************
--- state_change.sh: Wed May 13 04:17:35 IST 2009 Calling with hamode=3,
node_state=standalone, startup_mode=config
Disable ARP for time being
changeuname.sh:: Wed May 13 04:17:35 IST 2009 Changing uname for status=1
with hostname=manage1
CCC is not configured.
changehostsfile.sh:: Wed May 13 04:17:35 IST 2009 /etc/hosts file is
updated
Wed May 13 04:17:35 IST 2009 event_executer -m event -e discard
-------------
Wed May 13 04:17:35 IST 2009 Mysql Transition started with args 2 10.10.3.2
Wed May 13 04:17:35 IST 2009 Mysql Transit: starting mysql
Wed May 13 04:17:35 IST 2009 Mysql writconf called with type=3 peerip=10.10.3.2
peerport=3306
Wed May 13 04:17:35 IST 2009 Mysql Transit: mysql started
Wed May 13 04:17:35 IST 2009 Mysql Transit to primary started
Wed May 13 04:17:35 IST 2009 Mysql writconf called with type=2 peerip=10.10.3.2
peerport=3306
A mysqld process already exists
Wed May 13 04:17:35 IST 2009 Mysql Changing java property file
Killing mysqld with pid 10096
systemhasetup.sh: Starting keepalived daemon on peer system
Starting mysqld daemon with databases from /var/lib/mysql
copyfiletopeer.sh: file /etc/ha.d/hastatus to peer 10.10.3.2
sendmailalert.sh: Wed May 13 04:17:41 IST 2009 Sending mail as HA
configured
systemhasetup.sh: ********* Configuring System For HA Over ***********
-- Wed May 13 04:17:41 IST 2009 systemhasetup: is done --

Wed May 13 04:17:41 IST 2009 Mysql Transit to primary ended


iptables -I FORWARD -p tcp -m ruleid ! --fwruleid 0 -m connmark ! --mark 512 -t
mangle -j CTFLAGS --set-ctflags 32
Loading ctsyncd binary
Committing external cache's connections
1,5c1,5
< eth0=00:02:B6:41:96:BA
< eth1=00:02:B6:41:96:BB
< eth2=00:02:B6:41:96:BC
< eth3=00:02:B6:41:96:BD
< eth4=00:02:B6:41:96:BE
---
> eth0=00:E0:20:11:0A:3C
> eth1=00:E0:20:11:0A:66
> eth2=00:E0:20:11:0A:95
> eth3=00:E0:20:11:0A:98
> eth4=00:E0:20:15:0E:2A
Virtual MAC Assigning:: eth0 00:E0:20:11:0A:3C
Virtual MAC Assigning:: eth1 00:E0:20:11:0A:66
Virtual MAC Assigning:: eth2 00:E0:20:11:0A:95
Virtual MAC Assigning:: eth3 00:E0:20:11:0A:98
Virtual MAC Assigning:: eth4 00:E0:20:15:0E:2A
portrange = 32768 61000
Adding HA-specific routes
Nothing to flush.
RTNETLINK answers: No such process
ERROR: Module ipt_LBS does not exist in /proc/modules
ERROR: Module ip_route_send does not exist in /proc/modules
Loading LBS module
RTNETLINK answers: Cannot assign requested address
Wed May 13 04:17:41 IST 2009 manage_tlv_client.sh -e true -------------
SIOCDARP(pub): No such file or directory
SIOCDARP(pub): No such file or directory
SIOCDARP(pub): No such file or directory
SIOCDARP(pub): No such file or directory
SIOCDARP(pub): No such file or directory
SIOCDARP(pub): No such file or directory
arp -i eth0 -s 240.240.240.2 00:02:B6:41:95:82
arp -i eth1 -s 240.240.240.10 00:02:B6:41:95:83
arp -i eth2 -s 240.240.240.18 00:02:B6:41:95:84
arp -i eth3 -s 240.240.240.26 00:02:B6:41:95:85
arp -i eth4 -s 240.240.240.34 00:02:B6:41:95:86
Sending virtual ARP:: 202.159.215.65 00:E0:20:11:0A:3C 202.159.215.127 eth0
Sending virtual ARP:: 10.200.20.1 00:E0:20:11:0A:3C 10.200.20.255 eth0:0
Sending virtual ARP:: 192.168.168.1 00:E0:20:11:0A:66 192.168.168.255 eth1
Sending virtual ARP:: 202.159.215.130 00:E0:20:11:0A:95 202.159.215.135 eth2
Sending virtual ARP:: 172.16.120.18 00:E0:20:11:0A:98 172.16.120.23 eth3
Sending virtual ARP:: 10.10.4.1 00:E0:20:15:0E:2A 10.10.4.255 eth4
Now ARP is enabled
Applying proxy-ARP rules
--- state_change.sh: Wed May 13 04:17:42 IST 2009 Calling with hamode=3,
node_state=standalone, startup_mode=config Over
***********************************************************************************
******************************

Wed May 13 04:17:43 IST 2009 manage_tlv_client.sh -e true -------------


Wed May 13 04:19:01 IST 2009 keepdstate.sh master -------------
state=master mode=event
***********************************************************************************
**************************
--- state_change.sh: Wed May 13 04:19:01 IST 2009 Calling with hamode=3,
node_state=master, startup_mode=event
Disable ARP for time being
changeuname.sh:: Wed May 13 04:19:01 IST 2009 Changing uname for status=1
with hostname=manage1
CCC is not configured.
changehostsfile.sh:: Wed May 13 04:19:01 IST 2009 /etc/hosts file is
updated
Wed May 13 04:19:01 IST 2009 manage_tlv_client.sh -e true -------------
Wed May 13 04:19:02 IST 2009 event_executer -m event -e discard
-------------
ctsyncd binary is ALREADY loaded
Committing external cache's connections
Virtual MACs are already assigned
portrange = 32768 61000
Adding HA-specific routes
ERROR: Module ip_route_send does not exist in /proc/modules
Loading LBS module
RTNETLINK answers: Cannot assign requested address
SIOCDARP(pub): No such file or directory
arp -i eth0 -s 240.240.240.2 00:02:B6:41:95:82
arp -i eth1 -s 240.240.240.10 00:02:B6:41:95:83
arp -i eth2 -s 240.240.240.18 00:02:B6:41:95:84
arp -i eth3 -s 240.240.240.26 00:02:B6:41:95:85
arp -i eth4 -s 240.240.240.34 00:02:B6:41:95:86
Sending virtual ARP:: 202.159.215.65 00:E0:20:11:0A:3C 202.159.215.127 eth0
Sending virtual ARP:: 10.200.20.1 00:E0:20:11:0A:3C 10.200.20.255 eth0:0
Sending virtual ARP:: 192.168.168.1 00:E0:20:11:0A:66 192.168.168.255 eth1
Sending virtual ARP:: 202.159.215.130 00:E0:20:11:0A:95 202.159.215.135 eth2
Sending virtual ARP:: 172.16.120.18 00:E0:20:11:0A:98 172.16.120.23 eth3
Sending virtual ARP:: 10.10.4.1 00:E0:20:15:0E:2A 10.10.4.255 eth4
Now ARP is enabled
Applying proxy-ARP rules
--- state_change.sh: Wed May 13 04:19:03 IST 2009 Calling with hamode=3,
node_state=master, startup_mode=event Over
***********************************************************************************
******************************

Wed May 13 04:24:44 IST 2009 keepdstate.sh fault ------------- state=fault


mode=event
***********************************************************************************
**************************
--- state_change.sh: Wed May 13 04:24:44 IST 2009 Calling with hamode=3,
node_state=fault, startup_mode=event
Disable ARP but allowing for dedicated port/remote admin ip
changeuname.sh:: Wed May 13 04:24:44 IST 2009 Changing uname for status=2
with hostname=manage2
CCC is not configured.
changehostsfile.sh:: Wed May 13 04:24:44 IST 2009 /etc/hosts file is
updated
Wed May 13 04:24:44 IST 2009 manage_tlv_client.sh -e false -------------
Wed May 13 04:24:44 IST 2009 event_executer -m event -e discard
-------------
manageservices.sh: Wed May 13 04:24:44 IST 2009 stoping services
090513 04:24:55 mysqld ended

You might also like