ROC TC (app1 tc,tc1/app2 tc1/app3 tc/app9 tc,tc1)
Pour trouver le controller ID:
VDI > ROC > system > controllers > search > find the TC and double clic on it.
Shut:
Verifier les TC up:
jps -m
ps -ef| grep taskcontroller
Kill:
kill -15 pid
Start:
Entrer dans le repertoire pour les variables d’env :
cd /irafm_binaries
. .bashrc_fm
Entrer dans le repertoire pour les restart:
cd /irafm_binaries/ROC_Server/ROC_v3.7.6.0_Server/deploy/bin
./nohup_tc.sh
./nohup_tc1.sh
./nohup_tc2.sh FOR app3
-------------------------------------------------------------------------
ROC SC (app10)
Shut:
Verifier les SC up:
Jps –m
ps -ef| grep streamcontroller
Kill:
Kill -15 pid
Start:
Entrer dans le repertoire pour les variables d’env:
cd /irafm_binaries
. .bashrc_fm
Entrer dans le repertoire pour les restart:
cd /irafm_binaries/ROC_Server/ROC_v3.7.6.0_Server/deploy/bin
./nohup_sc.sh
--------------------------------------------------------------------------------
ROC APACHE server (salrafmwebp01 ([Link])) :
Shut:
Ps -ef| grep tomcat
Kill -15 pid
Start:
cd /opt/apache/
. .bashrc1.7
cd ROC_Tomcat/apache-tomcat-7.0.94/bin
./[Link]
---------------------------------------------------------------------------------
TC RA (app4 tc/app5 tc,tc1/app6 tc,tc1)
Shut:
ps -ef| grep taskcontroller
Kill -15 pid
Start:
cd /irafm_binaries
. .bashrc
cd/irafm_binaries/ROC_Revenue_Assurance_5.7_SP6/Binaries/RA_Server/
bin./nohup_tc.sh
./nohup_tc1.sh
-----------------------------------------------------------------------------------------
RA SC (app4 ([Link]))
Shut:
ps -ef| grep streamcontroller
Kill -15 pid
Start:
cd /irafm_binaries
. .bashrc
cd
/irafm_binaries/ROC_Revenue_Assurance_5.7_SP6/Binaries/RA_Server/bi
n
./nohup_sc.sh
---------------------------------------------------------------------------------
RA APACHE server (salrafmwebp01 ([Link]))
Shut:
ps -ef| grep tomcat
kill -15 pid
Start:
cd /opt/apache/
. .bashrc1.7
cd RA_Tomcat/apache-tomcat-7.0.94/bin
./[Link]
ROCPS TC (app1 141.170 tc1) (app2 141.171 tc2)
Pause stream CCN , INTEC
Shut:
Verifier les TC up:
jps -m
or
ps -ef |grep "TaskControllerService" |grep -v "grep" |awk '{ print $1 " " $2 " "
$3}'
verify time before shutdown
date
free -h
ps aux --sort=-%mem | head -10
Kill:
kill -15 pid pid
Start:
Entrer dans le repertoire pour les variables d’env :
cd /rocps_binaries/ooredoo-server-Binaries/bin
./nohup_tc2.sh
./nohup_tc1.sh
resume stream
-------------------------------------------------------------------------
ROCPS SC (app1 141.170)
Shut:
Verifier les SC up:
Jps –m
ps -ef| grep streamcontroller
Kill
Kill -15 pid
Start:
cd /rocps_binaries/ooredoo-server-Binaries/bin
./nohup_sc.sh
--------------------------------------------------------------------------------
ROCPS APACHE server ( [Link]) :
Shut:
ps -ef| grep tomcat
kill -15 pid
Start:
cd /rocps_binaries/Tomcat/bin
./[Link]
---------------------------------------------------------------------------------------------------------------
NOTE: We repower the TC or SC or APACHE server is for example we find
collected files all failed in the same TC so we repower it.
---------------------------------------------------------------------------------------------------------------
ROC
TC jps –m
App1/app2/ kill -15 pid
app3/app9 cd /irafm_binaries
. .bashrc_fm
cd /irafm_binaries/ROC_Server/ROC_v3.7.6.0_Server/deploy/bin
./nohup_tc.sh
./nohup_tc1.sh
SC jps –m
app10 kill -15 pid
cd /irafm_binaries
. .bashrc_fm
cd /irafm_binaries/ROC_Server/ROC_v3.7.6.0_Server/deploy/bin
./nohup_sc.sh
APACHE ps –ef |grep tomcat
salrafmappp Kill –15 pid
10 Cd /opt/apache
. .bashrc1.7
Cd ROC_Tomcat/apache-tomcat-7.0.94/bin
./[Link]
RA
TC jps –m
App4/ kill -15 pid
app5/ cd /irafm_binaries
app6 . .bashrc_fm
cd /irafm_binaries/ROC_Revenue_Assurance_5.7_SP6/Binaries/RA_Server/bin
./nohup_tc.sh
SC jps –m
app4 kill -15 pid
cd /irafm_binaries
. .bashrc_fm
cd /irafm_binaries/ROC_Revenue_Assurance_5.7_SP6/Binaries/RA_Server/bin
./nohup_sc.sh
APACHE ps –ef |grep tomcat
salrafmw Kill –15 pid
ebp01 Cd /opt/apache
. .bashrc1.7
Cd ROC_Tomcat/apache-tomcat-7.0.94/bin
./[Link]
ROCPS
TC ps -ef |grep "TaskControllerService" |grep -v "grep" |awk '{ print $1 " " $2 " " $3}'
(app1 kill -15 pid pid
141.170 cd /rocps_binaries/ooredoo-server-Binaries/bin
tc1) ./nohup_tc1.sh
(app2
./nohup_tc2.sh
141.171
tc2)
SC ps -ef| grep streamcontroller
app1 kill -15 pid
141.170 cd /rocps_binaries/Tomcat/bin
./[Link]
APACHE ps –ef |grep tomcat
10.30.143 Kill –15 pid
.150 cd /rocps_binaries/Tomcat/bin
./[Link]
FMS
TC jps –m
[Link] kill -15 pid
. .bashrc
cd /rocfm_home/moneta/bin
./nohup_tc.sh
./nohup_tc2.sh
SC jps –m
[Link] kill -15 pid
. .bashrc
cd /rocfm_home/moneta/bin
./nohup_sc.sh
APACHE ps –ef |grep tomcat
[Link] Kill –15 pid
And . .bashrc
[Link] cd /rocfm_home/moneta/bin
./nohup_server.sh
on [Link]:
cd $NIKIRACLIENT
./[Link] start
PM ps –eaf |grep program
[Link] Kill –15 pid
. .bashrc
cd /rocfm_home/NIKIRAROOT/sbin
./programmanager -f programmanager.conf_latest.tcp &
Dbwriter ps –eaf |grep dbw
[Link] Kill –15 pid
. .bashrc
cd /rocfm_home/NIKIRAROOT/sbin
dbwriter -r /rocfm_home/NIKIRAROOT/FMSData/DBWriterData_1/ -w
/rocfm_home/NIKIRAROOT/FMSData/RecordLoaderData/ -q
TCP://[[Link]]:5689 &
Splitter ps –eaf |grep splitter
[Link] Kill –15 pid
. .bashrc
cd /rocfm_home/NIKIRAROOT/sbin
nohup [Link] &
nohup [Link] &
Rater ps –ef |grep Rater
[Link] Kill –15 pid
. .bashrc
cd /rocfm_home/NIKIRAROOT/sbin
./nedjmarater -d gprs &
./nedjmarater -d gsm &
TODO LIST :
FMS ROC/RA
Check the FM Health Check Email Check the email : [Ooredoo Algeria] ROC emails
([Link] - ROCFM: Health Check RA HOURLY REPORT (RA Directory)
Status)
Check the email in the Alerts directory Check the daily report OA | RA DAILY emails
OPERATIONAL REPORT
Check file sequence for MSS Check file sequence for : email
Rocps CCN CDR
Roc AIR and CCN
S From Any RA Server (ex app02) : DB
Sp Check USG1 and USG2 database
sqlplus roc_usg1/roc_usg1@usage1
sqlplus roc_usg2/roc_usg2@usage2
Check REREF database
sqlplus rocra_ref/rocra_ref@raref
Check ROC database
sqlplus sparkref/sparkref@fmref
Check RA ROC database
sqlplus rocfm/rocfm@fmref
Jps -m Check
java files
216
Check pm 216
ps -ef |grep -i tcp | wc –l
check rater 216
check splitter 216
check dbwriter 216
backlog 216
Slog (1subex) 216
Df –kh Check
disk
space
(216,217,
241)
Check if the FM Client appears Interface
properly FM Client
Open Spark [Link] and check: Interface
The files collection. RDP
File Source.
The collected files.
The tasks.
OPEN ROC : Interface
Check the collected files VDI
Check the failed and waiting tasks
Check ROC file sources
Check ROC File collections
OPEN RA : Interface
Check and Restart the Failed Audits VDI
ROC/RA database
Usg1=> dbp01
Usg2,RAREF(for audit)=> dbp02
ROCREF(for file and task roc),FMREF(for RA file and task)=> dbp03
ROCPS :
Rocps database [Link] (ref and usg)
Rocps web [Link]
Check CCN stream (failed, waiting...)
Check the INTEC stream (failed, waiting...)
Roc error:
Solution:
Extend the column size on db USG1/USG2:
alter table U_IN_SDP_047 MODIFY SDP_TOT_TRANS_AMT_DED_VOLUME NUMBER(30);
commit;
SELECT COUNT(*) AS total_pending
FROM record_20241117
WHERE status = 'pending';
SELECT COUNT(*) AS nombre_failed FROM record_20250309 WHERE status = 'failed’; AND
error_code = 'send_api_failed';
SELECT COUNT(*) AS nombre_processed FROM record_20250223 WHERE status =
'processing’;
SELECT status,
Count(1)
FROM record_20241117
GROUP BY status
ORDER BY Count(1) DESC;
UPDATE record_20250209 a SET processed_time = NULL, submitted_time = NULL,
delivered_time = NULL, error_code = NULL, server_ref = NULL, status = 'pending',
smsc = NULL WHERE [Link] = 'failed' AND error_code = 'send_api_failed';
---------------------------------------------------------------------------------------------------------------------
Failed sms :
sudo service bsmsc restart
cd scripts/
sh update_send_api_failed_sms_v2.sh
sudo service kannel status
telnet [Link] 2775
traceroute
hostname -I
Resolve the issue of SMS records having the status processing :
select * from record_20250223 where status ='processing' order by record_id desc;
update record_20250223
SET processed_time = NULL,
submitted_time = NULL,
delivered_time = NULL,
error_code = NULL,
server_ref = NULL,
status = 'pending',
smsc = NULL
where record_id <=34097 and status ='processing';
Ticket jira :
Hi Team,
The audit ‘Audit:Shahid_vas_service’ has failed multiple times during the
execution of the measure “SM:Shahid_mobile_only”.
The failure is due to the following error: “[Link]: ORA-
00928: missing SELECT keyword”
Could you please assit in resolving this issue ?
We've attached the log file.
Thank you for your support.
Best regards.
Zombie
Top=> check zombie process if yes contact UNIX team
Top also see the usage of the server component
Get the task id via script
sh /collected/n2s/get_task_id_log.sh 229603652
>/tmp/[Link]
how to acces rocps health check
/rocps_data/DATADIR/n2s/scripts/healthCheck_ROCPS.sh
[Link]
ROCPS
bash /rocps_data/DATADIR/n2s/scripts/healthCheck_ROCPS.sh