source: trunk/libIGCM/AA_monitoring @ 835

Last change on this file since 835 was 832, checked in by sdipsl, 11 years ago
  • Trivial changes to accomodate new_libIGCM function defined here /ccc/cont003/home/dsm/p86mart/.bash_alias (ksh-->bash)

She transforms every cp and rm by IGCM_sys_Cp and IGCM_sys_Rm within IGCM_debug_Check. So we need to source sys before calling it.

  • Property licence set to
    The following licence information concerns ONLY the libIGCM tools
    ==================================================================

    Copyright © Centre National de la Recherche Scientifique CNRS
    Commissariat à l'Énergie Atomique CEA

    libIGCM : Library for Portable Models Computation of IGCM Group.

    IGCM Group is the french IPSL Global Climate Model Group.

    This library is a set of shell scripts and functions whose purpose is
    the management of the initialization, the launch, the transfer of
    output files, the post-processing and the monitoring of datas produce
    by any numerical program on any plateforme.

    This software is governed by the CeCILL license under French law and
    abiding by the rules of distribution of free software. You can use,
    modify and/ or redistribute the software under the terms of the CeCILL
    license as circulated by CEA, CNRS and INRIA at the following URL
    "http://www.cecill.info".

    As a counterpart to the access to the source code and rights to copy,
    modify and redistribute granted by the license, users are provided only
    with a limited warranty and the software's author, the holder of the
    economic rights, and the successive licensors have only limited
    liability.

    In this respect, the user's attention is drawn to the risks associated
    with loading, using, modifying and/or developing or reproducing the
    software by the user in light of its specific status of free software,
    that may mean that it is complicated to manipulate, and that also
    therefore means that it is reserved for developers and experienced
    professionals having in-depth computer knowledge. Users are therefore
    encouraged to load and test the software's suitability as regards their
    requirements in conditions enabling the security of their systems and/or
    data to be ensured and, more generally, to use and operate it in the
    same conditions as regards security.

    The fact that you are presently reading this means that you have had
    knowledge of the CeCILL license and that you accept its terms.
  • Property svn:keywords set to Revision Author Date
File size: 9.3 KB
RevLine 
[622]1#-Q- curie ######################
2#-Q- curie ## CURIE   TGCC/CEA ##
3#-Q- curie ######################
[626]4#-Q- curie #MSUB -r MONITORING     # Nom du job               
[622]5#-Q- curie #MSUB -eo
6#-Q- curie #MSUB -n 1              # Reservation du processus
7#-Q- curie #MSUB -T 86400          # Limite de temps elapsed du job
[741]8#-Q- curie #MSUB -q xlarge
[704]9#-Q- curie #MSUB -Q normal
[681]10#-Q- curie set +x
[770]11#-Q- ada #!/bin/ksh
12#-Q- ada #######################
13#-Q- ada ##   ADA   IDRIS  ##
14#-Q- ada #######################
15#-Q- ada # Temps Elapsed max. d'une requete hh:mm:ss
16#-Q- ada # @ wall_clock_limit = 1:00:00
17#-Q- ada # Nom du travail LoadLeveler
18#-Q- ada # @ job_name   = MONITORING
19#-Q- ada # Fichier de sortie standard du travail       
20#-Q- ada # @ output     = $(job_name).$(jobid)
21#-Q- ada # Fichier de sortie d'erreur du travail
22#-Q- ada # @ error      =  $(job_name).$(jobid)
23#-Q- ada # pour recevoir un mail en cas de depassement du temps Elapsed (ou autre pb.)
24#-Q- ada # @ notification = error
25#-Q- ada # @ environment  = $POST_DIR ; $SUBMIT_DIR ; $libIGCM ; $libIGCM_SX ; $R_INIT ; $R_BC ; $StandAlone ; $RESOL_ATM ; $RESOL_OCE ; $RESOL_ICE ; $RESOL_MBG ; $RESOL_SRF ; $R_SAVE ; $config_UserChoices_JobName ; $config_UserChoices_TagName ; $YEARS ; $MASTER
26#-Q- ada # @ queue
[172]27#-Q- sx9mercure #!/bin/ksh
[616]28#-Q- sx9mercure ######################
29#-Q- sx9mercure ## SX9MERCURE  CCRT ##
30#-Q- sx9mercure ######################
31#-Q- sx9mercure #PBS -N  MONITORING          # Nom du job
32#-Q- sx9mercure #PBS -j o                    # regroupement des stdout et stderr
33#-Q- sx9mercure #PBS -S /usr/bin/ksh         # shell de soumission
34#-Q- sx9mercure #PBS -l memsz_job=1gb        # Limite memoire a 1 Go
35#-Q- sx9mercure #PBS -l elapstim_req=1:00:00   # Limite temps a 2 heures
36#-Q- sx9mercure #PBS -q scalaire
[640]37#-Q- sx9mercure #PBS -r n
[222]38#-Q- titane #!/bin/ksh
39#-Q- titane ######################
40#-Q- titane ## TITANE   CEA ##
41#-Q- titane ######################
42#-Q- titane #MSUB -r MONITORING     # Nom du job               
[544]43#-Q- titane #MSUB -eo
[222]44#-Q- titane #MSUB -n 1              # Reservation du processus
45#-Q- titane #MSUB -T 86400          # Limite de temps elapsed du job
[544]46#-Q- titane #MSUB -q mono
[643]47#-Q- titane #MSUB -E '-rn'
[281]48#-Q- lxiv8 ######################
49#-Q- lxiv8 ## OBELIX      LSCE ##
50#-Q- lxiv8 ######################
51#-Q- lxiv8 #PBS -N MONITORING
52#-Q- lxiv8 #PBS -m a
53#-Q- lxiv8 #PBS -j oe
54#-Q- lxiv8 #PBS -q medium
55#-Q- lxiv8 #PBS -o MONITORING.$$
56#-Q- lxiv8 #PBS -S /bin/ksh
[2]57#-Q- default #!/bin/ksh
58#-Q- default ##################
59#-Q- default ## DEFAULT HOST ##
60#-Q- default ##################
61
[373]62#**************************************************************
63# Author: Sebastien Denvil
64# Contact: Sebastien.Denvil__at__ipsl.jussieu.fr
65# $Revision::                                          $ Revision of last commit
66# $Author::                                            $ Author of last commit
67# $Date::                                              $ Date of last commit
[2]68# IPSL (2006)
69#  This software is governed by the CeCILL licence see libIGCM/libIGCM_CeCILL.LIC
[373]70#
71#**************************************************************
[2]72
[108]73#set -eu
74#set -vx
75
[2]76date
77
[770]78#-Q- ada export OMP_NUM_THREADS=1
[2]79
[712]80#D- Task type (computing or post-processing)
81TaskType=post-processing
82
[280]83########################################################################
84
85#D- Flag to determine if this job in a standalone mode
86#D- Default : value from AA_job if any
87StandAlone=${StandAlone:=true}
88
[554]89#D- Path to libIGCM
[280]90#D- Default : value from AA_job if any
[770]91# WARNING For StandAlone use : To run this script on some machine (ada and cesium)
[554]92# WARNING you must check MirrorlibIGCM variable in sys library.
93# WARNING If this variable is true, you must use libIGCM_POST path instead
94# WARNING of your running libIGCM directory.
[280]95libIGCM=${libIGCM:=::modipsl::/libIGCM}
96
[334]97#D- Increased verbosity (1, 2, 3)
98#D- Default : value from AA_job if any
99Verbosity=${Verbosity:=3}
100
101#D- Low level debug : to bypass lib test checks and stack construction
102#D- Default : value from AA_job if any
103DEBUG_debug=${DEBUG_debug:=false}
104
105#D- TEMPORARY Flag to determine atmospheric resolution
106#D- Default : value from atmospheric driver if any
107RESOL_ATM=${RESOL_ATM:=ALL}
108
109#D- Flag to determine surface resolution
110#D- Default : value from surface driver if any
111RESOL_SRF=${RESOL_SRF:=ALL}
112
113#D- Flag to determine surface resolution
114#D- Default : value from surface driver if any
115RESOL_SBG=${RESOL_SBG:=ALL}
116
117#D- TEMPORARY Flag to determine ocean resolution
118#D- Default : value from ocean driver if any
119RESOL_OCE=${RESOL_OCE:=ORCA2}
120
121#D- TEMPORARY Flag to determine ice resolution
122#D- Default : value from ice driver if any
123RESOL_ICE=${RESOL_ICE:=ORCA2}
124
125#D- TEMPORARY Flag to determine marine biogeochemistry resolution
126#D- Default : value from ice driver if any
127RESOL_MBG=${RESOL_MBG:=ORCA2}
128
[2]129######################################################################
130
[108]131. ${libIGCM}/libIGCM_debug/libIGCM_debug.ksh
132. ${libIGCM}/libIGCM_card/libIGCM_card.ksh
133. ${libIGCM}/libIGCM_date/libIGCM_date.ksh
134#-------
135. ${libIGCM}/libIGCM_sys/libIGCM_sys.ksh
[731]136. ${libIGCM}/libIGCM_config/libIGCM_config.ksh
[832]137#-------
138( ${DEBUG_debug} ) && IGCM_debug_Check
139( ${DEBUG_debug} ) && IGCM_card_Check
140( ${DEBUG_debug} ) && IGCM_date_Check
[2]141
142######################################################################
143
144#set -vx
145
146#===========================================
[36]147RUN_DIR=${RUN_DIR_PATH}
[34]148IGCM_sys_MkdirWork ${RUN_DIR}
149IGCM_sys_Cd ${RUN_DIR}
150
[436]151# ------------------------------------------------------------------
152# Test if all was right before proceeding further
153# ------------------------------------------------------------------
154IGCM_debug_Verif_Exit_Post
155
[2]156if [ ${StandAlone} = true ] ; then
[785]157  CARD_DIR=${SUBMIT_DIR}
[2]158else
[785]159  CARD_DIR=${RUN_DIR}
160  IGCM_sys_Get_Master ${SUBMIT_DIR}/config.card ${RUN_DIR_PATH}
161  IGCM_sys_Get_Master ${SUBMIT_DIR}/run.card    ${RUN_DIR_PATH}
162  IGCM_sys_Get_Master ${SUBMIT_DIR}/COMP        ${RUN_DIR_PATH}
163  IGCM_sys_Get_Master ${SUBMIT_DIR}/POST        ${RUN_DIR_PATH}
[2]164fi
165
[727]166#==================================
[2]167# First of all
168#
[727]169# Read libIGCM compatibility version in config.card
170# Read UserChoices section
171# Read Ensemble section
172# Read Post section
173# Define all netcdf output directories
174#==================================
175IGCM_config_CommonConfiguration ${CARD_DIR}/config.card
[658]176
[263]177#==================================
[727]178# Read ListOfComponents section:
179IGCM_card_DefineArrayFromSection ${CARD_DIR}/config.card ListOfComponents
[591]180
[727]181# Create R_FIGR that has been defined by IGCM_config_CommonConfiguration
[591]182IGCM_sys_MkdirArchive ${R_FIGR}
[102]183#
[591]184IGCM_sys_TestDirArchive ${R_FIGR}/MONITORING
[102]185if [ $? = 0 ] ; then
[785]186  IGCM_debug_Print 1 "Get MONITORING directory from archive"
187  IGCM_sys_Get_Dir ${R_FIGR}/MONITORING ${RUN_DIR}
[102]188else
[785]189  IGCM_debug_Print 1 "MONITORING first pass. Nothing has been done before"
[102]190fi
[2]191# --------------------------------------------
192# Insert your commands between III...III lines
193# and precise produced directories to save
194# IIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIII
195
196for comp in ${config_ListOfComponents[*]} ; do
[785]197  IGCM_debug_Print 1 "################## Component: ${comp} ######################"
198  liste_file_monitoring=""
199  IGCM_card_DefineArrayFromOption ${CARD_DIR}/config.card ListOfComponents ${comp}
200  eval compname=\${config_ListOfComponents_${comp}[0]}                > /dev/null 2>&1
[181]201
[785]202  PATH_monitoring_file=""
203  eval monitoring_file=monitoring01_${compname}_\${RESOL_${comp}}.cfg > /dev/null 2>&1
204  if [[ -d ${CARD_DIR}/POST && -f ${CARD_DIR}/POST/monitoring01_${compname}.cfg ]] ; then
205    PATH_monitoring_file=${CARD_DIR}/POST/monitoring01_${compname}.cfg
206  elif [ -f ${FER_ATLAS}/${monitoring_file} ] ; then
207    PATH_monitoring_file=${FER_ATLAS}/${monitoring_file}
208  else
209    IGCM_debug_Print 1 "No monitoring file found for this component. Was expecting ${monitoring_file}"
210    IGCM_debug_Print 1 "Step to next component"
211    continue
212  fi
213  #
214  if [ X${PATH_monitoring_file} != X"" ] ; then
215    IGCM_debug_Print 1 "Monitoring file used : ${PATH_monitoring_file}"
216    IGCM_debug_Print 1 "Determine which files we need."
217    . monitoring01 -l2 --listcommand 'IGCM_sys_RshArchive ls' ${PATH_monitoring_file} ${R_SAVE}/${comp}/Analyse/TS_MO
218    liste_file_monitoring=$( . monitoring01 -q -l2 --listcommand 'IGCM_sys_RshArchive ls' ${PATH_monitoring_file} ${R_SAVE}/${comp}/Analyse/TS_MO )
219  fi
220  #
221  if [ ! "X${liste_file_monitoring}" = X ] ; then
222    IGCM_sys_Get /l liste_file_monitoring ${RUN_DIR}
223    IGCM_debug_Print 1 "monitoring01 -c ${CARD_DIR} -p ${comp} --time -t \"${config_UserChoices_JobName} monitoring\" -o ${RUN_DIR}/MONITORING ${PATH_monitoring_file} ."
224    IGCM_debug_Print 1 "monitoring01 starts ................................................."
225    monitoring01 -c ${CARD_DIR} -p ${comp} --time -t "${config_UserChoices_JobName} monitoring" -o ${RUN_DIR}/MONITORING ${PATH_monitoring_file} .
226  else
227    IGCM_debug_Print 1 "No time series detected by this command :"
228    IGCM_debug_Print 1 "monitoring01 -l2 --listcommand 'IGCM_sys_RshArchive ls' ${PATH_monitoring_file} ${R_SAVE}/${comp}/Analyse/TS_MO"
229    . monitoring01 -l2 --listcommand 'IGCM_sys_RshArchive ls' ${PATH_monitoring_file} ${R_SAVE}/${comp}/Analyse/TS_MO
230  fi
231  #
[2]232done
233
234# IIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIII
235
236# Save files
[587]237IGCM_sys_Put_Dir MONITORING ${R_FIGR}
[2]238
239# Dods copy
240IGCM_sys_Put_Dods MONITORING
[203]241
[590]242# Clean RUN_DIR_PATH (necessary for cesium and titane only)
[203]243IGCM_sys_RmRunDir -Rf ${RUN_DIR_PATH}
Note: See TracBrowser for help on using the repository browser.