source: trunk/libIGCM/AA_atlas_ORCHIDEE @ 720

Last change on this file since 720 was 712, checked in by aclsce, 12 years ago
  • Added TaskType? variable in jobs to specify the type of the job (computing or post-processing).
  • Added the use of TaskType? variable in Curie libsys to source the appropriate .atlas_env* configuration file.
  • Property licence set to
    The following licence information concerns ONLY the libIGCM tools
    ==================================================================

    Copyright © Centre National de la Recherche Scientifique CNRS
    Commissariat à l'Énergie Atomique CEA

    libIGCM : Library for Portable Models Computation of IGCM Group.

    IGCM Group is the french IPSL Global Climate Model Group.

    This library is a set of shell scripts and functions whose purpose is
    the management of the initialization, the launch, the transfer of
    output files, the post-processing and the monitoring of datas produce
    by any numerical program on any plateforme.

    This software is governed by the CeCILL license under French law and
    abiding by the rules of distribution of free software. You can use,
    modify and/ or redistribute the software under the terms of the CeCILL
    license as circulated by CEA, CNRS and INRIA at the following URL
    "http://www.cecill.info".

    As a counterpart to the access to the source code and rights to copy,
    modify and redistribute granted by the license, users are provided only
    with a limited warranty and the software's author, the holder of the
    economic rights, and the successive licensors have only limited
    liability.

    In this respect, the user's attention is drawn to the risks associated
    with loading, using, modifying and/or developing or reproducing the
    software by the user in light of its specific status of free software,
    that may mean that it is complicated to manipulate, and that also
    therefore means that it is reserved for developers and experienced
    professionals having in-depth computer knowledge. Users are therefore
    encouraged to load and test the software's suitability as regards their
    requirements in conditions enabling the security of their systems and/or
    data to be ensured and, more generally, to use and operate it in the
    same conditions as regards security.

    The fact that you are presently reading this means that you have had
    knowledge of the CeCILL license and that you accept its terms.
  • Property svn:keywords set to Revision Author Date
File size: 12.9 KB
RevLine 
[314]1#-Q- cesium #!/bin/ksh
2#-Q- cesium ######################
3#-Q- cesium ## CESIUM   CEA ##
4#-Q- cesium ######################
5#-Q- cesium #MSUB -r ATL_ORCH       # Nom du job               
6#-Q- cesium #MSUB -N 1              # Reservation du noeud
7#-Q- cesium #MSUB -n 1              # Reservation du processus
8#-Q- cesium #MSUB -T 86400          # Limite de temps elapsed du job
9#-Q- cesium #MSUB -E "-j o"
10#-Q- cesium #MSUB -E "-S /bin/ksh"
[622]11#-Q- curie ######################
12#-Q- curie ## CURIE   TGCC/CEA ##
13#-Q- curie ######################
[626]14#-Q- curie #MSUB -r ATL_ORCH       # Nom du job               
[622]15#-Q- curie #MSUB -eo
16#-Q- curie #MSUB -n 1              # Reservation du processus
17#-Q- curie #MSUB -T 86400          # Limite de temps elapsed du job
[643]18#-Q- curie #MSUB -E '--no-requeue'
[681]19#-Q- curie #MSUB -q large
[704]20#-Q- curie #MSUB -Q normal
[681]21#-Q- curie set +x
[2]22#-Q- platine #!/usr/bin/ksh
23#-Q- platine ##################
24#-Q- platine ## PLATINE   CEA ##
25#-Q- platine ##################
26#-Q- platine #BSUB -J ATL_ORCH          # Nom du job
27#-Q- platine #BSUB -N                   # message a la fin du job
28#-Q- platine #BSUB -n 1                 # reservation des processeurs pour le job
29#-Q- platine #BSUB -W 1:00              # Limite temps
[18]30#-Q- platine #BSUB -q post              # Passage en queue post
[426]31#-Q- platine #BSUB -L /bin/ksh
[59]32#-Q- sx8brodie #!/bin/ksh
[2]33#-Q- sx8brodie #######################
34#-Q- sx8brodie ## SX8BRODIE   IDRIS ##
35#-Q- sx8brodie #######################
[58]36#-Q- sx8brodie # Temps Elapsed max. d'une requete hh:mm:ss
[504]37#-Q- sx8brodie # @ wall_clock_limit = 1:00:00
[58]38#-Q- sx8brodie # Nom du travail LoadLeveler
[60]39#-Q- sx8brodie # @ job_name   = ATL_ORCH
[58]40#-Q- sx8brodie # Fichier de sortie standard du travail       
41#-Q- sx8brodie # @ output     = $(job_name).$(jobid)
42#-Q- sx8brodie # Fichier de sortie d'erreur du travail
43#-Q- sx8brodie # @ error      =  $(job_name).$(jobid)
44#-Q- sx8brodie # pour recevoir un mail en cas de depassement du temps Elapsed (ou autre pb.)
45#-Q- sx8brodie # @ notification = error
[370]46#-Q- sx8brodie # @ environment  = $POST_DIR ; $SUBMIT_DIR ; $libIGCM ; $R_INIT ; $R_BC ; $StandAlone ; $RESOL_ATM ; $RESOL_OCE ; $RESOL_ICE ; $RESOL_SRF ; $R_SAVE ; $config_UserChoices_JobName ; $config_UserChoices_TagName ; $YEARS ; $DIR_OUT ; $MASTER ; $libIGCM_SX
[58]47#-Q- sx8brodie # @ queue
[68]48#-Q- aix6 #!/bin/ksh
49#-Q- aix6 #######################
50#-Q- aix6 ##   VARGAS   IDRIS  ##
51#-Q- aix6 #######################
52#-Q- aix6 # Temps Elapsed max. d'une requete hh:mm:ss
[504]53#-Q- aix6 # @ wall_clock_limit = 1:00:00
[68]54#-Q- aix6 # Nom du travail LoadLeveler
55#-Q- aix6 # @ job_name   = ATL_ORCH
56#-Q- aix6 # Fichier de sortie standard du travail       
57#-Q- aix6 # @ output     = $(job_name).$(jobid)
58#-Q- aix6 # Fichier de sortie d'erreur du travail
59#-Q- aix6 # @ error      =  $(job_name).$(jobid)
60#-Q- aix6 # pour recevoir un mail en cas de depassement du temps Elapsed (ou autre pb.)
61#-Q- aix6 # @ notification = error
[370]62#-Q- aix6 # @ environment  = $POST_DIR ; $SUBMIT_DIR ; $libIGCM ; $R_INIT ; $R_BC ; $StandAlone ; $RESOL_ATM ; $RESOL_OCE ; $RESOL_ICE ; $RESOL_SRF ; $R_SAVE ; $config_UserChoices_JobName ; $config_UserChoices_TagName ; $YEARS ; $DIR_OUT ; $MASTER ; $libIGCM_SX
[68]63#-Q- aix6 # @ queue
[386]64#-Q- ulam #!/bin/ksh
65#-Q- ulam #######################
66#-Q- ulam ##   ULAM   IDRIS  ##
67#-Q- ulam #######################
68#-Q- ulam # Temps Elapsed max. d'une requete hh:mm:ss
[500]69#-Q- ulam # @ wall_clock_limit = 1:00:00
[386]70#-Q- ulam # Nom du travail LoadLeveler
71#-Q- ulam # @ job_name   = ATL_ORCH
72#-Q- ulam # Fichier de sortie standard du travail       
73#-Q- ulam # @ output     = $(job_name).$(jobid)
74#-Q- ulam # Fichier de sortie d'erreur du travail
75#-Q- ulam # @ error      =  $(job_name).$(jobid)
76#-Q- ulam # pour recevoir un mail en cas de depassement du temps Elapsed (ou autre pb.)
77#-Q- ulam # @ notification = error
78#-Q- ulam # @ environment  = $POST_DIR ; $SUBMIT_DIR ; $libIGCM ; $R_INIT ; $R_BC ; $StandAlone ; $RESOL_ATM ; $RESOL_OCE ; $RESOL_ICE ; $RESOL_SRF ; $R_SAVE ; $config_UserChoices_JobName ; $config_UserChoices_TagName ; $YEARS ; $DIR_OUT ; $MASTER ; $libIGCM_SX
79#-Q- ulam # @ queue
[2]80#-Q- sx8mercure #!/bin/ksh
81#-Q- sx8mercure ######################
82#-Q- sx8mercure ## SX8MERCURE   CEA ##
83#-Q- sx8mercure ######################
84#-Q- sx8mercure #PBS -N  ATL_ORCH            # Nom du job
85#-Q- sx8mercure #PBS -j o                    # regroupement des stdout et stderr
86#-Q- sx8mercure #PBS -S /usr/bin/ksh         # shell de soumission
87#-Q- sx8mercure #PBS -l memsz_job=1gb        # Limite memoire a 1 Go
88#-Q- sx8mercure #PBS -l cputim_job=1:00:00   # Limite temps a 2 heures
[299]89#-Q- sx8mercure #PBS -q scalaire
[640]90#-Q- sx8mercure #PBS -r n
[172]91#-Q- sx9mercure #!/bin/ksh
[616]92#-Q- sx9mercure ######################
93#-Q- sx9mercure ## SX9MERCURE  CCRT ##
94#-Q- sx9mercure ######################
95#-Q- sx9mercure #PBS -N  ATL_ORCH            # Nom du job
96#-Q- sx9mercure #PBS -j o                    # regroupement des stdout et stderr
97#-Q- sx9mercure #PBS -S /usr/bin/ksh         # shell de soumission
98#-Q- sx9mercure #PBS -l memsz_job=1gb        # Limite memoire a 1 Go
99#-Q- sx9mercure #PBS -l elapstim_req=1:00:00   # Limite temps a 2 heures
100#-Q- sx9mercure #PBS -q scalaire
[640]101#-Q- sx9mercure #PBS -r n
[222]102#-Q- titane #!/bin/ksh
103#-Q- titane ######################
104#-Q- titane ## TITANE   CEA ##
105#-Q- titane ######################
106#-Q- titane #MSUB -r ATL_ORCH       # Nom du job               
[544]107#-Q- titane #MSUB -eo
[222]108#-Q- titane #MSUB -n 1              # Reservation du processus
109#-Q- titane #MSUB -T 86400          # Limite de temps elapsed du job
[544]110#-Q- titane #MSUB -q mono
[643]111#-Q- titane #MSUB -E '-rn'
[281]112#-Q- lxiv8 ######################
113#-Q- lxiv8 ## OBELIX      LSCE ##
114#-Q- lxiv8 ######################
115#-Q- lxiv8 #PBS -N ATL_ORCH
116#-Q- lxiv8 #PBS -m a
117#-Q- lxiv8 #PBS -j oe
118#-Q- lxiv8 #PBS -q medium
119#-Q- lxiv8 #PBS -o ATL_ORCH.$$
120#-Q- lxiv8 #PBS -S /bin/ksh
[2]121#-Q- default #!/bin/ksh
122#-Q- default ##################
123#-Q- default ## DEFAULT HOST ##
124#-Q- default ##################
125
[373]126#**************************************************************
127# Author: Martial Mancip
128# Contact: Martial.Mancip__at__ipsl.jussieu.fr
129# $Revision::                                          $ Revision of last commit
130# $Author::                                            $ Author of last commit
131# $Date::                                              $ Date of last commit
[2]132# IPSL (2006)
133#  This software is governed by the CeCILL licence see libIGCM/libIGCM_CeCILL.LIC
[373]134#
135#**************************************************************
[2]136
[108]137#set -eu
138#set -vx
139
[2]140date
141
142#-Q- sx8brodie export OMP_NUM_THREADS=1
[108]143#-Q- aix6 export OMP_NUM_THREADS=1
[386]144#-Q- ulam export OMP_NUM_THREADS=1
[2]145
[712]146#D- Task type (computing or post-processing)
147TaskType=post-processing
148
[2]149########################################################################
150
[108]151. ${libIGCM}/libIGCM_debug/libIGCM_debug.ksh
152      ( ${DEBUG_debug} ) && IGCM_debug_Check
153. ${libIGCM}/libIGCM_card/libIGCM_card.ksh
154     ( ${DEBUG_debug} ) && IGCM_card_Check
155. ${libIGCM}/libIGCM_date/libIGCM_date.ksh
156     ( ${DEBUG_debug} ) && IGCM_date_Check
157#-------
158. ${libIGCM}/libIGCM_sys/libIGCM_sys.ksh
[2]159
160########################################################################
161
162#set -vx
163
[263]164IGCM_sys_MkdirWork ${RUN_DIR_PATH}
165IGCM_sys_Cd ${RUN_DIR_PATH}
166
[436]167# ------------------------------------------------------------------
168# Test if all was right before proceeding further
169# ------------------------------------------------------------------
170IGCM_debug_Verif_Exit_Post
171
[263]172if [ ${StandAlone} = true ] ; then
173    CARD_DIR=${SUBMIT_DIR}
174else
[647]175    CARD_DIR=${RUN_DIR_PATH}
[640]176    IGCM_sys_Get_Master ${SUBMIT_DIR}/config.card ${RUN_DIR_PATH}
177    IGCM_sys_Get_Master ${SUBMIT_DIR}/run.card    ${RUN_DIR_PATH}
178    IGCM_sys_Get_Master ${SUBMIT_DIR}/COMP        ${RUN_DIR_PATH}
179    IGCM_sys_Get_Master ${SUBMIT_DIR}/POST        ${RUN_DIR_PATH}
[263]180fi
181#
182# First of all
183#
184IGCM_card_DefineArrayFromSection       ${CARD_DIR}/config.card UserChoices
185typeset option
186for option in ${config_UserChoices[*]} ; do
187    IGCM_card_DefineVariableFromOption ${CARD_DIR}/config.card UserChoices ${option}
188done
[658]189
190IGCM_card_DefineArrayFromSection       ${CARD_DIR}/config.card Ensemble
191typeset option
192for option in ${config_Ensemble[*]} ; do
193    IGCM_card_DefineVariableFromOption ${CARD_DIR}/config.card Ensemble ${option}
194done
[263]195#
196echo
197IGCM_debug_Print 1 "DefineArrayFromOption  : config_UserChoices"
198IGCM_debug_PrintVariables 3 config_UserChoices_JobName
199IGCM_debug_PrintVariables 3 config_UserChoices_LongName
200IGCM_debug_PrintVariables 3 config_UserChoices_TagName
201IGCM_debug_PrintVariables 3 config_UserChoices_SpaceName
202IGCM_debug_PrintVariables 3 config_UserChoices_ExperimentName
203IGCM_debug_PrintVariables 3 config_UserChoices_CalendarType
204IGCM_debug_PrintVariables 3 config_UserChoices_DateBegin
205IGCM_debug_PrintVariables 3 config_UserChoices_DateEnd
206IGCM_debug_PrintVariables 3 config_UserChoices_PeriodLength
[658]207IGCM_debug_PrintVariables 3 config_Ensemble_EnsembleName
208IGCM_debug_PrintVariables 3 config_Ensemble_EnsembleDate
[263]209echo
210
211#==================================
212#R_SAVE : Job output directory
[546]213#R_BUFR : Job output buffered directory
[263]214if ( [ ! X${config_UserChoices_SpaceName} = X ] && [ ! X${config_UserChoices_ExperimentName} = X ] ) ; then
[658]215  FreeName=$( echo ${config_UserChoices_JobName} | sed 's/.*_//' )
216  if ( [ ! X${config_Ensemble_EnsembleName} = X ] && [ ! X${config_Ensemble_EnsembleDate} = X ] ) ; then
217    R_SAVE=${R_OUT}/${config_UserChoices_TagName}/${config_UserChoices_SpaceName}/${config_UserChoices_ExperimentName}/${config_Ensemble_EnsembleName}/${config_Ensemble_EnsembleDate}/${FreeName}
218    R_FIGR=${R_FIG}/${config_UserChoices_TagName}/${config_UserChoices_SpaceName}/${config_UserChoices_ExperimentName}/${config_Ensemble_EnsembleName}/${config_Ensemble_EnsembleDate}/${FreeName}
219    R_BUFR=${R_BUF}/${config_UserChoices_TagName}/${config_UserChoices_SpaceName}/${config_UserChoices_ExperimentName}/${config_Ensemble_EnsembleName}/${config_Ensemble_EnsembleDate}/${FreeName}
220    R_DODS=${config_UserChoices_TagName}/${config_UserChoices_SpaceName}/${config_UserChoices_ExperimentName}/${config_Ensemble_EnsembleName}/${config_Ensemble_EnsembleDate}/${FreeName}
221  else
[263]222    R_SAVE=${R_OUT}/${config_UserChoices_TagName}/${config_UserChoices_SpaceName}/${config_UserChoices_ExperimentName}/${FreeName}
[587]223    R_FIGR=${R_FIG}/${config_UserChoices_TagName}/${config_UserChoices_SpaceName}/${config_UserChoices_ExperimentName}/${FreeName}
[546]224    R_BUFR=${R_BUF}/${config_UserChoices_TagName}/${config_UserChoices_SpaceName}/${config_UserChoices_ExperimentName}/${FreeName}
[263]225    R_DODS=${config_UserChoices_TagName}/${config_UserChoices_SpaceName}/${config_UserChoices_ExperimentName}/${FreeName}
[658]226  fi
[263]227else
[658]228  if ( [ ! X${config_Ensemble_EnsembleName} = X ] && [ ! X${config_Ensemble_EnsembleDate} = X ] ) ; then
229    R_SAVE=${R_OUT}/${config_UserChoices_TagName}/${config_Ensemble_EnsembleName}/${config_Ensemble_EnsembleDate}/${config_UserChoices_JobName}
230    R_FIGR=${R_FIG}/${config_UserChoices_TagName}/${config_Ensemble_EnsembleName}/${config_Ensemble_EnsembleDate}/${config_UserChoices_JobName}
231    R_BUFR=${R_BUF}/${config_UserChoices_TagName}/${config_Ensemble_EnsembleName}/${config_Ensemble_EnsembleDate}/${config_UserChoices_JobName}
232    R_DODS=${config_UserChoices_TagName}/${config_Ensemble_EnsembleName}/${config_Ensemble_EnsembleDate}/${config_UserChoices_JobName}
233  else
[263]234    R_SAVE=${R_OUT}/${config_UserChoices_TagName}/${config_UserChoices_JobName}
[587]235    R_FIGR=${R_FIG}/${config_UserChoices_TagName}/${config_UserChoices_JobName}
[546]236    R_BUFR=${R_BUF}/${config_UserChoices_TagName}/${config_UserChoices_JobName}
[263]237    R_DODS=${config_UserChoices_TagName}/${config_UserChoices_JobName}
[658]238  fi
[263]239fi
240#
[591]241IGCM_sys_MkdirArchive ${R_FIGR}
[263]242
[2]243R_ATLAS=ATLAS/SE_${YEARS}
244R_OUT_SRF=${R_SAVE}/SRF
[370]245DIR_OUT=${DIR_OUT:=SE}
[2]246
247RUN_DIR=${RUN_DIR_PATH}/ATLAS_ORCHIDEE_${YEARS}
248IGCM_sys_MkdirWork ${RUN_DIR}
249IGCM_sys_Cd ${RUN_DIR}
250
251# --------------------------------------------
252# Insert your commands between III...III lines
253# and precise produced directories to save
254# IIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIII
255
[370]256IGCM_sys_Get ${R_OUT_SRF}/Analyse/${DIR_OUT}/${config_UserChoices_JobName}_SE_${YEARS}_1M_sechiba_history.nc ${RUN_DIR}
[2]257
258atlas -o ${RUN_DIR}/${R_ATLAS}/SRF -l ${FER_ATLAS}/atlas_p_ORCHIDEE_diag1_*.cfg \
259                                       ${FER_ATLAS}/atlas_p_SECHIBA_diag1_*.cfg \
260                                       ${FER_ATLAS}/atlas_p_ORCHIDEE_diag2_a.cfg  ${RUN_DIR}/${config_UserChoices_JobName}_SE_${YEARS}_1M_sechiba_history.nc
261
262# IIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIII
263
264# Put ferret journal files together
265for file in $( ls ${R_ATLAS}/SRF/*/*jnl ) ; do 
266    echo -e "\n\n################################" ;
267    echo -e "$file\n" ; cat $file ;
268done  > ${R_ATLAS}/SRF/allferretscript.txt
269
270# Clear some files
271find . \( -name "*.stdout" -o -name "*.jnl" \) -print -exec rm -f {} \;
272
273# Save files
[587]274IGCM_sys_Put_Dir ATLAS ${R_FIGR}
[2]275IGCM_sys_Rm -Rf ATLAS
276IGCM_sys_Rm ${config_UserChoices_JobName}_SE_${YEARS}_1M_sechiba_history.nc
277
278# DODS copy
[587]279IGCM_sys_TestDirArchive ${R_FIGR}/${R_ATLAS}
[67]280[ $? = 0 ] && IGCM_sys_Put_Dods ${R_ATLAS}
[203]281
[590]282# Clean RUN_DIR_PATH (necessary for cesium and titane only)
[203]283IGCM_sys_RmRunDir -Rf ${RUN_DIR_PATH}
Note: See TracBrowser for help on using the repository browser.