source: trunk/libIGCM/AA_atlas_ORCA_LIM @ 590

Last change on this file since 590 was 590, checked in by sdipsl, 12 years ago
  • can extract needed restart from a tar (up to 20 minutes on titane)
    • still to do : introduce a lag when cleaning the restart buffer so that we don't look into the tar too often
    • still to do : work on the clean_month procedure
  • rebuild process submit pack_output process if needed
    • still to do : a pack_output able to submit create_ts/create_se if needed
  • bugfixes/cosmetics/cleaning
  • SX9 and titane OK.
  • Property licence set to
    The following licence information concerns ONLY the libIGCM tools
    ==================================================================

    Copyright © Centre National de la Recherche Scientifique CNRS
    Commissariat à l'Énergie Atomique CEA

    libIGCM : Library for Portable Models Computation of IGCM Group.

    IGCM Group is the french IPSL Global Climate Model Group.

    This library is a set of shell scripts and functions whose purpose is
    the management of the initialization, the launch, the transfer of
    output files, the post-processing and the monitoring of datas produce
    by any numerical program on any plateforme.

    This software is governed by the CeCILL license under French law and
    abiding by the rules of distribution of free software. You can use,
    modify and/ or redistribute the software under the terms of the CeCILL
    license as circulated by CEA, CNRS and INRIA at the following URL
    "http://www.cecill.info".

    As a counterpart to the access to the source code and rights to copy,
    modify and redistribute granted by the license, users are provided only
    with a limited warranty and the software's author, the holder of the
    economic rights, and the successive licensors have only limited
    liability.

    In this respect, the user's attention is drawn to the risks associated
    with loading, using, modifying and/or developing or reproducing the
    software by the user in light of its specific status of free software,
    that may mean that it is complicated to manipulate, and that also
    therefore means that it is reserved for developers and experienced
    professionals having in-depth computer knowledge. Users are therefore
    encouraged to load and test the software's suitability as regards their
    requirements in conditions enabling the security of their systems and/or
    data to be ensured and, more generally, to use and operate it in the
    same conditions as regards security.

    The fact that you are presently reading this means that you have had
    knowledge of the CeCILL license and that you accept its terms.
  • Property svn:keywords set to Revision Author Date
File size: 13.1 KB
RevLine 
[314]1#-Q- cesium #!/bin/ksh
2#-Q- cesium ######################
3#-Q- cesium ## CESIUM   CEA ##
4#-Q- cesium ######################
5#-Q- cesium #MSUB -r ATL_OPA        # Nom du job               
6#-Q- cesium #MSUB -N 1              # Reservation du noeud
7#-Q- cesium #MSUB -n 1              # Reservation du processus
8#-Q- cesium #MSUB -T 86400          # Limite de temps elapsed du job
9#-Q- cesium #MSUB -E "-j o"
10#-Q- cesium #MSUB -E "-S /bin/ksh"
[2]11#-Q- platine #!/usr/bin/ksh
12#-Q- platine ##################
13#-Q- platine ## PLATINE   CEA ##
14#-Q- platine ##################
15#-Q- platine #BSUB -J ATL_OPA           # Nom du job
16#-Q- platine #BSUB -N                   # message a la fin du job
17#-Q- platine #BSUB -n 1                 # reservation des processeurs pour le job
18#-Q- platine #BSUB -W 1:00              # Limite temps
[18]19#-Q- platine #BSUB -q post              # Passage en queue post
[426]20#-Q- platine #BSUB -L /bin/ksh
[59]21#-Q- sx8brodie #!/bin/ksh
[2]22#-Q- sx8brodie #######################
23#-Q- sx8brodie ## SX8BRODIE   IDRIS ##
24#-Q- sx8brodie #######################
[58]25#-Q- sx8brodie # Temps Elapsed max. d'une requete hh:mm:ss
[518]26#-Q- sx8brodie # @ wall_clock_limit = 2:00:00
[58]27#-Q- sx8brodie # Nom du travail LoadLeveler
[60]28#-Q- sx8brodie # @ job_name   = ATL_OPA
[58]29#-Q- sx8brodie # Fichier de sortie standard du travail       
30#-Q- sx8brodie # @ output     = $(job_name).$(jobid)
31#-Q- sx8brodie # Fichier de sortie d'erreur du travail
32#-Q- sx8brodie # @ error      =  $(job_name).$(jobid)
33#-Q- sx8brodie # pour recevoir un mail en cas de depassement du temps Elapsed (ou autre pb.)
34#-Q- sx8brodie # @ notification = error
[370]35#-Q- sx8brodie # @ environment  = $POST_DIR ; $SUBMIT_DIR ; $libIGCM ; $R_INIT ; $R_BC ; $StandAlone ; $RESOL_ATM ; $RESOL_OCE ; $RESOL_ICE ; $RESOL_MBG ; $RESOL_SRF ; $R_SAVE ; $config_UserChoices_JobName ; $config_UserChoices_TagName ; $YEARS ; $DIR_OUT ; $MASTER ; $libIGCM_SX
[58]36#-Q- sx8brodie # @ queue
[68]37#-Q- aix6 #!/bin/ksh
38#-Q- aix6 #######################
39#-Q- aix6 ##   VARGAS   IDRIS  ##
40#-Q- aix6 #######################
41#-Q- aix6 # Temps Elapsed max. d'une requete hh:mm:ss
[518]42#-Q- aix6 # @ wall_clock_limit = 2:00:00
[68]43#-Q- aix6 # Nom du travail LoadLeveler
44#-Q- aix6 # @ job_name   = ATL_OPA
45#-Q- aix6 # Fichier de sortie standard du travail       
46#-Q- aix6 # @ output     = $(job_name).$(jobid)
47#-Q- aix6 # Fichier de sortie d'erreur du travail
48#-Q- aix6 # @ error      =  $(job_name).$(jobid)
49#-Q- aix6 # pour recevoir un mail en cas de depassement du temps Elapsed (ou autre pb.)
50#-Q- aix6 # @ notification = error
[370]51#-Q- aix6 # @ environment  = $POST_DIR ; $SUBMIT_DIR ; $libIGCM ; $R_INIT ; $R_BC ; $StandAlone ; $RESOL_ATM ; $RESOL_OCE ; $RESOL_ICE ; $RESOL_MBG ; $RESOL_SRF ; $R_SAVE ; $config_UserChoices_JobName ; $config_UserChoices_TagName ; $YEARS ; $DIR_OUT ; $MASTER ; $libIGCM_SX
[68]52#-Q- aix6 # @ queue
[386]53#-Q- ulam #!/bin/ksh
54#-Q- ulam #######################
55#-Q- ulam ##   ULAM   IDRIS  ##
56#-Q- ulam #######################
57#-Q- ulam # Temps Elapsed max. d'une requete hh:mm:ss
[518]58#-Q- ulam # @ wall_clock_limit = 2:00:00
[386]59#-Q- ulam # Nom du travail LoadLeveler
60#-Q- ulam # @ job_name   = ATL_OPA
61#-Q- ulam # Fichier de sortie standard du travail       
62#-Q- ulam # @ output     = $(job_name).$(jobid)
63#-Q- ulam # Fichier de sortie d'erreur du travail
64#-Q- ulam # @ error      =  $(job_name).$(jobid)
65#-Q- ulam # pour recevoir un mail en cas de depassement du temps Elapsed (ou autre pb.)
66#-Q- ulam # @ notification = error
67#-Q- ulam # @ environment  = $POST_DIR ; $SUBMIT_DIR ; $libIGCM ; $R_INIT ; $R_BC ; $StandAlone ; $RESOL_ATM ; $RESOL_OCE ; $RESOL_ICE ; $RESOL_MBG ; $RESOL_SRF ; $R_SAVE ; $config_UserChoices_JobName ; $config_UserChoices_TagName ; $YEARS ; $DIR_OUT ; $MASTER ; $libIGCM_SX
68#-Q- ulam # @ queue
[2]69#-Q- sx8mercure #!/bin/ksh
70#-Q- sx8mercure ######################
71#-Q- sx8mercure ## SX8MERCURE   CEA ##
72#-Q- sx8mercure ######################
73#-Q- sx8mercure #PBS -N  ATL_OPA             # Nom du job
74#-Q- sx8mercure #PBS -j o                    # regroupement des stdout et stderr
75#-Q- sx8mercure #PBS -S /usr/bin/ksh         # shell de soumission
76#-Q- sx8mercure #PBS -l memsz_job=1gb        # Limite memoire a 1 Go
77#-Q- sx8mercure #PBS -l cputim_job=2:00:00   # Limite temps a 2 heures
[299]78#-Q- sx8mercure #PBS -q scalaire
[172]79#-Q- sx9mercure #!/bin/ksh
[316]80#-Q- sx9mercure #########################
81#-Q- sx9mercure ## CESIUM FOR SX9  CEA ##
82#-Q- sx9mercure #########################
83#-Q- sx9mercure #MSUB -r ATL_OPA        # Nom du job               
84#-Q- sx9mercure #MSUB -N 1              # Reservation du noeud
85#-Q- sx9mercure #MSUB -n 1              # Reservation du processus
86#-Q- sx9mercure #MSUB -T 86400          # Limite de temps elapsed du job
87#-Q- sx9mercure #MSUB -E "-j o"
88#-Q- sx9mercure #MSUB -E "-S /bin/ksh"
[222]89#-Q- titane #!/bin/ksh
90#-Q- titane ######################
91#-Q- titane ## TITANE   CEA ##
92#-Q- titane ######################
93#-Q- titane #MSUB -r ATL_OPA        # Nom du job               
[544]94#-Q- titane #MSUB -eo
[222]95#-Q- titane #MSUB -n 1              # Reservation du processus
96#-Q- titane #MSUB -T 86400          # Limite de temps elapsed du job
[544]97#-Q- titane #MSUB -q mono
[2]98#-Q- default #!/bin/ksh
99#-Q- default ##################
100#-Q- default ## DEFAULT HOST ##
101#-Q- default ##################
102
[373]103#**************************************************************
104# Author: Sebastien Denvil
105# Contact: Sebastien.Denvil__at__ipsl.jussieu.fr
106# $Revision::                                          $ Revision of last commit
107# $Author::                                            $ Author of last commit
108# $Date::                                              $ Date of last commit
[2]109# IPSL (2006)
110#  This software is governed by the CeCILL licence see libIGCM/libIGCM_CeCILL.LIC
[373]111#
112#**************************************************************
[2]113
[108]114#set -eu
[2]115#set -vx
116
117date
118
119#-Q- sx8brodie export OMP_NUM_THREADS=1
[108]120#-Q- aix6 export OMP_NUM_THREADS=1
[386]121#-Q- ulam export OMP_NUM_THREADS=1
[2]122
123########################################################################
124
[108]125. ${libIGCM}/libIGCM_debug/libIGCM_debug.ksh
126      ( ${DEBUG_debug} ) && IGCM_debug_Check
127. ${libIGCM}/libIGCM_card/libIGCM_card.ksh
128     ( ${DEBUG_debug} ) && IGCM_card_Check
129. ${libIGCM}/libIGCM_date/libIGCM_date.ksh
130     ( ${DEBUG_debug} ) && IGCM_date_Check
131#-------
132. ${libIGCM}/libIGCM_sys/libIGCM_sys.ksh
[2]133
134########################################################################
135
136#set -vx
137
[263]138IGCM_sys_MkdirWork ${RUN_DIR_PATH}
139IGCM_sys_Cd ${RUN_DIR_PATH}
140
[436]141# ------------------------------------------------------------------
142# Test if all was right before proceeding further
143# ------------------------------------------------------------------
144IGCM_debug_Verif_Exit_Post
145
[263]146if [ ${StandAlone} = true ] ; then
147    CARD_DIR=${SUBMIT_DIR}
148else
149    CARD_DIR=${RUN_DIR_PATH}/$( basename ${SUBMIT_DIR} )
150    IGCM_sys_Get_Master ${SUBMIT_DIR} ${RUN_DIR_PATH}
151fi
152#
153# First of all
154#
155IGCM_card_DefineArrayFromSection       ${CARD_DIR}/config.card UserChoices
156typeset option
157for option in ${config_UserChoices[*]} ; do
158    IGCM_card_DefineVariableFromOption ${CARD_DIR}/config.card UserChoices ${option}
159done
160#
161echo
162IGCM_debug_Print 1 "DefineArrayFromOption  : config_UserChoices"
163IGCM_debug_PrintVariables 3 config_UserChoices_JobName
164IGCM_debug_PrintVariables 3 config_UserChoices_LongName
165IGCM_debug_PrintVariables 3 config_UserChoices_TagName
166IGCM_debug_PrintVariables 3 config_UserChoices_SpaceName
167IGCM_debug_PrintVariables 3 config_UserChoices_ExperimentName
168IGCM_debug_PrintVariables 3 config_UserChoices_CalendarType
169IGCM_debug_PrintVariables 3 config_UserChoices_DateBegin
170IGCM_debug_PrintVariables 3 config_UserChoices_DateEnd
171IGCM_debug_PrintVariables 3 config_UserChoices_PeriodLength
172echo
173
174#==================================
175#R_SAVE : Job output directory
[546]176#R_BUFR : Job output buffered directory
[263]177if ( [ ! X${config_UserChoices_SpaceName} = X ] && [ ! X${config_UserChoices_ExperimentName} = X ] ) ; then
178    FreeName=$( echo ${config_UserChoices_JobName} | sed 's/.*_//' )
179    R_SAVE=${R_OUT}/${config_UserChoices_TagName}/${config_UserChoices_SpaceName}/${config_UserChoices_ExperimentName}/${FreeName}
[587]180    R_FIGR=${R_FIG}/${config_UserChoices_TagName}/${config_UserChoices_SpaceName}/${config_UserChoices_ExperimentName}/${FreeName}
[546]181    R_BUFR=${R_BUF}/${config_UserChoices_TagName}/${config_UserChoices_SpaceName}/${config_UserChoices_ExperimentName}/${FreeName}
[263]182    R_DODS=${config_UserChoices_TagName}/${config_UserChoices_SpaceName}/${config_UserChoices_ExperimentName}/${FreeName}
183else
184    R_SAVE=${R_OUT}/${config_UserChoices_TagName}/${config_UserChoices_JobName}
[587]185    R_FIGR=${R_FIG}/${config_UserChoices_TagName}/${config_UserChoices_JobName}
[546]186    R_BUFR=${R_BUF}/${config_UserChoices_TagName}/${config_UserChoices_JobName}
[263]187    R_DODS=${config_UserChoices_TagName}/${config_UserChoices_JobName}
188fi
189#
190
[2]191R_ATLAS=ATLAS/SE_${YEARS}
192R_OUT_OCE=${R_SAVE}/OCE
193R_OUT_ICE=${R_SAVE}/ICE
[370]194DIR_OUT=${DIR_OUT:=SE}
[2]195
[34]196RUN_DIR=${RUN_DIR_PATH}/ATLAS_ORCALIM_${YEARS}
197IGCM_sys_MkdirWork ${RUN_DIR}
198IGCM_sys_Cd ${RUN_DIR}
[2]199
200# --------------------------------------------
201# Insert your commands between III...III lines
202# and precise produced directories to save
203# IIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIII
204
[370]205IGCM_sys_Get ${R_OUT_OCE}/Analyse/${DIR_OUT}/${config_UserChoices_JobName}_SE_${YEARS}_1M_grid_T.nc  ${RUN_DIR}
206IGCM_sys_Get ${R_OUT_OCE}/Analyse/${DIR_OUT}/${config_UserChoices_JobName}_SE_${YEARS}_1M_grid_U.nc  ${RUN_DIR}
207IGCM_sys_Get ${R_OUT_OCE}/Analyse/${DIR_OUT}/${config_UserChoices_JobName}_SE_${YEARS}_1M_grid_V.nc  ${RUN_DIR}
208IGCM_sys_Get ${R_OUT_OCE}/Analyse/${DIR_OUT}/${config_UserChoices_JobName}_SE_${YEARS}_1M_grid_W.nc  ${RUN_DIR}
209IGCM_sys_Get ${R_OUT_ICE}/Analyse/${DIR_OUT}/${config_UserChoices_JobName}_SE_${YEARS}_1M_icemod.nc  ${RUN_DIR}
[2]210
[470]211atlas -o ${RUN_DIR}/${R_ATLAS}/OCE_T -l ${FER_ATLAS}/atlas_p_${RESOL_OCE}_diag1_[abc].cfg     ${RUN_DIR}/${config_UserChoices_JobName}_SE_${YEARS}_1M_grid_T.nc
[34]212atlas -o ${RUN_DIR}/${R_ATLAS}/OCE_U -l ${FER_ATLAS}/atlas_p_${RESOL_OCE}_diag0_U.cfg        ${RUN_DIR}/${config_UserChoices_JobName}_SE_${YEARS}_1M_grid_U.nc
213atlas -o ${RUN_DIR}/${R_ATLAS}/OCE_V -l ${FER_ATLAS}/atlas_p_${RESOL_OCE}_diag0_V.cfg        ${RUN_DIR}/${config_UserChoices_JobName}_SE_${YEARS}_1M_grid_V.nc
214#atlas -o ${RUN_DIR}/${R_ATLAS}/OCE_W -l ${FER_ATLAS}/atlas_p_${RESOL_OCE}_diag0_W.cfg        ${RUN_DIR}/${config_UserChoices_JobName}_SE_${YEARS}_1M_grid_W.nc
[470]215atlas -o ${RUN_DIR}/${R_ATLAS}/OCE   -l ${FER_ATLAS}/atlas_p_${RESOL_OCE}_diag0_[defg].cfg     ${RUN_DIR}/${config_UserChoices_JobName}_SE_${YEARS}_1M_grid_T.nc
[34]216atlas -o ${RUN_DIR}/${R_ATLAS}/ICE   -l ${FER_ATLAS}/atlas_p_${RESOL_OCE}LIM_diag0_[abc].cfg ${RUN_DIR}/${config_UserChoices_JobName}_SE_${YEARS}_1M_icemod.nc
[2]217
218# IIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIII
219
220# Put ferret journal files together
221for file in $( ls ${R_ATLAS}/OCE_T/*/*jnl ) ; do 
222    echo -e "\n\n################################" ;
223    echo -e "$file\n" ; cat $file ;
224done  > ${R_ATLAS}/OCE_T/allferretscript.txt
225
226for file in $( ls ${R_ATLAS}/OCE_U/*/*jnl ) ; do 
227    echo -e "\n\n################################" ;
228    echo -e "$file\n" ; cat $file ;
229done  > ${R_ATLAS}/OCE_U/allferretscript.txt
230
231for file in $( ls ${R_ATLAS}/OCE_V/*/*jnl ) ; do 
232    echo -e "\n\n################################" ;
233    echo -e "$file\n" ; cat $file ;
234done  > ${R_ATLAS}/OCE_V/allferretscript.txt
235
236for file in $( ls ${R_ATLAS}/OCE/*/*jnl ) ; do 
237    echo -e "\n\n################################" ;
238    echo -e "$file\n" ; cat $file ;
239done  > ${R_ATLAS}/OCE/allferretscript.txt
240
241for file in $( ls ${R_ATLAS}/ICE/*/*jnl ) ; do 
242    echo -e "\n\n################################" ;
243    echo -e "$file\n" ; cat $file ;
244done  > ${R_ATLAS}/ICE/allferretscript.txt
245
[74]246# WHILE WAITING FOR A MORE GENERIC SOLUTION
[367]247if ( [ ${config_UserChoices_TagName} = "IPSLCM5" ] || [ ${config_UserChoices_TagName} = "IPSLCM5A" ] || [ ${config_UserChoices_TagName} = "IPSLCM5A-MR" ] || [ ${config_UserChoices_TagName} = "ORCA2_LIM2" ] || [ ${config_UserChoices_TagName} = "ORCA2_LIM2_PISCES" ] ) ; then
[370]248    IGCM_sys_Get ${R_OUT_OCE}/Analyse/${DIR_OUT}/${config_UserChoices_JobName}_SE_${YEARS}_1M_diaptr.nc  ${RUN_DIR} ;
[74]249    atlas -o ${RUN_DIR}/${R_ATLAS}/ZNL   -d -l ${FER_ATLAS}/atlas_l_${RESOL_OCE}_znl.cfg         ${RUN_DIR}/${config_UserChoices_JobName}_SE_${YEARS}_1M_diaptr.nc ;
250    for file in $( ls ${R_ATLAS}/ZNL/*/*jnl ) ; do
251        echo -e "\n\n################################" ;
252        echo -e "$file\n" ; cat $file ;
[165]253    done > ${R_ATLAS}/ZNL/allferretscript.txt
[74]254fi
255
[2]256# Clear some files
257find . \( -name "*.stdout" -o -name "*.jnl" \) -print -exec rm -f {} \;
258
259# Save files
[587]260IGCM_sys_Put_Dir ATLAS ${R_FIGR}
[2]261
262IGCM_sys_Rm -Rf ATLAS
263IGCM_sys_Rm ${config_UserChoices_JobName}_SE_${YEARS}_1M_grid_[TUVW].nc
264IGCM_sys_Rm ${config_UserChoices_JobName}_SE_${YEARS}_1M_icemod.nc     
[74]265# WHILE WAITING FOR A MORE GENERIC SOLUTION
[367]266if ( [ ${config_UserChoices_TagName} = "IPSLCM5" ] || [ ${config_UserChoices_TagName} = "IPSLCM5A" ] || [ ${config_UserChoices_TagName} = "IPSLCM5A-MR" ] || [ ${config_UserChoices_TagName} = "ORCA2_LIM2" ] || [ ${config_UserChoices_TagName} = "ORCA2_LIM2_PISCES" ] ) ; then
[74]267    IGCM_sys_Rm ${config_UserChoices_JobName}_SE_${YEARS}_1M_diaptr.nc ;
268fi
[2]269
270# DODS copy
[587]271IGCM_sys_TestDirArchive ${R_FIGR}/${R_ATLAS}
[67]272[ $? = 0 ] && IGCM_sys_Put_Dods ${R_ATLAS}
[203]273
[590]274# Clean RUN_DIR_PATH (necessary for cesium and titane only)
[203]275IGCM_sys_RmRunDir -Rf ${RUN_DIR_PATH}
Note: See TracBrowser for help on using the repository browser.