source: trunk/libIGCM/AA_atlas_LMDZ @ 544

Last change on this file since 544 was 544, checked in by sdipsl, 13 years ago
  • Prepare libIGCM for TGCC migration. For now work for CCRT machines ONLY
  • SX8, SX9 and Titane are independant from DMNFS
    • 30 seconds between execution instead of at least 3 minutes ; sometimes hours
  • SX8, SX9 and Titane use their SCRATCHDIR as a BUFFER (for restart and text)
  • Titane simulations are entirely post-processed on titane mono
    • Working except create_se and atlas (missing software : ncap2, openpbm, ImageMagick?)
  • Cards are the same up to now
  • New indentation to ease readability ("svn diff -x -b" to ignore space when differencing)
  • Project (gen2211) is inherited from AA_job by post-processing jobs
    • will stop during config_check if Project is empty
  • Prepare easy switching (submitting post-processing here or there)
  • Homogenize CCRTs libIGCM_sys
  • Bugfixes
  • Cosmetics

First steps and still a long way to go.

  • Property licence set to
    The following licence information concerns ONLY the libIGCM tools
    ==================================================================

    Copyright © Centre National de la Recherche Scientifique CNRS
    Commissariat à l'Énergie Atomique CEA

    libIGCM : Library for Portable Models Computation of IGCM Group.

    IGCM Group is the french IPSL Global Climate Model Group.

    This library is a set of shell scripts and functions whose purpose is
    the management of the initialization, the launch, the transfer of
    output files, the post-processing and the monitoring of datas produce
    by any numerical program on any plateforme.

    This software is governed by the CeCILL license under French law and
    abiding by the rules of distribution of free software. You can use,
    modify and/ or redistribute the software under the terms of the CeCILL
    license as circulated by CEA, CNRS and INRIA at the following URL
    "http://www.cecill.info".

    As a counterpart to the access to the source code and rights to copy,
    modify and redistribute granted by the license, users are provided only
    with a limited warranty and the software's author, the holder of the
    economic rights, and the successive licensors have only limited
    liability.

    In this respect, the user's attention is drawn to the risks associated
    with loading, using, modifying and/or developing or reproducing the
    software by the user in light of its specific status of free software,
    that may mean that it is complicated to manipulate, and that also
    therefore means that it is reserved for developers and experienced
    professionals having in-depth computer knowledge. Users are therefore
    encouraged to load and test the software's suitability as regards their
    requirements in conditions enabling the security of their systems and/or
    data to be ensured and, more generally, to use and operate it in the
    same conditions as regards security.

    The fact that you are presently reading this means that you have had
    knowledge of the CeCILL license and that you accept its terms.
  • Property svn:keywords set to Revision Author Date
File size: 9.6 KB
Line 
1#-Q- cesium #!/bin/ksh
2#-Q- cesium ######################
3#-Q- cesium ## CESIUM   CEA ##
4#-Q- cesium ######################
5#-Q- cesium #MSUB -r ATL_LMDZ       # Nom du job               
6#-Q- cesium #MSUB -N 1              # Reservation du noeud
7#-Q- cesium #MSUB -n 1              # Reservation du processus
8#-Q- cesium #MSUB -T 86400          # Limite de temps elapsed du job
9#-Q- cesium #MSUB -E "-j o"
10#-Q- cesium #MSUB -E "-S /bin/ksh"
11#-Q- platine #!/usr/bin/ksh
12#-Q- platine ##################
13#-Q- platine ## PLATINE   CEA ##
14#-Q- platine ##################
15#-Q- platine #BSUB -J ATL_LMDZ          # Nom du job
16#-Q- platine #BSUB -N                   # message a la fin du job
17#-Q- platine #BSUB -n 1                 # reservation des processeurs pour le job
18#-Q- platine #BSUB -W 1:00              # Limite temps
19#-Q- platine #BSUB -q post              # Passage en queue post
20#-Q- platine #BSUB -L /bin/ksh
21#-Q- sx8brodie #!/bin/ksh
22#-Q- sx8brodie #######################
23#-Q- sx8brodie ## SX8BRODIE   IDRIS ##
24#-Q- sx8brodie #######################
25#-Q- sx8brodie # Temps Elapsed max. d'une requete hh:mm:ss
26#-Q- sx8brodie # @ wall_clock_limit = 1:00:00
27#-Q- sx8brodie # Nom du travail LoadLeveler
28#-Q- sx8brodie # @ job_name   = ATL_LMDZ
29#-Q- sx8brodie # Fichier de sortie standard du travail       
30#-Q- sx8brodie # @ output     = $(job_name).$(jobid)
31#-Q- sx8brodie # Fichier de sortie d'erreur du travail
32#-Q- sx8brodie # @ error      =  $(job_name).$(jobid)
33#-Q- sx8brodie # pour recevoir un mail en cas de depassement du temps Elapsed (ou autre pb.)
34#-Q- sx8brodie # @ notification = error
35#-Q- sx8brodie # @ environment  = $POST_DIR ; $SUBMIT_DIR ; $libIGCM ; $R_INIT ; $R_BC ; $StandAlone ; $RESOL_ATM ; $RESOL_OCE ; $RESOL_ICE ; $RESOL_SRF ; $R_SAVE ; $config_UserChoices_JobName ; $config_UserChoices_TagName ; $YEARS ; $DIR_OUT ; $MASTER ; $libIGCM_SX
36#-Q- sx8brodie # @ queue
37#-Q- aix6 #!/bin/ksh
38#-Q- aix6 #######################
39#-Q- aix6 ##   VARGAS   IDRIS  ##
40#-Q- aix6 #######################
41#-Q- aix6 # Temps Elapsed max. d'une requete hh:mm:ss
42#-Q- aix6 # @ wall_clock_limit = 1:00:00
43#-Q- aix6 # Nom du travail LoadLeveler
44#-Q- aix6 # @ job_name   = ATL_LMDZ
45#-Q- aix6 # Fichier de sortie standard du travail       
46#-Q- aix6 # @ output     = $(job_name).$(jobid)
47#-Q- aix6 # Fichier de sortie d'erreur du travail
48#-Q- aix6 # @ error      =  $(job_name).$(jobid)
49#-Q- aix6 # pour recevoir un mail en cas de depassement du temps Elapsed (ou autre pb.)
50#-Q- aix6 # @ notification = error
51#-Q- aix6 # @ environment  = $POST_DIR ; $SUBMIT_DIR ; $libIGCM ; $R_INIT ; $R_BC ; $StandAlone ; $RESOL_ATM ; $RESOL_OCE ; $RESOL_ICE ; $RESOL_SRF ; $R_SAVE ; $config_UserChoices_JobName ; $config_UserChoices_TagName ; $YEARS ; $DIR_OUT ; $MASTER ; $libIGCM_SX
52#-Q- aix6 # @ queue
53#-Q- ulam #!/bin/ksh
54#-Q- ulam #######################
55#-Q- ulam ##   ULAM   IDRIS  ##
56#-Q- ulam #######################
57#-Q- ulam # Temps Elapsed max. d'une requete hh:mm:ss
58#-Q- ulam # @ wall_clock_limit = 1:00:00
59#-Q- ulam # Nom du travail LoadLeveler
60#-Q- ulam # @ job_name   = ATL_LMDZ
61#-Q- ulam # Fichier de sortie standard du travail       
62#-Q- ulam # @ output     = $(job_name).$(jobid)
63#-Q- ulam # Fichier de sortie d'erreur du travail
64#-Q- ulam # @ error      =  $(job_name).$(jobid)
65#-Q- ulam # pour recevoir un mail en cas de depassement du temps Elapsed (ou autre pb.)
66#-Q- ulam # @ notification = error
67#-Q- ulam # @ environment  = $POST_DIR ; $SUBMIT_DIR ; $libIGCM ; $R_INIT ; $R_BC ; $StandAlone ; $RESOL_ATM ; $RESOL_OCE ; $RESOL_ICE ; $RESOL_SRF ; $R_SAVE ; $config_UserChoices_JobName ; $config_UserChoices_TagName ; $YEARS ; $DIR_OUT ; $MASTER ; $libIGCM_SX
68#-Q- ulam # @ queue
69#-Q- sx8mercure #!/bin/ksh
70#-Q- sx8mercure ######################
71#-Q- sx8mercure ## SX8MERCURE   CEA ##
72#-Q- sx8mercure ######################
73#-Q- sx8mercure #PBS -N  ATL_LMDZ           # Nom du job
74#-Q- sx8mercure #PBS -j o                   # regroupement des stdout et stderr
75#-Q- sx8mercure #PBS -S /usr/bin/ksh        # shell de soumission
76#-Q- sx8mercure #PBS -l memsz_job=1gb       # Limite memoire a 1 Go
77#-Q- sx8mercure #PBS -l cputim_job=2:00:00  # Limite temps a 2 heures
78#-Q- sx8mercure #PBS -q scalaire
79#-Q- sx9mercure #!/bin/ksh
80#-Q- sx9mercure #########################
81#-Q- sx9mercure ## CESIUM FOR SX9  CEA ##
82#-Q- sx9mercure #########################
83#-Q- sx9mercure #MSUB -r ATL_LMDZ       # Nom du job               
84#-Q- sx9mercure #MSUB -N 1              # Reservation du noeud
85#-Q- sx9mercure #MSUB -n 1              # Reservation du processus
86#-Q- sx9mercure #MSUB -T 86400          # Limite de temps elapsed du job
87#-Q- sx9mercure #MSUB -E "-j o"
88#-Q- sx9mercure #MSUB -E "-S /bin/ksh"
89#-Q- titane #!/bin/ksh
90#-Q- titane ######################
91#-Q- titane ## TITANE   CEA ##
92#-Q- titane ######################
93#-Q- titane #MSUB -r ATL_LMDZ       # Nom du job               
94#-Q- titane #MSUB -eo
95#-Q- titane #MSUB -n 1              # Reservation du processus
96#-Q- titane #MSUB -T 86400          # Limite de temps elapsed du job
97#-Q- titane #MSUB -q mono
98#-Q- default #!/bin/ksh
99#-Q- default ##################
100#-Q- default ## DEFAULT HOST ##
101#-Q- default ##################
102
103#**************************************************************
104# Author: Sebastien Denvil
105# Contact: Sebastien.Denvil__at__ipsl.jussieu.fr
106# $Revision::                                          $ Revision of last commit
107# $Author::                                            $ Author of last commit
108# $Date::                                              $ Date of last commit
109# IPSL (2006)
110#  This software is governed by the CeCILL licence see libIGCM/libIGCM_CeCILL.LIC
111#
112#**************************************************************
113
114#set -eu
115#set -vx
116
117date
118
119#-Q- sx8brodie export OMP_NUM_THREADS=1
120#-Q- aix6 export OMP_NUM_THREADS=1
121#-Q- ulam export OMP_NUM_THREADS=1
122
123######################################################################
124
125. ${libIGCM}/libIGCM_debug/libIGCM_debug.ksh
126      ( ${DEBUG_debug} ) && IGCM_debug_Check
127. ${libIGCM}/libIGCM_card/libIGCM_card.ksh
128     ( ${DEBUG_debug} ) && IGCM_card_Check
129. ${libIGCM}/libIGCM_date/libIGCM_date.ksh
130     ( ${DEBUG_debug} ) && IGCM_date_Check
131#-------
132. ${libIGCM}/libIGCM_sys/libIGCM_sys.ksh
133
134######################################################################
135
136#set -vx
137
138IGCM_sys_MkdirWork ${RUN_DIR_PATH}
139IGCM_sys_Cd ${RUN_DIR_PATH}
140
141# ------------------------------------------------------------------
142# Test if all was right before proceeding further
143# ------------------------------------------------------------------
144IGCM_debug_Verif_Exit_Post
145
146if [ ${StandAlone} = true ] ; then
147    CARD_DIR=${SUBMIT_DIR}
148else
149    CARD_DIR=${RUN_DIR_PATH}/$( basename ${SUBMIT_DIR} )
150    IGCM_sys_Get_Master ${SUBMIT_DIR} ${RUN_DIR_PATH}
151fi
152#
153# First of all
154#
155IGCM_card_DefineArrayFromSection       ${CARD_DIR}/config.card UserChoices
156typeset option
157for option in ${config_UserChoices[*]} ; do
158    IGCM_card_DefineVariableFromOption ${CARD_DIR}/config.card UserChoices ${option}
159done
160
161#
162echo
163IGCM_debug_Print 1 "DefineArrayFromOption  : config_UserChoices"
164IGCM_debug_PrintVariables 3 config_UserChoices_JobName
165IGCM_debug_PrintVariables 3 config_UserChoices_LongName
166IGCM_debug_PrintVariables 3 config_UserChoices_TagName
167IGCM_debug_PrintVariables 3 config_UserChoices_SpaceName
168IGCM_debug_PrintVariables 3 config_UserChoices_ExperimentName
169IGCM_debug_PrintVariables 3 config_UserChoices_CalendarType
170IGCM_debug_PrintVariables 3 config_UserChoices_DateBegin
171IGCM_debug_PrintVariables 3 config_UserChoices_DateEnd
172IGCM_debug_PrintVariables 3 config_UserChoices_PeriodLength
173echo
174
175#==================================
176#R_SAVE : Job output directory
177if ( [ ! X${config_UserChoices_SpaceName} = X ] && [ ! X${config_UserChoices_ExperimentName} = X ] ) ; then
178    FreeName=$( echo ${config_UserChoices_JobName} | sed 's/.*_//' )
179    R_SAVE=${R_OUT}/${config_UserChoices_TagName}/${config_UserChoices_SpaceName}/${config_UserChoices_ExperimentName}/${FreeName}
180    R_DODS=${config_UserChoices_TagName}/${config_UserChoices_SpaceName}/${config_UserChoices_ExperimentName}/${FreeName}
181else
182    R_SAVE=${R_OUT}/${config_UserChoices_TagName}/${config_UserChoices_JobName}
183    R_DODS=${config_UserChoices_TagName}/${config_UserChoices_JobName}
184fi
185#
186
187R_ATLAS=ATLAS/SE_${YEARS}
188R_OUT_ATM=${R_SAVE}/ATM
189DIR_OUT=${DIR_OUT:=SE}
190
191RUN_DIR=${RUN_DIR_PATH}/ATLAS_LMDZ_${YEARS}
192IGCM_sys_MkdirWork ${RUN_DIR}
193IGCM_sys_Cd ${RUN_DIR}
194
195# --------------------------------------------
196# Insert your commands between III...III lines
197# and precise produced directories to save
198# IIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIII
199
200IGCM_sys_Get ${R_OUT_ATM}/Analyse/${DIR_OUT}/${config_UserChoices_JobName}_SE_${YEARS}_1M_histmth.nc ${RUN_DIR}
201
202# Only LMDZ4 output have Alt variables
203DetectLev=$( ncdump -h ${config_UserChoices_JobName}_SE_${YEARS}_1M_histmth.nc | grep "Alt(Alt)" | wc -l )
204#
205[ ${DetectLev} = 1 ] && LMDZ=LMDZ4 || LMDZ=LMDZ3.3
206#
207atlas -o ${RUN_DIR}/${R_ATLAS}/ATM -l ${FER_ATLAS}/atlas_p_${LMDZ}_diag1_*.cfg ${RUN_DIR}/${config_UserChoices_JobName}_SE_${YEARS}_1M_histmth.nc
208
209# IIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIII
210
211# Put ferret journal files together
212for file in $( ls ${R_ATLAS}/ATM/*/*jnl ) ; do 
213    echo -e "\n\n################################" ;
214    echo -e "$file\n" ; cat $file ;
215done  > ${R_ATLAS}/ATM/allferretscript.txt
216
217# Clear some files
218find . \( -name "*.stdout" -o -name "*.jnl" \) -print -exec rm -f {} \;
219
220# Save files
221IGCM_sys_Put_Dir ATLAS ${R_SAVE}
222IGCM_sys_Rm -Rf ATLAS
223IGCM_sys_Rm ${config_UserChoices_JobName}_SE_${YEARS}_1M_histmth.nc
224
225# DODS copy
226IGCM_sys_TestDirArchive ${R_SAVE}/${R_ATLAS}
227[ $? = 0 ] && IGCM_sys_Put_Dods ${R_ATLAS}
228
229# Clean RUN_DIR_PATH (necessary for cesium)
230IGCM_sys_RmRunDir -Rf ${RUN_DIR_PATH}
Note: See TracBrowser for help on using the repository browser.