Context Navigation

← Previous Revision
Latest Revision
Next Revision →
Blame
Revision Log

libIGCM_config.ksh @ 1435

Last change on this file since 1435 was 661, checked in by acosce, 12 years ago

BugFix? for inca config

1- management of two executable with only one launch (inca individual case)
2- refine restart list and will find restart with different extension (.nc, .txt etc...)

Property licence set to
The following licence information concerns ONLY the libIGCM tools
==================================================================

Copyright © Centre National de la Recherche Scientifique CNRS
Commissariat à l'Énergie Atomique CEA

libIGCM : Library for Portable Models Computation of IGCM Group.

IGCM Group is the french IPSL Global Climate Model Group.

This library is a set of shell scripts and functions whose purpose is
the management of the initialization, the launch, the transfer of
output files, the post-processing and the monitoring of datas produce
by any numerical program on any plateforme.

This software is governed by the CeCILL license under French law and
abiding by the rules of distribution of free software. You can use,
modify and/ or redistribute the software under the terms of the CeCILL
license as circulated by CEA, CNRS and INRIA at the following URL
"http://www.cecill.info".

As a counterpart to the access to the source code and rights to copy,
modify and redistribute granted by the license, users are provided only
with a limited warranty and the software's author, the holder of the
economic rights, and the successive licensors have only limited
liability.

In this respect, the user's attention is drawn to the risks associated
with loading, using, modifying and/or developing or reproducing the
software by the user in light of its specific status of free software,
that may mean that it is complicated to manipulate, and that also
therefore means that it is reserved for developers and experienced
professionals having in-depth computer knowledge. Users are therefore
encouraged to load and test the software's suitability as regards their
requirements in conditions enabling the security of their systems and/or
data to be ensured and, more generally, to use and operate it in the
same conditions as regards security.

The fact that you are presently reading this means that you have had
knowledge of the CeCILL license and that you accept its terms.
Property svn:keywords set to Revision Author Date

File size: 44.0 KB

Line
1	#!/bin/ksh
2
3	#**************************************************************
4	# Author: Sebastien Denvil, Martial Mancip
5	# Contact: Sebastien.Denvil__at__ipsl.jussieu.fr Martial.Mancip__at__ipsl.jussieu.fr
6	# $Revision:: $ Revision of last commit
7	# $Author:: $ Author of last commit
8	# $Date:: $ Date of last commit
9	# IPSL (2006)
10	# This software is governed by the CeCILL licence see libIGCM/libIGCM_CeCILL.LIC
11	#
12	#**************************************************************
13
14	#===================================
15	function IGCM_config_Initialize
16	{
17	IGCM_debug_PushStack "IGCM_config_Initialize"
18
19	# Debug Print :
20	echo
21	IGCM_debug_Print 1 "IGCM_config_Initialize"
22
23	if [ ! -r ${SUBMIT_DIR}/run.card ]; then
24	#================================================#
25	# The file run.card doesn't exist #
26	#================================================#
27	FirstInitialize=true
28	#copy initial run.card
29	IGCM_sys_Cp ${SUBMIT_DIR}/run.card.init ${SUBMIT_DIR}/run.card
30	IGCM_debug_Print 2 "run.card copied from run.card.init"
31	else
32	FirstInitialize=false
33	IGCM_debug_Print 2 "run.card exists"
34	fi
35
36	# Test modipsl tree existence.
37	IGCM_sys_TestDir ${MODIPSL}
38	[ $? != 0 ] && IGCM_debug_Exit "IGCM_sys_TestDir"
39	IGCM_sys_TestDir ${libIGCM}
40	[ $? != 0 ] && IGCM_debug_Exit "IGCM_sys_TestDir"
41	IGCM_sys_TestDir ${R_EXE}
42	[ $? != 0 ] && IGCM_debug_Exit "IGCM_sys_TestDir"
43	IGCM_sys_TestDir ${SUBMIT_DIR}
44	[ $? != 0 ] && IGCM_debug_Exit "IGCM_sys_TestDir"
45
46	if ( $DEBUG_debug ) ; then
47	echo "Keep trace of inital SUBMIT_DIR : "
48	ls -lta ${SUBMIT_DIR}
49	fi
50
51	#==================================
52
53	typeset option auxprint CompatibilityTag
54	# Read libIGCM compatibility version in config.card
55	IGCM_card_DefineVariableFromOption ${SUBMIT_DIR}/config.card Compatibility libIGCM
56	eval CompatibilityTag=${config_Compatibility_libIGCM} > /dev/null 2>&1
57
58	if [ ! "${CompatibilityTag}" = "${libIGCM_CurrentTag}" ] ; then
59	IGCM_debug_Exit "config.card is not compatible with libIGCM version ${libIGCM_CurrentTag} see libIGCM FAQ http://wiki.ipsl.jussieu.fr/wiki_ipsl/IGCMG/libIGCM/DocUtilisateur/FAQ ."
60	fi
61
62	#==================================
63	# Read UserChoices section:
64	IGCM_card_DefineArrayFromSection ${SUBMIT_DIR}/config.card UserChoices
65
66	for option in ${config_UserChoices[*]} ; do
67	IGCM_card_DefineVariableFromOption ${SUBMIT_DIR}/config.card UserChoices ${option}
68	done
69	echo
70	IGCM_debug_Print 1 "DefineArrayFromOption : config_UserChoices"
71	# Name Space of this experience
72	if [ X${config_UserChoices_SpaceName} != X ] ; then
73	IGCM_debug_PrintVariables 3 config_UserChoices_SpaceName
74	fi
75	# Expericence class of the run
76	if [ X${config_UserChoices_ExperimentName} != X ] ; then
77	IGCM_debug_PrintVariables 3 config_UserChoices_ExperimentName
78	fi
79	IGCM_debug_PrintVariables 3 config_UserChoices_JobName
80	if [ 3 -le ${Verbosity} ] ; then
81	echo "--------------Debug3-->" "config_UserChoices_LongName="
82	echo "--------------Debug3-->" \"${config_UserChoices_LongName}\"
83	fi
84	IGCM_debug_PrintVariables 3 config_UserChoices_TagName
85	IGCM_debug_PrintVariables 3 config_UserChoices_CalendarType
86	IGCM_debug_PrintVariables 3 config_UserChoices_DateBegin
87	IGCM_debug_PrintVariables 3 config_UserChoices_DateEnd
88	IGCM_debug_PrintVariables 3 config_UserChoices_PeriodLength
89
90	#==================================
91	# Read Post section:
92	IGCM_card_DefineArrayFromSection ${SUBMIT_DIR}/config.card Post
93	echo
94	IGCM_debug_Print 1 "DefineArrayFromOption : config_Post"
95
96	for option in ${config_Post[*]} ; do
97	IGCM_card_DefineVariableFromOption ${SUBMIT_DIR}/config.card Post ${option}
98	eval auxprint=\${config_Post_${option}}
99	IGCM_debug_Print 3 "${option} : ${auxprint}"
100	done
101
102	#==================================
103	# Define default value to keep compatibility with previous card: means before changes due to TGCC
104	if [ X${PackDefault} = Xtrue ] ; then
105	[ X${config_Post_PackFrequency} = X ] && config_Post_PackFrequency=${config_Post_RebuildFrequency}
106	else
107	config_Post_PackFrequency=NONE
108	fi
109
110	#==================================
111	# Read ListOfComponents section:
112	IGCM_card_DefineArrayFromSection ${SUBMIT_DIR}/config.card ListOfComponents
113	for comp in ${config_ListOfComponents[*]} ; do
114	IGCM_card_DefineArrayFromOption ${SUBMIT_DIR}/config.card ListOfComponents ${comp}
115	done
116
117	echo
118	IGCM_debug_Print 1 "DefineArrayFromSection : ListOfComponents"
119	IGCM_debug_Print 3 ${config_ListOfComponents[*]}
120
121	NbComponents=${#config_ListOfComponents[*]}
122
123	#==================================
124	# Define principal executable
125	IGCM_card_DefineArrayFromSection ${SUBMIT_DIR}/config.card Executable
126	IGCM_card_DefineVariableFromOption ${SUBMIT_DIR}/config.card Executable Name
127
128	#==================================
129	# Define Outputs Name
130	IGCM_debug_Print 2 "Define Script_Output_Prefix and Exe_Output"
131	eval Script_Output_Prefix=${config_UserChoices_Script_Output_Prefix:='Script_Output'}
132	IGCM_debug_Print 3 "Script_Output_Prefix = ${Script_Output_Prefix}"
133	eval Exe_Output=out_${config_Executable_Name}
134	IGCM_debug_Print 3 "Exe_Output = ${Exe_Output}"
135
136	#===================================================================#
137	# Prepare variables available for ${COMP}.card and ${COMP}.driver #
138	# But available to any son functions #
139	#===================================================================#
140
141	# Convert yyyy-mm-dd date to gregorian yyyymmdd
142	DateBegin=$( IGCM_date_ConvertFormatToGregorian ${config_UserChoices_DateBegin} )
143	DateEnd=$( IGCM_date_ConvertFormatToGregorian ${config_UserChoices_DateEnd} )
144
145	# Period Length In Days between DateBegin and DateEnd
146	(( ExperienceLengthInDays=$( IGCM_date_DaysBetweenGregorianDate ${DateEnd} ${DateBegin} ) + 1 ))
147	if [ ${ExperienceLengthInDays} -lt 0 ] ; then
148	IGCM_debug_Print 1 "Problem with dates in config.card : ${DateEnd} < ${DateBegin} ! You must check that."
149	IGCM_debug_Exit "IGCM_config_Initialize" " Wrong Dates."
150	IGCM_debug_Verif_Exit
151	fi
152
153	# Day and Year of Initial State (Given in julian format)
154	InitDay=$(( $( IGCM_date_ConvertGregorianDateToJulian $DateBegin ) % 1000 ))
155	InitYear=$(( $( IGCM_date_ConvertGregorianDateToJulian $DateBegin ) / 1000 ))
156
157	#==================================
158	# Restarts : Gerneral rule or local for each component ?
159	IGCM_card_DefineArrayFromSection ${SUBMIT_DIR}/config.card Restarts
160
161	echo
162	IGCM_debug_Print 1 "DefineArrayFromOption : config_Restarts"
163
164	for option in ${config_Restarts[*]} ; do
165	IGCM_card_DefineVariableFromOption ${SUBMIT_DIR}/config.card Restarts ${option}
166	eval auxprint=\${config_Restarts_${option}}
167	IGCM_debug_Print 3 "${option} : ${auxprint}"
168	done
169
170	#================================================================#
171	# Test and Prepare directories #
172	#================================================================#
173
174	# ==> 4 kinds of input files :
175	# 1) R_INIT : Initial State Files (Etat0, carteveg)
176	# 2) R_BC : Boundary Conditions (Forcages, lai)
177	# 3) Parameters files (allready define through ${SUBMIT_DIR})
178	# 4) Restarts files (allready define in IGCM_config_Initialize)
179
180	# Here we offer the possibility to redefine R_INIT, R_BC
181	# and PeriodNb through config.card
182	R_INIT=${config_UserChoices_R_INIT:=${R_IN}/INIT}
183	IGCM_debug_Print 2 "(Re)Define R_INIT, R_BC and PeriodNb"
184	IGCM_debug_Print 3 "R_INIT=${R_INIT}"
185	R_BC=${config_UserChoices_R_BC:=${R_IN}/BC}
186	IGCM_debug_Print 3 "R_BC=${R_BC}"
187	PeriodNb=${config_UserChoices_PeriodNb:=${PeriodNb}}
188	IGCM_debug_Print 3 "Loop in main Job with ${PeriodNb} period(s)"
189
190	# Test Archive input/output.
191	IGCM_sys_TestDirArchive ${ARCHIVE}
192	[ $? != 0 ] && IGCM_debug_Exit "IGCM_sys_TestDirArchive"
193	IGCM_sys_TestDirArchive ${R_IN}
194	[ $? != 0 ] && IGCM_debug_Exit "IGCM_sys_TestDirArchive"
195
196	#====================================================
197	#R_SAVE : Job output directory
198	if ( [ ! X${config_UserChoices_SpaceName} = X ] && [ ! X${config_UserChoices_ExperimentName} = X ] ) ; then
199	FreeName=$( echo ${config_UserChoices_JobName} \| sed 's/.*_//' )
200	R_SAVE=${R_OUT}/${config_UserChoices_TagName}/${config_UserChoices_SpaceName}/${config_UserChoices_ExperimentName}/${FreeName}
201	R_FIGR=${R_FIG}/${config_UserChoices_TagName}/${config_UserChoices_SpaceName}/${config_UserChoices_ExperimentName}/${FreeName}
202	R_BUFR=${R_BUF}/${config_UserChoices_TagName}/${config_UserChoices_SpaceName}/${config_UserChoices_ExperimentName}/${FreeName}
203	R_DODS=${config_UserChoices_TagName}/${config_UserChoices_SpaceName}/${config_UserChoices_ExperimentName}/${FreeName}
204	else
205	R_SAVE=${R_OUT}/${config_UserChoices_TagName}/${config_UserChoices_JobName}
206	R_FIGR=${R_FIG}/${config_UserChoices_TagName}/${config_UserChoices_JobName}
207	R_BUFR=${R_BUF}/${config_UserChoices_TagName}/${config_UserChoices_JobName}
208	R_DODS=${config_UserChoices_TagName}/${config_UserChoices_JobName}
209	fi
210
211	if ( ${FirstInitialize} ) ; then
212	IGCM_sys_MkdirArchive ${R_SAVE}
213	IGCM_sys_Mkdir ${R_BUFR}
214	else
215	IGCM_sys_TestDirArchive ${R_SAVE}
216	[ $? != 0 ] && IGCM_debug_Exit "IGCM_sys_TestDirArchive ${R_SAVE}"
217
218	IGCM_sys_TestDir ${R_BUFR}
219	[ $? != 0 ] && IGCM_debug_Exit "IGCM_sys_TestDir ${R_BUFR}"
220
221	#Test state of run in run.card
222	IGCM_card_DefineVariableFromOption ${SUBMIT_DIR}/run.card Configuration PeriodState
223
224	if ( [ ${run_Configuration_PeriodState} != "Start" ] && [ ${run_Configuration_PeriodState} != "Running" ] && [ ${run_Configuration_PeriodState} != "OnQueue" ] && [ ${run_Configuration_PeriodState} != "Continue" ] ) ; then
225	echo
226	IGCM_debug_Print 1 "!! Error in run.card with PeriodState : " ${run_Configuration_PeriodState} "!!"
227	IGCM_debug_Print 1 "Try running ${libIGCM}/clean_month.job to fix this"
228	IGCM_debug_Exit
229	IGCM_debug_Verif_Exit
230	fi
231	fi
232
233	#====================================================
234	# Define REBUILD_DIR : where we store files needing rebuild process
235	if [ X${config_Post_RebuildFromArchive} = Xtrue ] ; then
236	REBUILD_DIR=${R_SAVE}/TMP
237	IGCM_sys_MkdirArchive ${REBUILD_DIR}
238	else
239	REBUILD_DIR=${BIG_DIR}/${config_UserChoices_TagName}/${config_UserChoices_JobName}
240	IGCM_sys_MkdirWork ${REBUILD_DIR}
241	fi
242
243	#====================================================
244	# Experience type : DEB(ug), DEV(elopment), RUN
245	if [ X${JobType} != XRUN ] ; then
246	echo
247	echo "===================================================="
248	echo "libIGCM JOB is NOT in RUN type mode."
249	echo "!! OUTPUT files will NOT be PROTECTED !!"
250	echo "Be carefull : you can ERASE the result of this job !"
251
252	case ${JobType} in
253	DEB)
254	echo "DEBUG mode : activation of 'set -vx' mode."
255	echo "DEBUG mode : no protection for output files."
256	echo "DEBUG mode : if active force asynchronous rebuild frequency to PeriodLength frequency."
257	;;
258	DEV)
259	echo "DEVelopment mode : no protection for output files."
260	echo "DEVelopment mode : if active force asynchronous rebuild frequency to PeriodLength frequency."
261	;;
262	esac
263
264	if ( [ X${config_Post_RebuildFrequency} != XNONE ] && [ ${DRYRUN} -eq 0 ] ) ; then
265	if [ X${config_Post_RebuildFrequency} != X${config_UserChoices_PeriodLength} ] ; then
266	echo "------------"
267	echo "WARNING : Job is NOT in RUN mode then we will force REBUILD Frequency"
268	echo " to PeriodLength : ${config_UserChoices_PeriodLength}"
269	echo "------------"
270	config_Post_RebuildFrequency=${config_UserChoices_PeriodLength}
271	fi
272	fi
273	echo "===================================================="
274	echo
275	fi
276
277	#====================================================
278	#R_OUT_KSH : Storage place for job output
279	#R_OUT_EXE : Storage place for binary used during simulation
280	R_OUT_KSH=${R_SAVE}/Out
281	R_OUT_EXE=${R_SAVE}/Exe
282
283	#====================================================
284	#R_BUF_KSH : Buffer place for job output
285	#R_BUF_EXE : Buffer place for binary used during simulation
286	R_BUF_KSH=${R_BUFR}/Out
287	R_BUF_EXE=${R_BUFR}/Exe
288
289	IGCM_debug_PopStack "IGCM_config_Initialize"
290	}
291
292	#===================================
293	function IGCM_config_Analyse_PeriodLength
294	{
295	IGCM_debug_PushStack "IGCM_config_Analyse_PeriodLength"
296
297	typeset i
298
299	# Determine number of day(s) in PeriodLength :
300	case ${config_UserChoices_PeriodLength} in
301	Y\|y)
302	PeriodLengthInYears=$( echo ${config_UserChoices_PeriodLength} \| sed -e 's/[yY]//' )
303	IGCM_debug_Print 2 "Number of years for PeriodLength : ${PeriodLengthInYears}"
304	PeriodLengthInDays=0
305	i=0
306	until [ $i -ge $PeriodLengthInYears ] ; do
307	(( PeriodLengthInDays = PeriodLengthInDays + $( IGCM_date_DaysInYear $(( year + i )) ) ))
308	(( i=i+1 ))
309	done
310	;;
311	M\|m)
312	PeriodLengthInMonths=$( echo ${config_UserChoices_PeriodLength} \| sed -e 's/[mM]//' )
313	IGCM_debug_Print 2 "Number of months for PeriodLength : ${PeriodLengthInMonths}"
314	PeriodLengthInDays=0
315	i=0
316	until [ $i -ge $PeriodLengthInMonths ] ; do
317	if [ $(( month + i )) -lt 13 ] ; then
318	(( PeriodLengthInDays = PeriodLengthInDays + $( IGCM_date_DaysInMonth $year $(( month + i )) ) ))
319	else
320	(( PeriodLengthInDays = PeriodLengthInDays + $( IGCM_date_DaysInMonth $year $(( month + i - 12 )) ) ))
321	fi
322	(( i=i+1 ))
323	done
324	;;
325	D\|d)
326	PeriodLengthInMonths=0
327	PeriodLengthInDays=$( echo ${config_UserChoices_PeriodLength} \| sed -e 's/[dD]//' );;
328	*)
329	IGCM_debug_Exit "IGCM_config_Analyse_PeriodLength " ${config_UserChoices_PeriodLength} " invalid period length : choose in Y, M, *D."
330	IGCM_debug_Verif_Exit ;;
331	esac
332
333	IGCM_debug_PopStack "IGCM_config_Analyse_PeriodLength"
334	}
335
336	#===================================
337	function IGCM_config_Check
338	{
339	IGCM_debug_PushStack "IGCM_config_Check"
340
341	# If one of the following modulo is not zero :
342	# we will issue an error then explain and exit in
343	# AA_job IGCM_debug_Verif_Exit call before binary submission
344
345	echo
346	IGCM_debug_Print 1 "IGCM_config_Check"
347	echo
348
349	typeset i
350
351	# Check RebuildFrequency against key frequencies : PeriodLength ; PackFrequency ; TimeSeriesFrequency ; SeasonalFrequency
352	if ( [ ! X${config_Post_RebuildFrequency} = X${NULL_STR} ] && [ ! X${config_Post_RebuildFrequency} = XNONE ] ) ; then
353	AsynchronousRebuild=true
354	IGCM_debug_Print 1 "Asynchronous rebuild has been activated."
355	echo
356	# modulo (RebuildFrequency and PeriodLength/TimeSeriesFrequency/SeasonalFrequency) must be zero
357	IGCM_debug_Print 1 "Check coherence between RebuildFrequency and PeriodLength"
358	IGCM_post_CheckModuloFrequency config_Post_RebuildFrequency config_UserChoices_PeriodLength
359	IGCM_debug_Print 1 "Check coherence between PackFrequency and RebuildFrequency"
360	IGCM_post_CheckModuloFrequency config_Post_PackFrequency config_Post_RebuildFrequency
361	IGCM_debug_Print 1 "Check coherence between TimeSeriesFrequency and RebuildFrequency"
362	IGCM_post_CheckModuloFrequency config_Post_TimeSeriesFrequency config_Post_RebuildFrequency
363	IGCM_debug_Print 1 "Check coherence between SeasonalFrequency and RebuildFrequency"
364	IGCM_post_CheckModuloFrequency config_Post_SeasonalFrequency config_Post_RebuildFrequency
365	else
366	AsynchronousRebuild=false
367	IGCM_debug_Print 1 "Asynchronous rebuild has not been activated"
368	IGCM_debug_Print 1 "Proceed with standard post-treatment pathway"
369	echo
370	#modulo (PeriodLength and TimeSeriesFrequency/SeasonalFrequency) must be zero
371	IGCM_debug_Print 1 "Check coherence between TimeSeriesFrequency and PeriodLength"
372	IGCM_post_CheckModuloFrequency config_Post_TimeSeriesFrequency config_UserChoices_PeriodLength
373	IGCM_debug_Print 1 "Check coherence between SeasonalFrequency and PeriodLength"
374	IGCM_post_CheckModuloFrequency config_Post_SeasonalFrequency config_UserChoices_PeriodLength
375	fi
376
377	# Check PackFrequency against other key frequencies
378	# Modulo (PackFrequency and TimeSeriesFrequency/SeasonalFrequency and PeriodLenght) must be zero
379	if ( [ ! X${config_Post_PackFrequency} = X${NULL_STR} ] && [ ! X${config_Post_PackFrequency} = XNONE ] ) ; then
380	Pack=true
381	#
382	IGCM_debug_Print 1 "Check coherence between PackFrequency and PeriodLength"
383	IGCM_post_CheckModuloFrequency config_Post_PackFrequency config_UserChoices_PeriodLength
384	IGCM_debug_Print 1 "Check coherence between TimeSeriesFrequency and PackFrequency"
385	IGCM_post_CheckModuloFrequency config_Post_TimeSeriesFrequency config_Post_PackFrequency
386	IGCM_debug_Print 1 "Check coherence between SeasonalFrequency and PackFrequency"
387	IGCM_post_CheckModuloFrequency config_Post_SeasonalFrequency config_Post_PackFrequency
388	else
389	Pack=false
390	fi
391
392	#modulo (TimeSeriesFrequency and all Chunck2D) must be zero
393	NbJob=${#CHUNCK2D_SIZE[@]}
394	i=0
395	until [ $i -ge $NbJob ]; do
396	value=${CHUNCK2D_SIZE[${i}]}
397	IGCM_debug_Print 1 "Check coherence between All Chunck2D frequency and TimeSeriesFrequency"
398	IGCM_post_CheckModuloFrequency value config_Post_TimeSeriesFrequency
399	case ${value} in
400	Y\|y) ;;
401	) IGCM_debug_Print 1 "All ChunckJob2D frequency must be expressed in year Y\|*y in comp.card"
402	IGCM_debug_Exit "This will stop the job" ;;
403	esac
404	(( i=i+1 ))
405	done
406
407	#modulo (TimeSeriesFrequency and all Chunck3D) must be zero
408	NbJob=${#CHUNCK3D_SIZE[@]}
409	i=0
410	until [ $i -ge $NbJob ]; do
411	value=${CHUNCK3D_SIZE[${i}]}
412	IGCM_debug_Print 1 "Check coherence between All Chunck3D frequency and TimeSeriesFrequency"
413	IGCM_post_CheckModuloFrequency value config_Post_TimeSeriesFrequency
414	case ${value} in
415	Y\|y) ;;
416	) IGCM_debug_Print 1 "All ChunckJob3D frequency must be expressed in year Y\|*y in comp.card"
417	IGCM_debug_Exit "This will stop the job" ;;
418	esac
419	(( i=i+1 ))
420	done
421
422	#check to be sure there is enough space on temporary filesystems to run
423	IGCM_debug_Print 1 "Check if there is enough space on temporary filesystem"
424	IGCM_sys_check_quota
425
426	IGCM_debug_PopStack "IGCM_config_Check"
427	}
428
429	#===================================
430	function IGCM_config_PeriodStart
431	{
432	IGCM_debug_PushStack "IGCM_config_PeriodStart"
433
434	echo
435	IGCM_debug_Print 1 "IGCM_config_PeriodStart"
436	echo
437
438	if ( ${FirstInitialize} ) ; then
439	#================================================#
440	# Initialize date/period information #
441	#================================================#
442
443	IGCM_date_GetYearMonthDay $DateBegin year month day
444	IGCM_config_Analyse_PeriodLength
445
446	eval PeriodDateBegin=${DateBegin} > /dev/null 2>&1
447	PeriodDateEnd=$( IGCM_date_AddDaysToGregorianDate ${DateBegin} $(( ${PeriodLengthInDays} - 1 )) )
448	eval CumulPeriod=1 > /dev/null 2>&1
449
450	#=================================================#
451	# Write updated run.card #
452	#=================================================#
453
454	#Correct run.card Configuration for this period
455	IGCM_card_WriteOption ${SUBMIT_DIR}/run.card Configuration PeriodDateBegin ${PeriodDateBegin}
456	IGCM_card_WriteOption ${SUBMIT_DIR}/run.card Configuration PeriodDateEnd ${PeriodDateEnd}
457	IGCM_card_WriteOption ${SUBMIT_DIR}/run.card Configuration CumulPeriod ${CumulPeriod}
458	if [ X$( grep "SubmitPath" ${SUBMIT_DIR}/run.card ) != X ] ; then
459	IGCM_card_WriteOption ${SUBMIT_DIR}/run.card Configuration SubmitPath ${SUBMIT_DIR}
460	fi
461
462	IGCM_card_WriteOption ${SUBMIT_DIR}/run.card Configuration PeriodState "Running"
463
464	else
465	#================================================#
466	# The file run.card allready exist #
467	#================================================#
468
469	#Test state of run in run.card
470	IGCM_card_DefineVariableFromOption ${SUBMIT_DIR}/run.card Configuration PeriodState
471	if ( [ ${run_Configuration_PeriodState} != "Running" ] && [ ${run_Configuration_PeriodState} != "OnQueue" ] && [ ${run_Configuration_PeriodState} != "Continue" ] ) ; then
472	echo
473	IGCM_debug_Print 1 "!! Error in run.card with PeriodState : " ${run_Configuration_PeriodState} "!!"
474	IGCM_debug_Print 1 "Try running ${libIGCM}/clean_month.job to fix this"
475	echo
476	IGCM_debug_Exit
477	IGCM_debug_Verif_Exit
478	fi
479
480	#===================================#
481	# Read updated run.card #
482	#===================================#
483
484	IGCM_card_DefineVariableFromOption ${SUBMIT_DIR}/run.card Configuration OldPrefix
485	IGCM_card_DefineVariableFromOption ${SUBMIT_DIR}/run.card Configuration PeriodDateBegin
486	IGCM_card_DefineVariableFromOption ${SUBMIT_DIR}/run.card Configuration PeriodDateEnd
487	IGCM_card_DefineVariableFromOption ${SUBMIT_DIR}/run.card Configuration CumulPeriod
488
489	PeriodDateBegin=$( IGCM_date_ConvertFormatToGregorian ${run_Configuration_PeriodDateBegin} )
490	PeriodDateEnd=$( IGCM_date_ConvertFormatToGregorian ${run_Configuration_PeriodDateEnd} )
491	eval CumulPeriod="${run_Configuration_CumulPeriod}" > /dev/null 2>&1
492
493	LastPeriodDateEnd=$( echo ${run_Configuration_OldPrefix} \| sed -e "s/${config_UserChoices_JobName}_//" )
494
495	typeset LastDate
496	set +A LastDate -- $( echo ${LastPeriodDateEnd} \| sed -e "s/$[0-9]\{${dY}\}$$[0-9]\{2\}$$[0-9]\{2\}$/\1 \2 \3/" )
497	LastYearDateEnd=${LastDate[0]}
498	LastMonthDateEnd=${LastDate[1]}
499	LastDayDateEnd=${LastDate[2]}
500
501	if [ ${Period} = 1 ]; then
502	# save last Job output
503	typeset LastPeriod iLastPeriod Last_Script_Output_Name
504	(( LastPeriod=CumulPeriod-PeriodNb ))
505	iLastPeriod=$( printf "%06d" ${LastPeriod} )
506	Last_Script_Output_Name="${Script_Output_Prefix}_${config_UserChoices_JobName}.${iLastPeriod}"
507	Last_run_card="run.card.${iLastPeriod}"
508	#eval ls -l ${SUBMIT_DIR}/${Last_Script_Output_Name}
509	#eval IGCM_sys_Put_Out ${SUBMIT_DIR}/${Last_Script_Output_Name} ${R_BUF_KSH}/${Last_Script_Output_Name} > /dev/null 2>&1
510	IGCM_debug_Print 2 "Try to save previous ksh job output"
511	IGCM_sys_Cd ${SUBMIT_DIR}/
512	if [ X${Pack} = Xtrue ] ; then
513	IGCM_sys_PutBuffer_Out ${Last_Script_Output_Name} ${R_BUF_KSH}/${Last_Script_Output_Name}.$$ rw
514	else
515	IGCM_sys_Put_Out ${Last_Script_Output_Name} ${R_OUT_KSH}/${Last_Script_Output_Name}.$$ rw
516	fi
517
518	IGCM_card_CheckConflict run.card
519	if [ X${Pack} = Xtrue ] ; then
520	IGCM_sys_PutBuffer_Out ${SUBMIT_DIR}/run.card ${R_BUF_KSH}/${Last_run_card}.$$ rw
521	else
522	IGCM_sys_Put_Out ${SUBMIT_DIR}/run.card ${R_OUT_KSH}/${Last_run_card}.$$ rw
523	fi
524	IGCM_sys_Cd ${RUN_DIR}
525	else
526	unset FileToBeDeleted
527	fi
528
529	IGCM_date_GetYearMonthDay $PeriodDateBegin year month day
530	IGCM_config_Analyse_PeriodLength
531
532	IGCM_card_WriteOption ${SUBMIT_DIR}/run.card Configuration PeriodState "Running"
533
534	fi
535	OldPrefix=${config_UserChoices_JobName}_${PeriodDateEnd}
536
537	# BEGIN: SHOULD GO IN A FUNCTION FROM libIGCM_date.ksh
538	# Compute year_m1 and year_p1 (year minus 1Y and year plus 1Y)
539	year_m1=$(( year - 1 ))
540	year_p1=$(( year + 1 ))
541	# Compute month_m1 (month minus 1M)
542	# Compute yyyymm_m1 (yyyymm minus 1M)
543	month_m1=$(( month - 1 ))
544	if [ ${month_m1} = 0 ]; then
545	month_m1=12
546	yyyymm_m1=${year_m1}12
547	elif [ ${month_m1} -le 9 ]; then
548	month_m1=0${month_m1}
549	yyyymm_m1=${year}${month_m1}
550	else
551	yyyymm_m1=${year}${month_m1}
552	fi
553	# Compute month_p1 (month plus 1M)
554	# Compute yyyymm_p1 (yyyymm plus 1M)
555	month_p1=$(( month + 1 ))
556	if [ ${month_p1} = 13 ]; then
557	month_p1=01
558	yyyymm_p1=${year_p1}01
559	elif [ ${month_p1} -le 9 ]; then
560	month_p1=0${month_p1}
561	yyyymm_p1=${year}${month_p1}
562	else
563	yyyymm_p1=${year}${month_p1}
564	fi
565	#IGCM_debug_Print 1 "jg 1 month_m1 = ${month_m1} month_p1 = ${month_p1} "
566	#IGCM_debug_Print 1 "jg 1 calculate yyyymm_m1 = ${yyyymm_m1} "
567	#IGCM_debug_Print 1 "jg 1 calculate yyyymm_p1 = ${yyyymm_p1} "
568
569	# END: SHOULD GO IN A FUNCTION FROM libIGCM_date.ksh
570
571	#===================================================================#
572	# Prepare variables available for ${COMP}.card and ${COMP}.driver #
573	# But available to any son functions #
574	#===================================================================#
575
576	# Period Length In Days between DateBegin and DateCurrent (at end of period == PeriodDateEnd !)
577	(( SimulationLengthInDays = $( IGCM_date_DaysBetweenGregorianDate ${PeriodDateEnd} ${DateBegin} ) + 1 ))
578
579	# Debug Print :
580	IGCM_debug_Print 1 "IGCM_config_PeriodStart : Before Execution"
581	IGCM_debug_Print 1 "Year of simulation : ${year}"
582	IGCM_debug_Print 1 "Month of simulation : ${month}"
583	IGCM_debug_Print 1 "PeriodLengthInDays : ${PeriodLengthInDays}"
584	IGCM_debug_Print 1 "PeriodDateBegin : ${PeriodDateBegin}"
585	IGCM_debug_Print 1 "PeriodDateEnd : ${PeriodDateEnd}"
586	IGCM_debug_Print 1 "SimulationLengthInDays : ${SimulationLengthInDays}"
587	IGCM_debug_Print 1 "ExperienceLengthInDays : ${ExperienceLengthInDays}"
588
589	#================================================================#
590	# Prepare variables available for comp_finalyze #
591	#================================================================#
592
593	# Period for save files
594	eval DatesPeriod=${PeriodDateBegin}_${PeriodDateEnd} > /dev/null 2>&1
595
596	# Prefix for save files of this period
597	eval PREFIX=${config_UserChoices_JobName}_${DatesPeriod} > /dev/null 2>&1
598
599	# List of files that will be deleted in RUN_DIR after run
600	[ -f stack ] && FileToBeDeleted[0]="stack"
601
602	# Test if the same run as already been saved :
603	if [ X${JobType} = XRUN ] ; then
604	if [ ${DRYRUN} -le 0 ] ; then
605	if ( IGCM_sys_TestFileBuffer ${R_BUF_KSH}/${PREFIX}_${Exe_Output} ) ; then
606	IGCM_debug_Exit "IGCM_config_PeriodStart" "You are currently RErunning an old job."
607	IGCM_debug_Print 1 "Because of readonly permissions, you can't RErun a job when saved files"
608	IGCM_debug_Print 1 " are still in the ARCHIVE directory. You must deleted those files, or "
609	IGCM_debug_Print 1 " the whole ${R_SAVE} tree. See clean_month.job in ${libIGCM} directory."
610	IGCM_debug_Print 1 " This exit has been initiated because at least ${R_BUF_KSH}/${PREFIX}_${Exe_Output} exists."
611	IGCM_debug_Verif_Exit
612	fi
613	fi
614	else
615	if ( IGCM_sys_TestFileBuffer ${R_BUF_KSH}/${PREFIX}_${Exe_Output} ) ; then
616	IGCM_debug_Print 1 "IGCM_config_PeriodStart" "RErun an old job. Allowed in DEBUG or DEV mode."
617	fi
618	fi
619
620	typeset ExeNameIn ExeNameFirst CompNameFirst
621	typeset comp i
622	typeset tempvar tempvarMPI tempvarNOD NbElts j NbExec
623
624	(( PROCESSUS_NUMBER = 0 ))
625	(( i=0 ))
626	(( NbExec=0 ))
627
628	OK_PARA_MPI=false
629	OK_PARA_OMP=false
630	OK_PARA_NOD=false
631	OK_PARA_MPMD=false
632
633	for comp in ${config_ListOfComponents[*]} ; do
634
635	IGCM_debug_Print 1 ${comp}
636
637	eval ExeNameIn=\${config_Executable_${comp}[0]}
638
639	# NO order in config.card for parallelized values !
640	# just use suffix : MPI , OMP and NOD (for number of NODes.)
641
642	# NOD is the number of NODes allocated
643	eval ${comp}_PROC_NOD=0
644
645	# MPI is the number of MPI processus per nodes
646	eval ${comp}_PROC_MPI=0
647
648	# OMP is the number of OpenMP threads per MPI processus
649	eval ${comp}_PROC_OMP=0
650
651	# Only if we really have an executable for the component :
652	### if [ X${ExeNameIn} != X\"\" ] ; then
653	if ( [ "X${ExeNameIn}" != X\"\" ] && [ "X${ExeNameIn}" != "Xinca.dat" ] ) ; then
654
655	# Keep the first executable found and the first CompName
656	ExeNameFirst=${ExeNameIn}
657	CompNameFirst=${comp}
658
659	# Are we a second executable?
660	(( NbExec = NbExec + 1 ))
661
662	# set 1 MPI task, 1 OpenMP thread and 1 node as default
663	eval ${comp}_PROC_MPI=1
664	eval ${comp}_PROC_OMP=1
665	eval ${comp}_PROC_NOD=1
666
667	eval NbElts=\${#config_Executable_${comp}[@]}
668
669	if [ ${NbElts} -ge 2 ] ; then
670	(( j = 2 ))
671
672	while [ $j -lt ${NbElts} ] ; do
673	eval tempvar=\${config_Executable_${comp}[${j}]}
674
675	if [ X${tempvar} = X ] ; then
676	echo "Error reading MPI/OMP parameters !!!"
677	echo "Check your config.card."
678	exit 1
679	fi
680
681	eval IGCM_debug_Print 2 ${tempvar}
682
683	case ${tempvar} in
684	[mM][pP][iI])
685	# Read MPI parameter for composante
686	eval ${comp}_PROC_MPI=$( echo ${tempvar} \| tr '[a-z]' '[A-Z]' \| sed -e "s/MPI//" )
687	OK_PARA_MPI=true;;
688	[oO][mM][pP])
689	# Read OMP parameter for composante
690	eval ${comp}_PROC_OMP=$( echo ${tempvar} \| tr '[a-z]' '[A-Z]' \| sed -e "s/OMP//" )
691	OK_PARA_OMP=true;;
692	[nN][oO][dD])
693	# Read NOD (NumBer of Nodes) parameter for composante
694	eval ${comp}_PROC_NOD=$( echo ${tempvar} \| tr '[a-z]' '[A-Z]' \| sed -e "s/NOD//" )
695	OK_PARA_NOD=true
696	OK_PARA_MPI=true;;
697	esac
698
699	(( j = j + 1 ))
700	done
701
702	fi
703
704	eval tempvarMPI=\${${comp}_PROC_MPI}
705	eval tempvarNOD=\${${comp}_PROC_NOD}
706	eval tempvarOMP=\${${comp}_PROC_OMP}
707
708	(( PROCESSUS_NUMBER = PROCESSUS_NUMBER + tempvarMPI * tempvarNOD * tempvarOMP ))
709
710	fi
711
712	(( i=i+1 ))
713	done
714
715	# set MPMD mode if more than 2 executable names.
716	[ ${NbExec} -ge 2 ] && OK_PARA_MPMD=true
717
718	# Verification of BATCH_NUM_PROC_TOT total number of processors set in job header.
719	if [ X${BATCH_NUM_PROC_TOT} != X ] ; then
720	# BATCH_NUM_PROC_TOT is set
721	if ( ${OK_PARA_MPI} ) ; then
722	IGCM_debug_Print 1 "MPI/OMP/NOD found into config.card and BATCH_NUM_PROC_TOT = ${BATCH_NUM_PROC_TOT} "
723	else
724	# with previous method.
725	if [ ${BATCH_NUM_PROC_TOT} -gt 1 ] ; then
726	# with more than 1 proc
727	if ( ${OK_PARA_MPMD} ) ; then
728	# with MPMD ie CPL/oasis method
729	echo "We will use default number of MPI tasks for this machine : "
730	echo "${DEFAULT_NUM_PROC_OCE} for OCE; "
731	echo "${DEFAULT_NUM_PROC_CPL} for CPL; "
732	echo "${DEFAULT_NUM_PROC_ATM} for ATM; "
733	echo "${DEFAULT_NUM_PROC_TOTAL} for the total number of processors; "
734	OK_PARA_MPI=true
735	CPL_PROC_MPI=${DEFAULT_NUM_PROC_CPL}
736	OCE_PROC_MPI=${DEFAULT_NUM_PROC_OCE}
737	ATM_PROC_MPI=${DEFAULT_NUM_PROC_ATM}
738	PROCESSUS_NUMBER=${DEFAULT_NUM_PROC_TOTAL}
739	else
740	# with have only one executable
741	echo "We will use ${BATCH_NUM_PROC_TOT} MPI tasks for ${CompNameFirst} : ${config_Executable_Name} "
742	OK_PARA_MPI=true
743	eval ${CompNameFirst}_PROC_MPI=${BATCH_NUM_PROC_TOT}
744	PROCESSUS_NUMBER=${BATCH_NUM_PROC_TOT}
745	fi
746	else
747	PROCESSUS_NUMBER=1
748	fi
749	fi
750	# Verification with PBS parameter
751	if [ ${BATCH_NUM_PROC_TOT} -ne ${PROCESSUS_NUMBER} ] ; then
752	echo "Warning with parallelization parameters !"
753	echo "Job header variable BATCH_NUM_PROC_TOT = ${BATCH_NUM_PROC_TOT} "
754	echo "is the total number of _processors_ reserved."
755	echo "It is not equal to the sum of _processus_ = ${PROCESSUS_NUMBER}."
756	echo "We stop now."
757	exit 1
758	fi
759	NUM_PROC_CPL=${CPL_PROC_MPI} # for backward compatibility
760	NUM_PROC_OCE=${OCE_PROC_MPI} # for backward compatibility
761	NUM_PROC_ATM=${ATM_PROC_MPI} # for backward compatibility
762	else # BATCH_NUM_PROC_TOT=""
763	if ( ${OK_PARA_MPI} ) ; then
764	echo "You have not given a value of ${BATCH_NUM_PROC_TOT} processors,"
765	echo "but you have filled the parallel parameter in config->Executable->list."
766	echo "Please add BATCH_NUM_PROC_TOT variable in job header."
767	echo "We stop now."
768	exit 1
769	else
770	# sequential case !
771	if [ ${PROCESSUS_NUMBER} -eq 0 ] ; then
772	(( PROCESSUS_NUMBER = 1 ))
773	echo "PROCESSUS_NUMBER is all 0 (sequential use of old definition in config->Executable->list)."
774	echo "We set it to 1."
775	fi
776	fi
777	fi
778
779	IGCM_debug_Print 1 "MPI/OMP treatment PROCESSUS_NUMBER = ${PROCESSUS_NUMBER}"
780
781	IGCM_sys_build_execution_scripts
782
783	ExecutionFail=false
784
785	IGCM_debug_PopStack "IGCM_config_PeriodStart"
786	}
787
788	#===================================
789	function IGCM_config_SaveSourceModifications
790	{
791	IGCM_debug_PushStack "IGCM_config_SaveSourceModifications"
792
793	typeset ExeOutDateMax listVarEnv
794	ExeOutDateMax=$1
795
796	listVarEnv="ExeOutDateMax,R_OUT_EXE,PREFIX,SUBMIT_DIR"
797	IGCM_sys_RshMaster "\
798	. ${libIGCM}/libIGCM_sys/libIGCM_sys.ksh; \
799	export ExeOutDateMax=${ExeOutDateMax};\
800	export R_OUT_EXE=${R_OUT_EXE};\
801	export PREFIX=${PREFIX};\
802	export SUBMIT_DIR=${SUBMIT_DIR};\
803	export listVarEnv=${listVarEnv};\
804	Script_Output=out_SaveSourceModifications;\
805	IGCM_sys_Qsub ${libIGCM}/SaveSourceModifications.job ${ExeOutDateMax} ${R_OUT_EXE} ${PREFIX} ${SUBMIT_DIR}"
806
807	IGCM_debug_PopStack "IGCM_config_SaveSourceModifications"
808	}
809
810	#===================================
811	function IGCM_config_PeriodEnd
812	{
813	IGCM_debug_PushStack "IGCM_config_PeriodEnd"
814
815	echo
816	IGCM_debug_Print 1 "IGCM_config_PeriodEnd"
817	echo
818
819	#==================================#
820	# Save Job output #
821	#==================================#
822	if [ X${Pack} = Xtrue ] ; then
823	IGCM_sys_PutBuffer_Out ${Exe_Output} ${R_BUF_KSH}/${PREFIX}_${Exe_Output}
824	else
825	IGCM_sys_Put_Out ${Exe_Output} ${R_OUT_KSH}/${PREFIX}_${Exe_Output}
826	fi
827	eval FileToBeDeleted[${#FileToBeDeleted[@]}]="${Exe_Output}"
828
829	IGCM_card_CheckConflict run.card
830	if [ X${Pack} = Xtrue ] ; then
831	IGCM_sys_PutBuffer_Out ${SUBMIT_DIR}/run.card ${R_BUF_KSH}/run.card rw
832	else
833	IGCM_sys_Put_Out ${SUBMIT_DIR}/run.card ${R_OUT_KSH}/run.card rw
834	fi
835
836	if [ ${DRYRUN} -le 1 ] ; then
837
838	IGCM_debug_Print 1 "Check components binary : size and creation date"
839
840	typeset LS_comp LS_bin ExeDate ExeCpuLog NextExeSize LastCompExeSize
841	typeset comp i
842	typeset ExeNameIn ExeNameOut UpdateExe ExeSecDateMax
843
844	#==================================#
845	# Get last Exe Size #
846	#==================================#
847
848	(( i=0 ))
849	if ( ${FirstInitialize} ) ; then
850	run_Log_LastExeSize=""
851	for comp in ${config_ListOfComponents[*]} ; do
852	run_Log_LastExeSize[$i]=0
853	(( i=i+1 ))
854	done
855	else
856	IGCM_card_DefineArrayFromOption ${SUBMIT_DIR}/run.card Log LastExeSize
857	fi
858	#==================================#
859	# And Build ExeDate #
860	#==================================#
861
862	# ExeDate = ATM_Jun_12_09:34-SRF_Jun_12_09:34-OCE_Jun_12_09:34-ICE_Jun_12_09:34-CPL_Jun_12_09:33
863	# Would be nice to have next line but no way to format ls output (need to ls -l --time-style "+%Y-%m-%dT%H:%M")
864	# ExeDate = ATM_2009-06-12T09:34+SRF_2009-06-12T09:34+OCE_2009-06-12T09:34+ICE_2009-06-12T09:34+CPL_2009-06-12T09:34
865	ExeDate=""
866	NextExeSize="( "
867	(( i=0 ))
868	UpdateExe=false
869	(( ExeSecDateMax = 0 ))
870	for comp in ${config_ListOfComponents[*]} ; do
871
872	IGCM_debug_Print 3 ${comp}
873
874	eval ExeNameIn=\${config_Executable_${comp}[0]}
875	eval ExeNameOut=\${config_Executable_${comp}[1]}
876	# Only if we really have an executable for the component :
877	if [ X${ExeNameIn} = X\"\" ] ; then
878	# If there is no exe file for this component
879	(( ExeSize=0 ))
880	else
881	eval LS_bin=${R_EXE}/${ExeNameIn}
882	IGCM_sys_FileSize ${LS_bin} ExeSize
883
884	set +A LS_comp -- $( LC_TIME=en_US ls -l ${LS_bin} )
885	if [ X${ExeDate} = X ] ; then
886	# First component exe date
887	ExeDate=${comp}_${LS_comp[5]}_${LS_comp[6]}
888	else
889	ExeDate=${ExeDate}-${comp}_${LS_comp[5]}_${LS_comp[6]}
890	fi
891	ExeDate=${ExeDate}_${LS_comp[7]}
892	fi
893
894	if [ ${i} -eq 0 ] ; then
895	# First component
896	NextExeSize="( "${ExeSize}
897	else
898	NextExeSize=${NextExeSize}", "${ExeSize}
899	fi
900	eval LastCompExeSize=${run_Log_LastExeSize[$i]}
901	(( i=i+1 ))
902
903	if [ ${ExeSize} -ne ${LastCompExeSize} ] ; then
904	if ( ${FirstInitialize} ) ; then
905	IGCM_debug_Print 1 "Save first ${ExeNameIn} in ${R_OUT_EXE} !"
906	else
907	IGCM_debug_Print 1 "${ExeNameIn} has changed in ${R_EXE} !"
908	IGCM_debug_Print 1 "Save latest ${ExeNameIn} in ${R_OUT_EXE} !"
909	eval FileToBeDeleted[${#FileToBeDeleted[@]}]=${ExeNameOut}
910	fi
911	eval IGCM_sys_Put_Out ${ExeNameOut} ${R_OUT_EXE}/${PREFIX}_${ExeNameIn} rw
912	UpdateExe=true
913
914	IGCM_sys_GetDate_FichWork ${LS_bin} ExeSecDate
915	if [ $ExeSecDateMax -lt $ExeSecDate ] ; then
916	ExeSecDateMax=$ExeSecDate
917	fi
918	fi
919	done
920
921	# SD : switch off for now
922	#if ( ${UpdateExe} ) ; then
923	# echo "Launch SaveSourceModifications."
924	# IGCM_config_SaveSourceModifications ${ExeSecDateMax}
925	#fi
926
927	NextExeSize=${NextExeSize}" )"
928	IGCM_card_WriteOption ${SUBMIT_DIR}/run.card Log LastExeSize "${NextExeSize}"
929
930	if [ ${DRYRUN} -le 1 ] ; then
931	tail -1500 ${Exe_Output} > ${Exe_Output}_tail.txt
932	ExeCpuLog=$( gawk -f ${libIGCM}/libIGCM_sys/IGCM_add_out.awk ${Exe_Output}_tail.txt )
933	RET=$?
934	if [ $RET -eq 0 ] ; then
935	# ExeCpuLog variable contents 5 fields
936	echo "${CumulPeriod} ${PeriodDateBegin} ${PeriodDateEnd} ${ExeCpuLog} ${ExeDate}" \| \
937	gawk '{printf("# %11d \| %15s \| %15s \| %19s \| %19s \| %15.5f \| %15.5f \| %15.5f \| %s\n", \
938	$1,$2,$3,$4,$5,$6,$7,$8,$9)}' >> ${SUBMIT_DIR}/run.card
939	fi
940	eval FileToBeDeleted[${#FileToBeDeleted[@]}]="${Exe_Output}_tail.txt"
941	fi
942
943	fi
944
945	# All was right ? no ? then we stop.
946	IGCM_debug_Verif_Exit
947
948	# If all was OK, we can delete all files not necessary for next Job
949	echo
950	IGCM_debug_Print 1 "Files that will be deleted before next period-run : "
951
952	if [ ${DRYRUN} -le 2 ] ; then
953	for f in ${FileToBeDeleted[@]} ; do [ -f ${f} ] && ls -la $f ; [ -f ${f} ] && rm -f $f ; done
954	else
955	echo ${FileToBeDeleted[@]}
956	fi
957
958	#=================================================#
959	# Modification of libIGCM behaviour #
960	#=================================================#
961
962	# To use this function, one must copy libIGCM.card from ${libIGCM} directory
963	# and put it in ${SUBMIT_DIR} directory. After modifications of ${SUBMIT_DIR}/libIGCM.card,
964	# variables define inside [UserChanges] will be modified for next Period of libIGCM main loop.
965	if [ -f ${SUBMIT_DIR}/libIGCM.card ] ; then
966	echo
967	echo "########################################################################"
968	echo "!!! Modification of libIGCM behaviour !!!"
969	echo
970
971	IGCM_debug_Print 1 "DefineArrayFromOption : libIGCM_UserChanges in libIGCM.card"
972	IGCM_card_DefineArrayFromSection ${SUBMIT_DIR}/libIGCM.card UserChanges
973	IGCM_debug_Print 2 "libIGCM_UserChanges" ${libIGCM_UserChanges[*]}
974
975	# Special treatments for libIGCM internals
976	for option in ${libIGCM_UserChanges[*]} ; do
977	IGCM_card_DefineVariableFromOption ${SUBMIT_DIR}/libIGCM.card UserChanges ${option}
978
979	echo "We will change : ${option}."
980	eval echo "Previous value : " \${${option}}
981	eval echo "Change to : " \${libIGCM_UserChanges_${option}}
982
983	eval ${option}=\${libIGCM_UserChanges_${option}}
984
985	case ${option} in
986	config_UserChoices_DateEnd)
987	IGCM_debug_PrintVariables 1 config_UserChoices_DateEnd
988	DateEnd=$( IGCM_date_ConvertFormatToGregorian ${config_UserChoices_DateEnd} )
989
990	# Period Length In Days between DateBegin and DateEnd
991	(( ExperienceLengthInDays=$( IGCM_date_DaysBetweenGregorianDate ${DateEnd} ${DateBegin} ) + 1 ))
992	if [ ${ExperienceLengthInDays} -lt 0 ] ; then
993	IGCM_debug_Print 1 "Problem with dates in libIGCM.card : ${DateEnd} < ${DateBegin} ! You must check that."
994	IGCM_debug_Exit "IGCM_PeriodEnd" " Wrong Dates."
995	IGCM_debug_Verif_Exit
996	fi
997	;;
998	config_UserChoices_PeriodLength)
999	IGCM_debug_Print 1 "Change config_UserChoices_PeriodLength=${config_UserChoices_PeriodLength}"
1000	;;
1001	PeriodNb)
1002	IGCM_debug_Print 1 "Loop in main Job with ${PeriodNb} period(s)"
1003	;;
1004	config_Post_RebuildFrequency)
1005	IGCM_debug_Print 1 "Change config_Post_RebuildFrequency=${config_Post_RebuildFrequency} : IGCM_post_Configure"
1006	IGCM_post_Configure
1007	;;
1008	config_Post_TimeSeriesFrequency)
1009	IGCM_debug_Print 1 "Change config_Post_TimeSeriesFrequency = ${config_Post_TimeSeriesFrequency} : IGCM_post_Configure"
1010	IGCM_post_Configure
1011	;;
1012	config_Post_SeasonalFrequency)
1013	IGCM_debug_Print 1 "Change config_Post_SeasonalFrequency = ${config_Post_SeasonalFrequency} : IGCM_post_Configure"
1014	IGCM_post_Configure
1015	;;
1016	esac
1017	done
1018
1019	echo
1020	echo "########################################################################"
1021	echo
1022	fi
1023
1024	#=================================================#
1025	# Determine next computed period #
1026	#=================================================#
1027
1028	PeriodDateBegin=$( IGCM_date_AddDaysToGregorianDate ${PeriodDateEnd} 1 )
1029	IGCM_date_GetYearMonthDay $PeriodDateBegin year month day
1030	year_m1=$(( year - 1 ))
1031	year_p1=$(( year + 1 ))
1032	IGCM_config_Analyse_PeriodLength
1033	PeriodDateEnd=$( IGCM_date_AddDaysToGregorianDate ${PeriodDateBegin} $(( ${PeriodLengthInDays} - 1 )) )
1034
1035	# Debug Print :
1036	echo
1037	IGCM_debug_Print 1 "IGCM_config_PeriodEnd : Preparing Next Execution"
1038	IGCM_debug_Print 1 "PeriodDateBegin : ${PeriodDateBegin}"
1039	IGCM_debug_Print 1 "PeriodDateEnd : ${PeriodDateEnd}"
1040	IGCM_debug_Print 1 "PeriodLengthInDays : ${PeriodLengthInDays}"
1041
1042	PeriodDateBegin=$( IGCM_date_ConvertFormatToHuman ${PeriodDateBegin} )
1043	PeriodDateEnd=$( IGCM_date_ConvertFormatToHuman ${PeriodDateEnd} )
1044
1045	(( CumulPeriod = CumulPeriod + 1 ))
1046
1047	# Debug Print :
1048	echo
1049	IGCM_debug_Print 3 "PeriodDateBegin Human : ${PeriodDateBegin}"
1050	IGCM_debug_Print 3 "PeriodDateEnd Human : ${PeriodDateEnd}"
1051	IGCM_debug_Print 3 "CumulPeriod : ${CumulPeriod}"
1052
1053	#=================================================#
1054	# Write updated run.card #
1055	#=================================================#
1056
1057	IGCM_card_WriteOption ${SUBMIT_DIR}/run.card Configuration OldPrefix ${OldPrefix}
1058	IGCM_card_WriteOption ${SUBMIT_DIR}/run.card Configuration PeriodDateBegin ${PeriodDateBegin}
1059	IGCM_card_WriteOption ${SUBMIT_DIR}/run.card Configuration PeriodDateEnd ${PeriodDateEnd}
1060	IGCM_card_WriteOption ${SUBMIT_DIR}/run.card Configuration CumulPeriod ${CumulPeriod}
1061
1062	if ( ${FirstInitialize} ) ; then
1063	# It's no more the first time
1064	FirstInitialize=false
1065	fi
1066
1067	IGCM_debug_PopStack "IGCM_config_PeriodEnd"
1068	}
1069
1070	#===================================
1071	function IGCM_config_Finalize
1072	{
1073	IGCM_debug_PushStack "IGCM_config_Finalize"
1074
1075	echo
1076	IGCM_debug_Print 1 "IGCM_config_Finalize"
1077	echo
1078
1079	if [ ${SimulationLengthInDays} -ge ${ExperienceLengthInDays} ] ; then
1080	#==========================#
1081	# End of entire simulation #
1082	#==========================#
1083
1084	# Mail notification
1085	IGCM_sys_SendMail
1086
1087	#
1088	IGCM_card_WriteOption ${SUBMIT_DIR}/run.card Configuration PeriodState "Completed"
1089	IGCM_debug_Print 1 "Normal End of computation."
1090	if ( $DEBUG_debug ) ; then
1091	echo
1092	IGCM_debug_Print 1 "Your files on ${R_SAVE} :"
1093	IGCM_sys_Tree ${R_SAVE}
1094
1095	IGCM_debug_Print 1 "Your files on ${R_BUFR} :"
1096	IGCM_sys_Tree ${R_BUFR}
1097	fi
1098	else
1099	#=================#
1100	# Submit next job #
1101	#=================#
1102
1103	IGCM_card_WriteOption ${SUBMIT_DIR}/run.card Configuration PeriodState "OnQueue"
1104
1105	# Name of next Ksh Script output :
1106	eval Script_Output="${Script_Output_Prefix}_${config_UserChoices_JobName}.$( printf "%06d" ${CumulPeriod} )"
1107
1108	IGCM_debug_Print 1 "Submit next job"
1109	# SUBMIT NEXT JOB from SUBMIT_DIR and come back in RUN_DIR
1110	IGCM_sys_Cd ${SUBMIT_DIR}
1111	# Keep only the 5 latest ${Script_Output_Prefix}_${config_UserChoices_JobName}
1112	ScriptTot=$( ls ${Script_Output_Prefix}_${config_UserChoices_JobName}.?????? 2>/dev/null \| wc -l )
1113	[ ${ScriptTot} -gt 5 ] && rm -f $( ls ${Script_Output_Prefix}_${config_UserChoices_JobName}.?????? \| head -$(( ${ScriptTot} - 5 )) )
1114	# Submit next job and come back
1115	IGCM_sys_Qsub ${SUBMIT_DIR}/Job_${config_UserChoices_JobName}
1116	IGCM_sys_Cd -
1117	fi
1118
1119	# Supress Non Deleted Boundary files
1120	if [ ${DRYRUN} -le 2 ] ; then
1121	IGCM_comp_DelFixeBoundaryFiles
1122	ls -la
1123	fi
1124
1125	# Clean ${RUN_DIR}=${RUN_DIR_PATH}/${config_UserChoices_TagName}/${config_UserChoices_JobName}
1126	# Only for production run (No clean up in DEV or DEB mode)
1127	# and command sent from .. directory.
1128	IGCM_sys_Cd ..
1129	[ X${JobType} = XRUN ] && IGCM_sys_Rm -rf ${RUN_DIR}
1130
1131	IGCM_debug_PopStack "IGCM_config_Finalize"
1132	}
1133
1134	#===================================

Note: See TracBrowser for help on using the repository browser.

Context Navigation

source: tags/libIGCM_v2.0_beta1/libIGCM_config/libIGCM_config.ksh @ 1435

Download in other formats: