Context Navigation

libIGCM_comp.ksh @ 1211

Last change on this file since 1211 was 662, checked in by acosce, 12 years ago

BugFix? for inca config

1- management of two executable with only one launch (inca individual case)
2- refine restart list and will find restart with different extension (.nc, .txt etc...)

Property licence set to
The following licence information concerns ONLY the libIGCM tools
==================================================================

Copyright © Centre National de la Recherche Scientifique CNRS
Commissariat à l'Énergie Atomique CEA

libIGCM : Library for Portable Models Computation of IGCM Group.

IGCM Group is the french IPSL Global Climate Model Group.

This library is a set of shell scripts and functions whose purpose is
the management of the initialization, the launch, the transfer of
output files, the post-processing and the monitoring of datas produce
by any numerical program on any plateforme.

This software is governed by the CeCILL license under French law and
abiding by the rules of distribution of free software. You can use,
modify and/ or redistribute the software under the terms of the CeCILL
license as circulated by CEA, CNRS and INRIA at the following URL
"http://www.cecill.info".

As a counterpart to the access to the source code and rights to copy,
modify and redistribute granted by the license, users are provided only
with a limited warranty and the software's author, the holder of the
economic rights, and the successive licensors have only limited
liability.

In this respect, the user's attention is drawn to the risks associated
with loading, using, modifying and/or developing or reproducing the
software by the user in light of its specific status of free software,
that may mean that it is complicated to manipulate, and that also
therefore means that it is reserved for developers and experienced
professionals having in-depth computer knowledge. Users are therefore
encouraged to load and test the software's suitability as regards their
requirements in conditions enabling the security of their systems and/or
data to be ensured and, more generally, to use and operate it in the
same conditions as regards security.

The fact that you are presently reading this means that you have had
knowledge of the CeCILL license and that you accept its terms.
Property svn:keywords set to Revision Author Date

File size: 44.2 KB

Line
1	#!/bin/ksh
2
3	#**************************************************************
4	# Author: Sebastien Denvil, Martial Mancip
5	# Contact: Sebastien.Denvil__at__ipsl.jussieu.fr Martial.Mancip__at__ipsl.jussieu.fr
6	# $Revision:: $ Revision of last commit
7	# $Author:: $ Author of last commit
8	# $Date:: $ Date of last commit
9	# IPSL (2006)
10	# This software is governed by the CeCILL licence see libIGCM/libIGCM_CeCILL.LIC
11	#
12	#**************************************************************
13
14	#========================================================================
15	function IGCM_comp_Initialize
16	{
17	IGCM_debug_PushStack "IGCM_comp_Initialize"
18
19	# Debug Print :
20	echo
21	IGCM_debug_Print 1 "IGCM_comp_Initialize"
22	echo
23
24	typeset comp compname comptagname CompatibilityTag auxprint card_UserChoices first_option option i j
25	for comp in ${config_ListOfComponents[*]} ; do
26
27	# Define component
28	IGCM_card_DefineArrayFromOption ${SUBMIT_DIR}/config.card ListOfComponents ${comp}
29	eval compname=\${config_ListOfComponents_${comp}[0]} > /dev/null 2>&1
30	eval comptagname=\${config_ListOfComponents_${comp}[1]} > /dev/null 2>&1
31
32	# Debug Print
33	IGCM_debug_Print 1 "Initialize ${comp} : ${compname} component."
34
35	# Read libIGCM compatibility version in ${compname}.card
36	card=${SUBMIT_DIR}/COMP/${compname}.card
37	IGCM_card_DefineVariableFromOption ${card} Compatibility libIGCM
38
39	eval CompatibilityTag=\${${compname}_Compatibility_libIGCM} > /dev/null 2>&1
40	if [ ! "${CompatibilityTag}" = "${libIGCM_CurrentTag}" ] ; then
41	IGCM_debug_Exit "${compname}.card is not compatible with libIGCM version ${libIGCM_CurrentTag} see libIGCM FAQ http://wiki.ipsl.jussieu.fr/wiki_ipsl/IGCMG/libIGCM/DocUtilisateur/FAQ ."
42	fi
43
44	# Manage component executable
45	IGCM_card_DefineArrayFromOption ${SUBMIT_DIR}/config.card Executable ${comp}
46
47	# Read component Write Frequency in config.card
48	IGCM_card_DefineVariableFromOption ${SUBMIT_DIR}/config.card ${comp} WriteFrequency
49	# Debug Print :
50	eval auxprint=\${config_${comp}_WriteFrequency}
51	IGCM_debug_Print 1 "Write frequency for ${compname} : ${auxprint} "
52	#2> /dev/null
53
54	# Debug Print :
55	IGCM_debug_Print 2 "Initialize following component library"
56
57	# Source drivers in directory DRIVER if it exist
58	# else source them from directory COMP
59	if [ -d ${SUBMIT_DIR}/DRIVER ] ; then
60	IGCM_debug_Print 2 ${SUBMIT_DIR}/DRIVER/${compname}.driver
61	# Source component library
62	. ${SUBMIT_DIR}/DRIVER/${compname}.driver
63	else
64	IGCM_debug_Print 2 ${SUBMIT_DIR}/COMP/${compname}.driver
65	# Source component library
66	. ${SUBMIT_DIR}/COMP/${compname}.driver
67	fi
68	IGCM_debug_Print 3 "With tag : ${comptagname}"
69
70	# Debug Print
71	IGCM_debug_Print 3 "Initialize ${comp} output directory."
72
73	# Define ARCHIVED Dirs
74	eval R_OUT_${comp}=${R_SAVE}/${comp}
75	eval IGCM_sys_MkdirArchive \${R_OUT_${comp}}
76
77	eval R_OUT_${comp}_O=\${R_OUT_${comp}}/Output
78	eval IGCM_sys_MkdirArchive \${R_OUT_${comp}_O}
79
80	eval R_OUT_${comp}_R=\${R_OUT_${comp}}/Restart
81	eval IGCM_sys_MkdirArchive \${R_OUT_${comp}_R}
82
83	eval R_OUT_${comp}_D=\${R_OUT_${comp}}/Debug
84	eval IGCM_sys_MkdirArchive \${R_OUT_${comp}_D}
85
86	eval R_OUT_${comp}_O_I=\${R_OUT_${comp}_O}/INS
87	eval R_OUT_${comp}_O_H=\${R_OUT_${comp}_O}/HF
88	eval R_OUT_${comp}_O_D=\${R_OUT_${comp}_O}/DA
89	eval R_OUT_${comp}_O_M=\${R_OUT_${comp}_O}/MO
90	eval R_OUT_${comp}_O_Y=\${R_OUT_${comp}_O}/YE
91
92	# Define BUFFERED Dirs
93	eval R_BUF_${comp}=${R_BUFR}/${comp}
94	eval IGCM_sys_Mkdir \${R_BUF_${comp}}
95
96	eval R_BUF_${comp}_O=\${R_BUF_${comp}}/Output
97	eval IGCM_sys_Mkdir \${R_BUF_${comp}_O}
98
99	eval R_BUF_${comp}_R=\${R_BUF_${comp}}/Restart
100	eval IGCM_sys_Mkdir \${R_BUF_${comp}_R}
101
102	eval R_BUF_${comp}_D=\${R_BUF_${comp}}/Debug
103	eval IGCM_sys_Mkdir \${R_BUF_${comp}_D}
104
105	eval R_BUF_${comp}_O_I=\${R_BUF_${comp}_O}/INS
106	eval R_BUF_${comp}_O_H=\${R_BUF_${comp}_O}/HF
107	eval R_BUF_${comp}_O_D=\${R_BUF_${comp}_O}/DA
108	eval R_BUF_${comp}_O_M=\${R_BUF_${comp}_O}/MO
109	eval R_BUF_${comp}_O_Y=\${R_BUF_${comp}_O}/YE
110
111	# Read UserChoices section of component card
112	IGCM_debug_Print 2 "DefineArrayFromSection : ${compname}_UserChoices ${card}"
113	IGCM_card_DefineArrayFromSection ${card} UserChoices
114	eval first_option=\${${compname}_UserChoices[0]} > /dev/null 2>&1
115	# If section is not empty we define corresponding variables
116	if [ X${first_option} != X"Error:" ] ; then
117	if [ X${card_UserChoices[0]} != X ] ; then
118	unset card_UserChoices
119	fi
120	eval set +A card_UserChoices -- \${${compname}_UserChoices[*]} > /dev/null 2>&1
121	IGCM_debug_Print 3 "${compname}_UserChoices_values:"
122	for option in ${card_UserChoices[*]} ; do
123	IGCM_card_DefineVariableFromOption ${card} UserChoices ${option}
124	eval IGCM_debug_Print 3 "${option}=\${${compname}_UserChoices_${option}}"
125	done
126	fi
127
128	# Read and Build Output File stuff
129	IGCM_debug_Print 2 "DefineArrayFromOption : ${compname}_OutputFiles ${card}"
130	IGCM_card_DefineArrayFromOption ${card} OutputFiles List
131	ListFilesName=${compname}_OutputFiles_List
132	eval FileName0=\${${ListFilesName}[0]} > /dev/null 2>&1
133	#
134	if [ X${FileName0} != X${NULL_STR} ] ; then
135	#
136	#IGCM_debug_Print 1 "Component : ${compname}"
137	#
138	# INITIALISATION
139	#
140	eval NbFiles=\${#${ListFilesName}[@]} > /dev/null 2>&1
141	#
142	i=2
143	#
144	until [ $i -ge $NbFiles ]; do
145	#
146	eval flag_post=\${${ListFilesName}[$i]} > /dev/null 2>&1
147	#
148	if [ X${flag_post} != XNONE ] ; then
149	#
150	# First of all
151	#
152	IGCM_card_DefineArrayFromSection ${card} ${flag_post}
153	#
154	# Seasonal case : If option Seasonal is not found (old cards) put SEASONAL ON by default
155	#
156	# variable option allready typeset above
157	for option in $( eval echo \${${compname}_${flag_post}[*]} ) ; do
158	if [ ${option} = Seasonal ] ; then
159	FoundSeasonal=true
160	IGCM_card_DefineVariableFromOption ${card} ${flag_post} Seasonal
161	fi
162	done
163	#
164	if [ ! X${FoundSeasonal} = Xtrue ] ; then
165	eval ${compname}_${flag_post}_Seasonal=ON
166	fi
167	#
168	if [ $( eval echo \${${compname}_${flag_post}_Seasonal} ) = ON ] ; then
169	Seasonal=true
170	fi
171
172	# Dimension = vide si vieille card.
173	IGCM_card_DefineArrayFromOption ${card} ${flag_post} TimeSeriesVars
174	IGCM_card_DefineArrayFromOption ${card} ${flag_post} Patches
175	if [ X"$( eval echo \${${compname}_${flag_post}_TimeSeriesVars[*]} )" = X"Option not" ] ; then
176	# New TimeSeriesVar description, with 2D, 3D and associate ChunckJob.
177	ListDimension[0]=2D
178	ListDimension[1]=3D
179	TimeSeries=false
180	iLoop=${#ListDimension[*]}
181	j=0
182	until [ $j -ge ${iLoop} ]; do
183	Dimension=${ListDimension[${j}]}
184	IGCM_card_DefineArrayFromOption ${card} ${flag_post} TimeSeriesVars${Dimension}
185	IGCM_card_DefineVariableFromOption ${card} ${flag_post} ChunckJob${Dimension}
186	#
187	# Time series WITHOUT chunk
188	#
189	if [ ! $( eval echo \${${compname}_${flag_post}_TimeSeriesVars${Dimension}} ) = ${NULL_STR} ] ; then
190	if [ $( eval echo \${${compname}_${flag_post}_ChunckJob${Dimension}} ) = NONE ] ; then
191	IGCM_debug_Print 3 "${Dimension} time series activated for ${flag_post}"
192	eval TimeSeries${Dimension}=true
193	fi
194	fi
195	#
196	# Time series WITH chunk
197	#
198	if [ ! $( eval echo \${${compname}_${flag_post}_TimeSeriesVars${Dimension}} ) = ${NULL_STR} ] ; then
199	chunck_size=$( eval echo \${${compname}_${flag_post}_ChunckJob${Dimension}} )
200	if [ ! ${chunck_size} = NONE ] && [ ! ${chunck_size} = OFF ] ; then
201	IGCM_debug_Print 3 "${Dimension} time series activated with chunck for ${flag_post}"
202	eval TimeSeriesChunck${Dimension}=true
203	eval set +A CHUNCK${Dimension}_COMP \${CHUNCK${Dimension}_COMP[*]} ${comp}
204	eval set +A CHUNCK${Dimension}_FLAG \${CHUNCK${Dimension}_FLAG[*]} ${i}
205	eval set +A CHUNCK${Dimension}_NAME \${CHUNCK${Dimension}_NAME[*]} ${flag_post}
206	eval set +A CHUNCK${Dimension}_SIZE \${CHUNCK${Dimension}_SIZE[*]} ${chunck_size}
207	fi
208	fi
209	(( j=j+1 ))
210	done
211	else
212	ListDimension[0]=""
213	TimeSeries=true
214	TimeSeries2D=false
215	TimeSeries3D=false
216	TimeSeriesChunck2D=false
217	TimeSeriesChunck3D=false
218	fi
219	fi
220	(( i=i+3 ))
221	done
222	fi
223	# Debug Print
224	IGCM_debug_Print 3 "Initialize ${compname} with driver."
225	# INIT component
226	${comp}_Initialize
227	echo
228	done
229
230	IGCM_debug_PopStack "IGCM_comp_Initialize"
231	}
232
233	#=======================================================================
234	function IGCM_comp_PrepareDeletedFiles
235	{
236	IGCM_debug_PushStack "IGCM_comp_PrepareDeletedFiles" $@
237
238	if [ X${2} != X. ] ; then
239	eval FileToBeDeleted[${#FileToBeDeleted[@]}]=$( basename ${2} ) > /dev/null 2>&1
240	else
241	eval FileToBeDeleted[${#FileToBeDeleted[@]}]=$( basename ${1} ) > /dev/null 2>&1
242	fi
243
244	IGCM_debug_PopStack "IGCM_comp_PrepareDeletedFiles"
245	}
246
247	#=======================================================================
248	function IGCM_comp_GetInputInitialStateFiles
249	{
250	IGCM_debug_PushStack "IGCM_comp_GetInputInitialStateFiles"
251
252	# Debug Print :
253	echo
254	IGCM_debug_Print 1 "IGCM_comp_GetInputInitialStateFiles"
255	echo
256
257	# Only the first time step need InitialStateFiles
258	# otherwise it's BoundaryConditions
259	if ( ${FirstInitialize} ) ; then
260	typeset comp compname comptagname card ListFilesName FileName0 NbFiles i i_
261	typeset file_in_ file_in file_out_ file_out do_init
262	for comp in ${config_ListOfComponents[*]} ; do
263	# Initialize
264	do_init="y"
265	# Do we need to bring initial state file for this component
266	if [ "${config_Restarts_OverRule}" = "y" ] ; then
267	eval do_init="n"
268	else
269	# Read component Restarts parameters
270	IGCM_card_DefineVariableFromOption ${SUBMIT_DIR}/config.card ${comp} Restart
271	eval do_start=\${config_${comp}_Restart} > /dev/null 2>&1
272	if [ "${do_start}" = "y" ] ; then
273	do_init="n"
274	else
275	do_init="y"
276	fi
277	fi
278
279	if [ "${do_init}" = "y" ] ; then
280	# Define component
281	eval compname=\${config_ListOfComponents_${comp}[0]} > /dev/null 2>&1
282	eval comptagname=\${config_ListOfComponents_${comp}[1]} > /dev/null 2>&1
283
284	# Debug Print :
285	IGCM_debug_Print 3 "Initialisation files ${compname}"
286
287	card=${SUBMIT_DIR}/COMP/${compname}.card
288
289	IGCM_card_DefineArrayFromOption ${card} InitialStateFiles List
290	ListFilesName=${compname}_InitialStateFiles_List
291
292	eval FileName0=\${${ListFilesName}[0]} > /dev/null 2>&1
293	if [ X${FileName0} != X${NULL_STR} ] ; then
294	eval NbFiles=\${#${ListFilesName}[@]} > /dev/null 2>&1
295	(( i=0 ))
296	until [ $i -ge $NbFiles ]; do
297	eval file_in_=\${${ListFilesName}[$i]} > /dev/null 2>&1
298	eval file_in=${file_in_}
299	(( i_ = i+1 ))
300	eval file_out_=\${${ListFilesName}[$i_]} > /dev/null 2>&1
301	eval file_out=${file_out_}
302
303	IGCM_sys_IsFileArchived ${file_in}
304	if [ $? = 0 ] ; then
305	IGCM_sys_Get ${file_in} ${file_out}
306	#IGCM_comp_PrepareDeletedFiles ${file_in} ${file_out}
307	else
308	IGCM_sys_Cp ${file_in} ${file_out}
309	fi
310	(( i=i+2 ))
311	done
312	fi
313	fi
314	done
315	fi
316	IGCM_debug_PopStack "IGCM_comp_GetInputInitialStateFiles"
317	}
318
319	#=======================================================================
320	# Definition of Smooth modulo function
321	# usage :
322	# IGCM_SmoothModulo StringModulo value
323	#
324	# StringModulo : A string of min max and modulo like definition of Scilab vectors.
325	# [min]:[modulo:][max]
326	# where :
327	# [] value are optionnals;
328	# empty min equal 1
329	# empty max equal infinity
330	# modulo not given or empty equal 1
331	# empty string or just ':' equal always.
332	#
333	# value : the value to test with the definition
334	#
335	# return : true(1)/false(0)
336	function IGCM_SmoothModulo
337	{
338	IGCM_debug_PushStack "IGCM_SmoothModulo"
339	typeset defVector ModValue
340
341	eval set +A defVector -- $( echo "${1}" \| \
342	gawk -F ':' '{print ($1 == "" ? 1 : $1) " " (NF==3 ? ($2 == "" ? 1 : $2) : 1) " " (NF==3 ? ($3 == "" ? -1 : $3) : ($2 == "" ? -1 : $2))}' )
343
344	# Save Smooth Min and Max. Needed to call IGCM_sys_Get when appropriate
345	arr[1]=${defVector[0]}
346	arr[2]=${defVector[2]}
347
348	# Test limits :
349	# ${defVector[0]} <= ${2} <= ${defVector[2]}
350	# or ${defVector[2]} == -1
351	if ( [ ${2} -ge ${defVector[0]} ] && ( [ ${2} -le ${defVector[2]} ] \|\| [ ${defVector[2]} -lt 0 ] ) ) ; then
352	# Test modulo
353	ModValue=$( expr $ ${2} - ${defVector[0]} $ % ${defVector[1]} )
354	if [ ${ModValue} -eq 0 ] ; then
355	arr[3]=true
356	echo ${arr[@]}
357	IGCM_debug_PopStack "IGCM_SmoothModulo"
358	return 1
359	else
360	arr[3]=false
361	echo ${arr[@]}
362	IGCM_debug_PopStack "IGCM_SmoothModulo"
363	return 0
364	fi
365	else
366	arr[3]=false
367	echo ${arr[@]}
368	IGCM_debug_PopStack "IGCM_SmoothModulo"
369	return 0
370	fi
371	}
372
373	#=======================================================================
374	function IGCM_comp_GetInputSmoothFiles
375	{
376	IGCM_debug_PushStack "IGCM_comp_GetInputSmoothFiles"
377
378	# Debug Print :
379	echo
380	IGCM_debug_Print 1 "IGCM_comp_GetInputSmoothFiles"
381	echo
382
383	typeset comp compname comptagname card ListFilesName FileName0 NbFiles j i i_ i__
384	typeset file_in_ file_in file_out_ file_out ret SmoothDef aux val
385
386	for comp in ${config_ListOfComponents[*]} ; do
387	# Define component
388	eval compname=\${config_ListOfComponents_${comp}[0]} > /dev/null 2>&1
389	eval comptagname=\${config_ListOfComponents_${comp}[1]} > /dev/null 2>&1
390
391	# Debug Print :
392	IGCM_debug_Print 3 "Smooth files ${compname}"
393
394	card=${SUBMIT_DIR}/COMP/${compname}.card
395
396	IGCM_card_DefineArrayFromOption ${card} SmoothFiles List
397	ListFilesName=${compname}_SmoothFiles_List
398	eval FileName0=\${${ListFilesName}[0]} > /dev/null 2>&1
399
400	if ( [ X${FileName0} != X${NULL_STR} ] && [ X${FileName0} != X"Section" ] ) ; then
401	eval NbFiles=\${#${ListFilesName}[@]} > /dev/null 2>&1
402
403	(( i=0 ))
404	until [ $i -ge $NbFiles ]; do
405	eval file_in_=\${${ListFilesName}[$i]} > /dev/null 2>&1
406	eval file_in=${file_in_}
407	(( i_ = i+1 ))
408	eval file_out_=\${${ListFilesName}[$i_]} > /dev/null 2>&1
409	eval file_out=${file_out_}
410
411	# define CumulPeriod definition for this file
412	(( i__ = i+2 ))
413	eval SmoothDef=\${${ListFilesName}[$i__]}
414	IGCM_debug_Print 3 " ${file_in} ${SmoothDef}"
415	aux=$( IGCM_SmoothModulo ${SmoothDef} ${CumulPeriod} )
416	j=1
417	for val in ${aux} ; do
418	[ ${j} -eq 1 ] && SmoothMin=${val}
419	[ ${j} -eq 2 ] && SmoothMax=${val}
420	[ ${j} -eq 3 ] && ret=${val}
421	(( j=j+1 ))
422	done
423	[ ${SmoothMax} -eq -1 ] && SmoothMax=${CumulPeriod}
424	if ( [ X${ret} = Xtrue ] \|\| ( [ ${Period} -eq 1 ] && [ ${CumulPeriod} -ge ${SmoothMin} ] && [ ${CumulPeriod} -le ${SmoothMax} ] ) ) ; then
425
426	IGCM_sys_IsFileArchived ${file_in}
427	if [ $? = 0 ] ; then
428	IGCM_sys_Get ${file_in} ${file_out}
429	#IGCM_comp_PrepareDeletedFiles ${file_in} ${file_out}
430	else
431	IGCM_sys_Cp ${file_in} ${file_out}
432	fi
433	fi
434	(( i=i+3 ))
435	done
436	fi
437	done
438
439	IGCM_debug_PopStack "IGCM_comp_GetInputSmoothFiles"
440	}
441
442	#=======================================================================
443	function IGCM_comp_GetInputBoundaryFiles
444	{
445	IGCM_debug_PushStack "IGCM_comp_GetInputBoundaryFiles"
446
447	# Debug Print :
448	echo
449	IGCM_debug_Print 1 "IGCM_comp_GetInputBoundaryFiles"
450	echo
451
452	typeset comp compname comptagname card ListFilesName FileName0 NbFiles i i_
453	typeset file_in_ file_in file_out_ file_out
454
455	if [ ${Period} = 1 ]; then
456	ListFixBoundary=" "
457	fi
458
459	for comp in ${config_ListOfComponents[*]} ; do
460
461	# Define component
462	eval compname=\${config_ListOfComponents_${comp}[0]} > /dev/null 2>&1
463	eval comptagname=\${config_ListOfComponents_${comp}[1]} > /dev/null 2>&1
464
465	# Debug Print :
466	IGCM_debug_Print 3 "Boundary files ${compname}"
467
468	card=${SUBMIT_DIR}/COMP/${compname}.card
469
470	IGCM_card_DefineArrayFromOption ${card} BoundaryFiles List
471	ListFilesName=${compname}_BoundaryFiles_List
472	eval FileName0=\${${ListFilesName}[0]} > /dev/null 2>&1
473
474	if [ X${FileName0} != X${NULL_STR} ] ; then
475	eval NbFiles=\${#${ListFilesName}[@]} > /dev/null 2>&1
476
477	(( i=0 ))
478	until [ $i -ge $NbFiles ]; do
479	eval file_in_=\${${ListFilesName}[$i]} > /dev/null 2>&1
480	eval file_in=${file_in_}
481	(( i_ = i+1 ))
482	eval file_out_=\${${ListFilesName}[$i_]} > /dev/null 2>&1
483	eval file_out=${file_out_}
484
485	IGCM_sys_IsFileArchived ${file_in}
486	if [ $? = 0 ] ; then
487	IGCM_sys_Get ${file_in} ${file_out}
488	#IGCM_comp_PrepareDeletedFiles ${file_in} ${file_out}
489	else
490	IGCM_sys_Cp ${file_in} ${file_out}
491	fi
492
493	(( i=i+2 ))
494	done
495	fi
496
497	# Get non deleted files
498	if [ ${Period} = 1 ]; then
499
500	IGCM_card_DefineArrayFromOption ${card} BoundaryFiles ListNonDel
501	ListFilesName=${compname}_BoundaryFiles_ListNonDel
502	eval FileName0=\${${ListFilesName}[0]} > /dev/null 2>&1
503
504	if [ X${FileName0} != X${NULL_STR} ] ; then
505	eval NbFiles=\${#${ListFilesName}[@]} > /dev/null 2>&1
506
507	(( i=0 ))
508	until [ $i -ge $NbFiles ]; do
509	eval file_in_=\${${ListFilesName}[$i]} > /dev/null 2>&1
510	eval file_in=${file_in_}
511	(( i_ = i+1 ))
512	eval file_out_=\${${ListFilesName}[$i_]} > /dev/null 2>&1
513	eval file_out=${file_out_}
514
515	IGCM_sys_IsFileArchived ${file_in}
516	if [ $? = 0 ] ; then
517	IGCM_sys_Get ${file_in} ${file_out}
518	#IGCM_comp_PrepareDeletedFiles ${file_in} ${file_out}
519	else
520	IGCM_sys_Cp ${file_in} ${file_out}
521	fi
522
523	if [ X${file_out} != X. ] ; then
524	ListFixBoundary=${ListFixBoundary}" "${file_out}
525	else
526	ListFixBoundary=${ListFixBoundary}" "$( basename ${file_in} )
527	fi
528
529	(( i=i+2 ))
530	done
531	fi
532	fi
533	done
534
535	IGCM_debug_PopStack "IGCM_comp_GetInputBoundaryFiles"
536	}
537
538	#=======================================================================
539	function IGCM_comp_DelFixeBoundaryFiles
540	{
541	IGCM_debug_PushStack "IGCM_comp_DelFixeBoundaryFiles"
542
543	# Debug Print :
544	echo
545	IGCM_debug_Print 1 "IGCM_comp_DelFixeBoundaryFiles"
546	echo
547
548	ls -l ${ListFixBoundary}
549	rm -f ${ListFixBoundary}
550
551	IGCM_debug_PopStack "IGCM_comp_DelFixeBoundaryFiles"
552	}
553
554	#=======================================================================
555	function IGCM_comp_GetInputParametersFiles
556	{
557	IGCM_debug_PushStack "IGCM_comp_GetInputParametersFiles"
558
559	# Debug Print :
560	echo
561	IGCM_debug_Print 1 "IGCM_comp_GetInputParametersFiles"
562	echo
563
564	typeset comp compname comptagname card ListFilesName FileName0 NbFiles i i_ file_in file_out
565	for comp in ${config_ListOfComponents[*]} ; do
566	# Define component
567	eval compname=\${config_ListOfComponents_${comp}[0]} > /dev/null 2>&1
568	eval comptagname=\${config_ListOfComponents_${comp}[1]} > /dev/null 2>&1
569
570	# Debug Print :
571	IGCM_debug_Print 3 "Parameters ${compname}"
572
573	card=${SUBMIT_DIR}/COMP/${compname}.card
574
575	IGCM_card_DefineArrayFromOption ${card} ParametersFiles List
576	ListFilesName=${compname}_ParametersFiles_List
577	eval FileName0=\${${ListFilesName}[0]} > /dev/null 2>&1
578
579	if [ X${FileName0} != X${NULL_STR} ] ; then
580	eval NbFiles=\${#${ListFilesName}[@]} > /dev/null 2>&1
581
582	(( i=0 ))
583	until [ $i -ge $NbFiles ]; do
584	eval file_in_=\${${ListFilesName}[$i]} > /dev/null 2>&1
585	eval file_in=${file_in_}
586	(( i_ = i+1 ))
587	eval file_out_=\${${ListFilesName}[$i_]} > /dev/null 2>&1
588	eval file_out=${file_out_}
589
590	IGCM_sys_Cp ${file_in} ${file_out}
591	IGCM_comp_PrepareDeletedFiles ${file_in} ${file_out}
592
593	(( i=i+2 ))
594	done
595	fi
596	done
597
598	IGCM_debug_PopStack "IGCM_comp_GetInputParametersFiles"
599	}
600
601	#=======================================================================
602	function IGCM_comp_GetInputRestartFiles
603	{
604	IGCM_debug_PushStack "IGCM_comp_GetInputRestartFiles"
605
606	# Debug Print :
607	echo
608	IGCM_debug_Print 1 "IGCM_comp_GetInputRestartFiles"
609	echo
610
611	typeset Date_tmp Date_r Path_r do_start CompOldName Path_OUT Path_BUF
612	typeset Buffered Archived Tared PotentialTarFile IsMatching TarFileFound
613	typeset comp compname comptagname card ListFilesName FileName0 NbFiles i i_
614	typeset file_in file_out file_in_ file_out_ file_in_Name
615	typeset -Z4 j4
616
617	for comp in ${config_ListOfComponents[*]} ; do
618	# Define component
619	eval compname=\${config_ListOfComponents_${comp}[0]} > /dev/null 2>&1
620	eval comptagname=\${config_ListOfComponents_${comp}[1]} > /dev/null 2>&1
621	#
622	card=${SUBMIT_DIR}/COMP/${compname}.card
623	#
624	IGCM_card_DefineArrayFromOption ${card} RestartFiles List
625	ListFilesName=${compname}_RestartFiles_List
626	eval FileName0=\${${ListFilesName}[0]} > /dev/null 2>&1
627
628	# Debug Print :
629	IGCM_debug_Print 3 "restart ${compname}"
630
631	if ( ${FirstInitialize} ) ; then
632
633	if [ "${config_Restarts_OverRule}" = "y" ] ; then
634	eval config_${comp}_Restart="y"
635	eval config_${comp}_RestartDate=${config_Restarts_RestartDate}
636	eval config_${comp}_RestartJobName=${config_Restarts_RestartJobName}
637	eval config_${comp}_RestartPath=${config_Restarts_RestartPath}
638	eval do_start=\${config_${comp}_Restart} > /dev/null 2>&1
639	eval CompOldName=${comp}
640	else
641	# Read component Restarts parameters
642	IGCM_card_DefineVariableFromOption ${SUBMIT_DIR}/config.card ${comp} Restart
643	eval do_start=\${config_${comp}_Restart} > /dev/null 2>&1
644
645	if [ "${do_start}" = "y" ] ; then
646	IGCM_card_DefineVariableFromOption ${SUBMIT_DIR}/config.card ${comp} RestartDate
647	IGCM_card_DefineVariableFromOption ${SUBMIT_DIR}/config.card ${comp} RestartJobName
648	IGCM_card_DefineVariableFromOption ${SUBMIT_DIR}/config.card ${comp} RestartPath
649	else
650	eval config_${comp}_RestartDate=-1
651	eval config_${comp}_RestartJobName=${NULL_STR}
652	eval config_${comp}_RestartPath=${NULL_STR}
653	fi
654	IGCM_card_DefineVariableFromOption ${SUBMIT_DIR}/config.card ${comp} OldName
655	eval CompOldName=\${config_${comp}_OldName}
656	if [ X${CompOldName} = X ] ; then
657	eval CompOldName=${comp}
658	fi
659	fi
660
661	if [ "${do_start}" = "y" ] ; then
662
663	if ( [ X${FileName0} != X${NULL_STR} ] && [ X${FileName0} != XNONE ] ) ; then
664	eval NbFiles=\${#${ListFilesName}[@]} > /dev/null 2>&1
665
666	(( i=1 ))
667	until [ $i -gt $NbFiles ]; do
668	eval file_in_=\${${ListFilesName}[$i]} > /dev/null 2>&1
669	eval file_in=${file_in_}
670
671	(( i_ = i+1 ))
672	eval file_out_=\${${ListFilesName}[$i_]} > /dev/null 2>&1
673	eval file_out=${file_out_}
674
675	eval Date_tmp=\${config_${comp}_RestartDate}
676	Date_r=$( IGCM_date_ConvertFormatToGregorian ${Date_tmp} )
677	eval Path_r=\${config_${comp}_RestartPath}/\${config_${comp}_RestartJobName}/${CompOldName}/Restart
678	eval file_in_Name=\${config_${comp}_RestartJobName}_${Date_r}_${file_in}
679
680	generic_restart_file_name_in=$( basename ${file_in_Name} .nc )
681	generic_restart_file_name_out=$( basename ${file_out} .nc )
682
683	eval Path_OUT=\${Path_r}/${generic_restart_file_name_in}
684	nb_restart_file=$(IGCM_sys_CountFileArchive ${Path_OUT}_????.nc)
685
686	if [ ${nb_restart_file} -gt 1 ] ; then
687	j=0
688	until [ $j -ge $nb_restart_file ]; do
689	j4=${j}
690	eval IGCM_sys_Get ${Path_r}/${generic_restart_file_name_in}_${j4}.nc ${generic_restart_file_name_out}_${j4}.nc
691	#IGCM_comp_PrepareDeletedFiles ${generic_restart_file_name_in}_${j4}.nc ${generic_restart_file_name_out}_${j4}.nc
692	#eval FileToBeDeleted[${#FileToBeDeleted[@]}]="${generic_restart_file_name_out}_${j4}.nc" > /dev/null 2>&1
693	(( j=j+1 ))
694	done
695	else
696	eval IGCM_sys_Get ${Path_r}/${file_in_Name} ${file_out}
697	#IGCM_comp_PrepareDeletedFiles ${file_in} ${file_out}
698	fi
699
700	(( i=i+3 ))
701	done
702	else
703	if [ X${FileName0} != XNONE ] ; then
704	IGCM_debug_Exit "IGCM_comp_GetInputRestartFiles : No file in list for ${compname}."
705	else
706	IGCM_debug_Print 1 "IGCM_comp_GetInputRestartFiles : NONE specified in Restart List ${compname}."
707	fi
708	fi
709	fi
710	elif [ ${Period} -eq 1 ] ; then
711	# if not FirstInitialize and first loop of this job
712
713	# Restore Restarts files
714	#-----------------------
715	if ( [ X${FileName0} != X${NULL_STR} ] && [ X${FileName0} != XNONE ] ) ; then
716	eval NbFiles=\${#${ListFilesName}[@]} > /dev/null 2>&1
717
718	(( i=1 ))
719	until [ $i -gt $NbFiles ]; do
720	eval file_in_=\${${ListFilesName}[$i]} > /dev/null 2>&1
721	eval file_in=${file_in_}
722	(( i_ = i+1 ))
723	eval file_out_=\${${ListFilesName}[$i_]} > /dev/null 2>&1
724	eval file_out=${file_out_}
725
726	file_in_Name=${run_Configuration_OldPrefix}_${file_in}
727
728
729	extension_in=$( echo ${file_in_Name##*.} )
730	extension_out=$( echo ${file_out##*.} )
731
732
733	generic_restart_file_name_in=$( basename ${file_in_Name} .${extension_in} )
734	generic_restart_file_name_out=$( basename ${file_out} .${extension_out} )
735
736	eval Path_BUF=\${R_BUF_${comp}_R}/${generic_restart_file_name_in}
737	eval Path_OUT=\${R_OUT_${comp}_R}/${generic_restart_file_name_in}
738
739	#if [ -f ${Path_BUF}*.nc ] ; then
740	if [ $( IGCM_sys_TestFileBuffer ${Path_BUF}*.${extension_in} ; echo $? ) = 0 ] ; then
741	IGCM_debug_Print 3 "Buffered restart"
742	Buffered=true
743	Archived=false
744	Tared=false
745	nb_restart_file=$(IGCM_sys_CountFileBuffer ${Path_BUF}_????.${extension_in})
746	#elif [ -f ${Path_OUT}*.nc ] ; then
747	elif [ $( IGCM_sys_TestFileArchive ${Path_OUT}*.${extension_out} ; echo $? ) = 0 ] ; then
748	IGCM_debug_Print 3 "Archived restart"
749	Buffered=false
750	Archived=true
751	Tared=false
752	nb_restart_file=$(IGCM_sys_CountFileArchive ${Path_OUT}_????.${extension_out})
753	else
754	IGCM_debug_Print 3 "Tared restart"
755	Buffered=false
756	Archived=false
757	Tared=true
758	# Look after the tar file we want if we did not found it already
759	if [ X${IsMatching} = X ] ; then
760	for PotentialTarFile in $( find ${R_SAVE}/RESTART -name "${config_UserChoices_JobName}_*_restart.tar" -print ) ; do
761	IsMatching=$( echo ${PotentialTarFile##*/} \| sed "s:^${config_UserChoices_JobName}_::" \| sed "s:\.restart\.tar$::" \| gawk -F_ -v restartdate=${LastPeriodDateEnd} '{if (($1 < restartdate) && ($2 >= restartdate)) {print $1"_"$2}}' )
762	if [ ! X${IsMatching} = X ] ; then
763	TarFileFound=${PotentialTarFile}
764	break
765	fi
766	done
767	fi
768	tar xvf ${TarFileFound} ${comp}_${generic_restart_file_name_in}*.${extension_in}
769	nb_restart_file=$( IGCM_sys_CountFileBuffer ${comp}_${generic_restart_file_name_in}_????.${extension_in} )
770	fi
771
772	if [ ${nb_restart_file} -gt 1 ] ; then
773	j=0
774	until [ $j -ge $nb_restart_file ]; do
775	j4=${j}
776	if [ X${Buffered} = Xtrue ] ; then
777	IGCM_sys_GetBuffer ${Path_BUF}_${j4}.${extension_in} ${generic_restart_file_name_out}_${j4}.${extension_out}
778	elif [ X${Archived} = Xtrue ] ; then
779	IGCM_sys_Get ${Path_OUT}_${j4}.${extension_out} ${generic_restart_file_name_out}_${j4}.${extension_out}
780	elif [ X${Tared} = Xtrue ] ; then
781	IGCM_sys_Mv ${comp}_${generic_restart_file_name_in}_${j4}.${extension_in} ${generic_restart_file_name_out}_${j4}.${extension_out}
782	fi
783	(( j=j+1 ))
784	done
785	else
786	if [ X${Buffered} = Xtrue ] ; then
787	eval IGCM_sys_GetBuffer \${R_BUF_${comp}_R}/${file_in_Name} ${file_out}
788	elif [ X${Archived} = Xtrue ] ; then
789	eval IGCM_sys_Get \${R_OUT_${comp}_R}/${file_in_Name} ${file_out}
790	elif [ X${Tared} = Xtrue ] ; then
791	IGCM_sys_Mv ${comp}_${file_in_Name} ${file_out}
792	fi
793	fi
794	(( i=i+3 ))
795	done
796	else
797	if [ X${FileName0} != XNONE ] ; then
798	IGCM_debug_Exit "IGCM_comp_GetInputRestartFiles : No file in list for ${compname}."
799	else
800	IGCM_debug_Print 1 "IGCM_comp_GetInputRestartFiles : NONE specified in Restart List ${compname}."
801	fi
802	fi
803	fi
804	done
805
806	NbFiles=$( ls * 2> /dev/null \| wc -l )
807	if [ ${NbFiles} -gt 0 ] ; then
808	IGCM_sys_Chmod u+rw *
809	fi
810
811	IGCM_debug_PopStack "IGCM_comp_GetInputRestartFiles"
812	}
813
814	#=======================================================================
815	function IGCM_comp_PeriodStart
816	{
817	IGCM_debug_PushStack "IGCM_comp_PeriodStart"
818
819	# Debug Print :
820	echo
821	IGCM_debug_Print 1 "IGCM_comp_PeriodStart"
822	echo
823
824	typeset ExeNameIn ExeNameOut
825	typeset comp compname comptagname
826	for comp in ${config_ListOfComponents[*]} ; do
827	# Define component
828	eval compname=\${config_ListOfComponents_${comp}[0]} > /dev/null 2>&1
829	eval comptagname=\${config_ListOfComponents_${comp}[1]} > /dev/null 2>&1
830
831	# Copy executable for this component
832	eval ExeNameIn=\${config_Executable_${comp}[0]}
833	eval ExeNameOut=\${config_Executable_${comp}[1]}
834
835	# Debug Print
836	IGCM_debug_Print 3 "PeriodStart ${compname} Driver Function (if any)."
837	# UPDATE component
838	${comp}_PeriodStart 2> /dev/null
839
840	done
841
842	IGCM_debug_PopStack "IGCM_comp_PeriodStart"
843	}
844
845	#=======================================================================
846	function IGCM_comp_Update
847	{
848	IGCM_debug_PushStack "IGCM_comp_Update"
849
850	# Debug Print :
851	echo
852	IGCM_debug_Print 1 "IGCM_comp_Update"
853	echo
854
855	typeset ExeNameIn ExeNameOut
856	typeset comp compname comptagname
857	for comp in ${config_ListOfComponents[*]} ; do
858	# Define component
859	eval compname=\${config_ListOfComponents_${comp}[0]} > /dev/null 2>&1
860	eval comptagname=\${config_ListOfComponents_${comp}[1]} > /dev/null 2>&1
861
862	# Copy executable for this component
863	eval ExeNameIn=\${config_Executable_${comp}[0]}
864	eval ExeNameOut=\${config_Executable_${comp}[1]}
865
866	# If missing executable and DRYRUN is set to 0 or 1 then stop!
867	if [ ${DRYRUN} -le 1 ] && [ X${ExeNameIn} != X\"\" ] && [ ! -f ${R_EXE}/${ExeNameIn} ] ; then
868	IGCM_debug_Exit "IGCM_comp_Update missing executable ${ExeNameIn}"
869	fi
870
871	if [ ${Period} -eq 1 ] && [ -f ${R_EXE}/${ExeNameIn} ] ; then
872	eval IGCM_sys_Cp ${R_EXE}/${ExeNameIn} ${ExeNameOut}
873	if [ -f ${RUN_DIR}/${ExeNameOut} ] ; then
874	eval IGCM_sys_Chmod +rx ${RUN_DIR}/${ExeNameOut}
875	fi
876	elif [ -f ${R_EXE}/${ExeNameIn} ] && [ ! -f ${RUN_DIR}/${ExeNameOut} ] ; then
877	eval IGCM_sys_Cp ${R_EXE}/${ExeNameIn} ${ExeNameOut}
878	if [ -f ${RUN_DIR}/${ExeNameOut} ] ; then
879	eval IGCM_sys_Chmod +rx ${RUN_DIR}/${ExeNameOut}
880	fi
881	fi
882
883	# Debug Print
884	IGCM_debug_Print 1 "Update ${compname} Parameter Files."
885	# UPDATE component
886	${comp}_Update
887
888	done
889
890	IGCM_debug_PopStack "IGCM_comp_Update"
891	}
892
893	#=======================================================================
894	function IGCM_comp_Finalize
895	{
896	IGCM_debug_PushStack "IGCM_comp_Finalize"
897
898	# Debug Print :
899	echo
900	IGCM_debug_Print 1 "IGCM_comp_Finalize"
901	echo
902
903	typeset ListTextName TextName0
904	typeset comp compname comptagname card ListFilesName FileName0 NbFiles SaveOnArchive
905	typeset i i_ file_in file_in_ file_out file_out_ file_outin file_outin_ generic_file_name nb_rebuild_file
906	typeset -Z4 j4
907	typeset list_file nlist_file
908	typeset compactoutputs
909
910	compactoutputs=false
911	if [ X${JobType} != XRUN ] ; then
912	compactoutputs=true
913	elif [ X${config_UserChoices_CompactText} != Xn ] ; then
914	compactoutputs=true
915	fi
916
917	for comp in ${config_ListOfComponents[*]} ; do
918	# Define component
919	eval compname=\${config_ListOfComponents_${comp}[0]} > /dev/null 2>&1
920	eval comptagname=\${config_ListOfComponents_${comp}[1]} > /dev/null 2>&1
921
922	# Debug Print
923	IGCM_debug_Print 1 "Finalize ${comp} : ${compname} component."
924	# FINALIZE component
925	${comp}_Finalize
926
927	card=${SUBMIT_DIR}/COMP/${compname}.card
928
929	# Save Restarts files
930	#--------------------
931	IGCM_debug_Print 2 "Save Restart files for ${comp} : ${compname} component."
932	IGCM_card_DefineArrayFromOption ${card} RestartFiles List
933	ListFilesName=${compname}_RestartFiles_List
934	eval FileName0=\${${ListFilesName}[0]} > /dev/null 2>&1
935
936	if ( [ X${FileName0} != X${NULL_STR} ] && [ X${FileName0} != XNONE ] ) ; then
937	eval NbFiles=\${#${ListFilesName}[@]} > /dev/null 2>&1
938
939	(( i=0 ))
940	until [ $i -ge $NbFiles ]; do
941	eval file_in_=\${${ListFilesName}[$i]} > /dev/null 2>&1
942	eval file_in=${file_in_}
943
944	(( i_ = i+1 ))
945	eval file_out_=\${${ListFilesName}[$i_]} > /dev/null 2>&1
946	eval file_out=${file_out_}
947
948	(( i_ = i+2 ))
949	eval file_outin_=\${${ListFilesName}[$i_]} > /dev/null 2>&1
950	eval file_outin=${file_outin_}
951
952	generic_restart_file_name_in=$( basename ${file_in} .nc )
953	generic_restart_file_name_out=$( basename ${config_UserChoices_JobName}_${PeriodDateEnd}_${file_out} .nc )
954	generic_restart_file_name_outin=$( basename ${file_outin} .nc )
955
956	nb_restart_file=$( ls ${generic_restart_file_name_in}_????.nc 2>/dev/null \| wc -l )
957	if [ ${nb_restart_file} -gt 1 ] ; then
958	j=0
959	until [ $j -ge $nb_restart_file ]; do
960	j4=${j}
961	if [ X${Pack} = Xtrue ] ; then
962	eval IGCM_sys_PutBuffer_Rest ${generic_restart_file_name_in}_${j4}.nc \${R_BUF_${comp}_R}/${generic_restart_file_name_out}_${j4}.nc
963	else
964	eval IGCM_sys_Put_Rest ${generic_restart_file_name_in}_${j4}.nc \${R_OUT_${comp}_R}/${generic_restart_file_name_out}_${j4}.nc
965	fi
966	if [ ! ${file_in} = ${file_outin} ] ; then
967	if ( ${ExitFlag} ) ; then
968	echo "IGCM_sys_Mv ${generic_restart_file_name_in}_${j4}.nc ${generic_restart_file_name_outin}_${j4}.nc not executed."
969	else
970	IGCM_sys_Mv ${generic_restart_file_name_in}_${j4}.nc ${generic_restart_file_name_outin}_${j4}.nc
971	fi
972	fi
973	(( j=j+1 ))
974	done
975	else
976	if [ X${Pack} = Xtrue ] ; then
977	eval IGCM_sys_PutBuffer_Rest ${file_in} \${R_BUF_${comp}_R}/${config_UserChoices_JobName}_${PeriodDateEnd}_${file_out}
978	else
979	eval IGCM_sys_Put_Rest ${file_in} \${R_OUT_${comp}_R}/${config_UserChoices_JobName}_${PeriodDateEnd}_${file_out}
980	fi
981	if [ ! ${file_in} = ${file_outin} ] ; then
982	if ( ${ExitFlag} ) ; then
983	echo "IGCM_sys_Mv ${file_in} ${file_outin} not executed."
984	else
985	IGCM_sys_Mv ${file_in} ${file_outin}
986	fi
987	fi
988	fi
989
990	(( i=i+3 ))
991	done
992	else
993	if [ X${FileName0} != XNONE ] ; then
994	IGCM_debug_Exit "IGCM_comp_Finalize : No file in restart list for ${compname}."
995	else
996	IGCM_debug_Print 1 "IGCM_comp_Finalize : NONE specified in Restart List ${compname}."
997	fi
998	fi
999
1000	# Save Output files
1001	#------------------
1002	IGCM_debug_Print 2 "Save Output files for ${comp} : ${compname} component."
1003	IGCM_card_DefineArrayFromOption ${card} OutputFiles List
1004	ListFilesName=${compname}_OutputFiles_List
1005	eval FileName0=\${${ListFilesName}[0]} > /dev/null 2>&1
1006
1007	if [ X${FileName0} != X${NULL_STR} ] ; then
1008	eval NbFiles=\${#${ListFilesName}[@]} > /dev/null 2>&1
1009
1010	(( i=0 ))
1011	until [ $i -ge $NbFiles ]; do
1012	SaveOnArchive=true
1013	eval file_in_=\${${ListFilesName}[$i]} > /dev/null 2>&1
1014	eval file_in=${file_in_}
1015	(( i_ = i+1 ))
1016	eval file_out_=\${${ListFilesName}[$i_]} > /dev/null 2>&1
1017	eval file_out=${file_out_}
1018	#
1019	# Override file_out path remplacing R_SAVE by R_BUFR
1020	#
1021	if [ X${Pack} = Xtrue ] ; then
1022	file_out=$( echo $file_out \| sed "s:^$R_SAVE:$R_BUFR:" )
1023	fi
1024	#
1025	# Not necessarily the best option. /!\ Potential side effects /!\
1026	#
1027	(( i_ = i+2 ))
1028	eval flag_post=\${${ListFilesName}[$i_]} > /dev/null 2>&1
1029	#
1030	generic_file_name=$( basename ${file_in} .nc )
1031	nb_rebuild_file=$( ls \| grep "^${generic_file_name}_[0-9]*.nc" \| wc -l )
1032	#
1033	if ( [ ${nb_rebuild_file} -eq 1 ] && [ -f ${generic_file_name}_0000.nc ] ) ; then
1034	IGCM_debug_Print 2 "Parallelism with 1 process. Rebuilding ${file_in} not needed"
1035	IGCM_sys_Mv ${generic_file_name}_0000.nc ${file_in}
1036	elif [ ${nb_rebuild_file} -gt 1 ] ; then
1037	IGCM_debug_Print 2 "Parallelism detected rebuilding ${file_in} is needed"
1038	if [ X${AsynchronousRebuild} = Xfalse ] ; then
1039	IGCM_debug_Print 2 "Rebuilding ${file_in} online"
1040	IGCM_sys_rebuild ${file_in} ${generic_file_name}_*.nc
1041	else
1042	IGCM_debug_Print 2 "Preparing offline rebuild for ${file_in}"
1043	[ ! -d ${RUN_DIR}/REBUILD_${PeriodDateBegin} ] && IGCM_sys_Mkdir ${RUN_DIR}/REBUILD_${PeriodDateBegin}
1044	IGCM_sys_Mv ${generic_file_name}_????.nc ${RUN_DIR}/REBUILD_${PeriodDateBegin}
1045
1046	# Prepare headers for the shell dedicated to offline rebuild
1047	if [ ! -f ${RUN_DIR}/REBUILD_${PeriodDateBegin}/rebuild.ksh ] ; then
1048	if [ $DRYRUN -le 1 ]; then
1049	echo "#!/bin/ksh " > ${RUN_DIR}/REBUILD_${PeriodDateBegin}/rebuild.ksh
1050	echo "function IGCM_FlushRebuild " >> ${RUN_DIR}/REBUILD_${PeriodDateBegin}/rebuild.ksh
1051	echo "{ " >> ${RUN_DIR}/REBUILD_${PeriodDateBegin}/rebuild.ksh
1052	echo "IGCM_debug_PushStack \"IGCM_FlushRebuild\" " >> ${RUN_DIR}/REBUILD_${PeriodDateBegin}/rebuild.ksh
1053	echo "echo " >> ${RUN_DIR}/REBUILD_${PeriodDateBegin}/rebuild.ksh
1054	echo "IGCM_debug_Print 1 \"IGCM_FlushRebuild\" " >> ${RUN_DIR}/REBUILD_${PeriodDateBegin}/rebuild.ksh
1055	echo "echo " >> ${RUN_DIR}/REBUILD_${PeriodDateBegin}/rebuild.ksh
1056	echo "export R_SAVE=${R_SAVE} " >> ${RUN_DIR}/REBUILD_${PeriodDateBegin}/rebuild.ksh
1057	echo "export R_BUFR=${R_BUFR} " >> ${RUN_DIR}/REBUILD_${PeriodDateBegin}/rebuild.ksh
1058	echo "export config_UserChoices_JobName=${config_UserChoices_JobName} " >> ${RUN_DIR}/REBUILD_${PeriodDateBegin}/rebuild.ksh
1059	fi
1060	fi
1061	# Prepare the shell dedicated to offline rebuild
1062	if [ $DRYRUN -le 1 ]; then
1063	echo "IGCM_sys_rebuild ${file_in} ${generic_file_name}_*.nc" >> ${RUN_DIR}/REBUILD_${PeriodDateBegin}/rebuild.ksh
1064	echo "IGCM_debug_Verif_Exit_Post " >> ${RUN_DIR}/REBUILD_${PeriodDateBegin}/rebuild.ksh
1065	fi
1066	#
1067	# Load Patch we need to apply and apply
1068	if [ $DRYRUN -le 1 ]; then
1069	if [ X$( eval echo \${${compname}_${flag_post}_Patches[0]} ) != X${NULL_STR} ]; then
1070	for Patch in $( eval echo \${${compname}_${flag_post}_Patches[*]} ); do
1071	echo ". ${libIGCM_POST}/libIGCM_post/IGCM_${Patch}.ksh" >> ${RUN_DIR}/REBUILD_${PeriodDateBegin}/rebuild.ksh
1072	echo "IGCM_${Patch} ${file_in} " >> ${RUN_DIR}/REBUILD_${PeriodDateBegin}/rebuild.ksh
1073	echo "IGCM_debug_Verif_Exit_Post " >> ${RUN_DIR}/REBUILD_${PeriodDateBegin}/rebuild.ksh
1074	done
1075	fi
1076	fi
1077	#
1078	if [ $DRYRUN -le 1 ]; then
1079	if [ X${Pack} = Xtrue ] ; then
1080	echo "IGCM_sys_PutBuffer_Out ${file_in} ${file_out} " >> ${RUN_DIR}/REBUILD_${PeriodDateBegin}/rebuild.ksh
1081	else
1082	echo "IGCM_sys_Put_Out ${file_in} ${file_out} " >> ${RUN_DIR}/REBUILD_${PeriodDateBegin}/rebuild.ksh
1083	fi
1084	echo "IGCM_debug_Verif_Exit_Post " >> ${RUN_DIR}/REBUILD_${PeriodDateBegin}/rebuild.ksh
1085	echo "IGCM_sys_Rm ${generic_file_name}_*.nc " >> ${RUN_DIR}/REBUILD_${PeriodDateBegin}/rebuild.ksh
1086	fi
1087	SaveOnArchive=false
1088	fi
1089	fi
1090	#
1091	if [ ${SaveOnArchive} = true ] ; then
1092	#
1093	# Rebuild has been done online or it was not needed
1094	#
1095	# If we need to apply a patch we use TMP DIRECTORY before ARCHIVING if asynchronous rebuild is on
1096	#
1097	thereisapatch=$( eval echo \${${compname}_${flag_post}_Patches[0]} )
1098	if ( [ ! X${thereisapatch} = X${NULL_STR} ] && [ X${AsynchronousRebuild} = Xtrue ] && [ -f ${file_in} ] ) ; then
1099	[ ! -d ${RUN_DIR}/REBUILD_${PeriodDateBegin} ] && IGCM_sys_Mkdir ${RUN_DIR}/REBUILD_${PeriodDateBegin}
1100	IGCM_sys_Mv ${file_in} ${RUN_DIR}/REBUILD_${PeriodDateBegin}
1101	eval FileToBeDeleted[${#FileToBeDeleted[@]}]=REBUILD_${PeriodDateBegin}/${file_in} > /dev/null 2>&1
1102	#
1103	if [ $DRYRUN -le 1 ]; then
1104	if [ ! -f ${RUN_DIR}/REBUILD_${PeriodDateBegin}/rebuild.ksh ] ; then
1105	echo "#!/bin/ksh " > ${RUN_DIR}/REBUILD_${PeriodDateBegin}/rebuild.ksh
1106	echo "function IGCM_FlushRebuild " >> ${RUN_DIR}/REBUILD_${PeriodDateBegin}/rebuild.ksh
1107	echo "{ " >> ${RUN_DIR}/REBUILD_${PeriodDateBegin}/rebuild.ksh
1108	echo "IGCM_debug_PushStack \"IGCM_FlushRebuild\" " >> ${RUN_DIR}/REBUILD_${PeriodDateBegin}/rebuild.ksh
1109	echo "echo " >> ${RUN_DIR}/REBUILD_${PeriodDateBegin}/rebuild.ksh
1110	echo "IGCM_debug_Print 1 \"IGCM_FlushRebuild\" " >> ${RUN_DIR}/REBUILD_${PeriodDateBegin}/rebuild.ksh
1111	echo "echo " >> ${RUN_DIR}/REBUILD_${PeriodDateBegin}/rebuild.ksh
1112	echo "export R_SAVE=${R_SAVE} " >> ${RUN_DIR}/REBUILD_${PeriodDateBegin}/rebuild.ksh
1113	echo "export config_UserChoices_JobName=${config_UserChoices_JobName} " >> ${RUN_DIR}/REBUILD_${PeriodDateBegin}/rebuild.ksh
1114	fi
1115	#
1116	for Patch in $( eval echo \${${compname}_${flag_post}_Patches[*]} ); do
1117	echo ". ${libIGCM_POST}/libIGCM_post/IGCM_${Patch}.ksh" >> ${RUN_DIR}/REBUILD_${PeriodDateBegin}/rebuild.ksh
1118	echo "IGCM_${Patch} ${file_in} " >> ${RUN_DIR}/REBUILD_${PeriodDateBegin}/rebuild.ksh
1119	echo "IGCM_debug_Verif_Exit_Post " >> ${RUN_DIR}/REBUILD_${PeriodDateBegin}/rebuild.ksh
1120	done
1121	#
1122	if [ X${Pack} = Xtrue ] ; then
1123	echo "IGCM_sys_PutBuffer_Out ${file_in} ${file_out} " >> ${RUN_DIR}/REBUILD_${PeriodDateBegin}/rebuild.ksh
1124	else
1125	echo "IGCM_sys_Put_Out ${file_in} ${file_out} " >> ${RUN_DIR}/REBUILD_${PeriodDateBegin}/rebuild.ksh
1126	fi
1127	echo "IGCM_debug_Verif_Exit_Post " >> ${RUN_DIR}/REBUILD_${PeriodDateBegin}/rebuild.ksh
1128	#
1129	fi
1130	else
1131	#
1132	# No Patch, No Asynchronous rebuild, online rebuild has been done or was not needed
1133	#
1134	if [ X${Pack} = Xtrue ] ; then
1135	IGCM_sys_PutBuffer_Out ${file_in} ${file_out}
1136	else
1137	IGCM_sys_Put_Out ${file_in} ${file_out}
1138	fi
1139	eval FileToBeDeleted[${#FileToBeDeleted[@]}]="${file_in}" > /dev/null 2>&1
1140	if [ ${nb_rebuild_file} -gt 1 ] ; then
1141	for DelFile in $( ls \| grep "${generic_file_name}[_0-9]*.nc" ) ; do
1142	eval FileToBeDeleted[${#FileToBeDeleted[@]}]=${DelFile} > /dev/null 2>&1
1143	done
1144	fi
1145	fi
1146	fi
1147	(( i=i+3 ))
1148	done
1149	fi
1150
1151	# Save Output Text files of models
1152	#---------------------------------
1153	IGCM_debug_Print 2 "Save Output Text files for ${comp} : ${compname} component."
1154	IGCM_card_DefineArrayFromOption ${card} OutputText List
1155	ListTextName=${compname}_OutputText_List
1156
1157	eval TextName0=\${${ListTextName}[0]} > /dev/null 2>&1
1158	if [ X${TextName0} != X${NULL_STR} ] ; then
1159	eval NbFiles=\${#${ListTextName}[@]} > /dev/null 2>&1
1160
1161	(( i=0 ))
1162	until [ $i -eq $NbFiles ]; do
1163	eval file_in=\${${ListTextName}[$i]} > /dev/null 2>&1
1164	eval file_out=${PREFIX}_${file_in}
1165
1166	(( i=i+1 ))
1167
1168	unset list_file
1169	#set +A list_file -- $( ls ${file_in}* \| sort 2>/dev/null )
1170	# result for a a1 a10 a2 with file_in=a a a1 a2 a10
1171	set +A list_file -- $( [ -f ${file_in} ] && ls ${file_in} ; for i in $(ls ${file_in}* 2>/dev/null \| sed "s/${file_in}//" \| sort -n) ; do ls ${file_in}$i ; done )
1172	nlist_file=${#list_file[@]}
1173	if [ ${nlist_file} -gt 1 ] ; then
1174	if ( ${compactoutputs} ) ; then
1175	IGCM_debug_Print 2 "Parallelism of Text Output with ${nlist_file} files."
1176	IGCM_debug_Print 2 "Compact files in ${file_out} : " ${list_file[*]}
1177	echo ${list_file[*]} > ${file_out}
1178	echo "" >> ${file_out}
1179
1180	(( i_ = 0 ))
1181	for file in ${list_file[@]}
1182	do
1183	echo "_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ " >> ${file_out}
1184	echo "\| " ${i_} " " ${file} >> ${file_out}
1185	echo "- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - " >> ${file_out}
1186	cat ${file} \| sed "s/$.*$/${i_}\1/" ${file} >> ${file_out}
1187	echo "" >> ${file_out}
1188	eval FileToBeDeleted[${#FileToBeDeleted[@]}]="${file}" > /dev/null 2>&1
1189	(( i_ = i_ + 1 ))
1190	done
1191	if [ X${Pack} = Xtrue ] ; then
1192	eval IGCM_sys_PutBuffer_Out ${file_out} \${R_BUF_${comp}_D}/${file_out}
1193	else
1194	eval IGCM_sys_Put_Out ${file_out} \${R_OUT_${comp}_D}/${file_out}
1195	fi
1196	eval FileToBeDeleted[${#FileToBeDeleted[@]}]="${file_out}" > /dev/null 2>&1
1197
1198	if ( ${ExecutionFail} ) ; then
1199	IGCM_sys_Cp ${file_out} ${SUBMIT_DIR}/Debug
1200	fi
1201	else
1202	for file in ${list_file[@]}
1203	do
1204	if [ X${Pack} = Xtrue ] ; then
1205	eval IGCM_sys_PutBuffer_Out ${file} \${R_BUF_${comp}_D}/${PREFIX}_${file}
1206	else
1207	eval IGCM_sys_Put_Out ${file} \${R_OUT_${comp}_D}/${PREFIX}_${file}
1208	fi
1209	eval FileToBeDeleted[${#FileToBeDeleted[@]}]="${file}" > /dev/null 2>&1
1210
1211	if ( ${ExecutionFail} ) ; then
1212	IGCM_sys_Cp ${file} ${SUBMIT_DIR}/Debug/${PREFIX}_${file}
1213	fi
1214	done
1215	fi
1216	else
1217	if ( [ -f ${file_in}_0000 ] \|\| [ -f ${file_in}0 ] ) ; then
1218	eval IGCM_sys_Mv ${file_in}* ${file_in}
1219	fi
1220	if [ X${Pack} = Xtrue ] ; then
1221	eval IGCM_sys_PutBuffer_Out ${file_in} \${R_BUF_${comp}_D}/${file_out}
1222	else
1223	eval IGCM_sys_Put_Out ${file_in} \${R_OUT_${comp}_D}/${file_out}
1224	fi
1225	eval FileToBeDeleted[${#FileToBeDeleted[@]}]="${file_in}" > /dev/null 2>&1
1226
1227	if ( ${ExecutionFail} ) ; then
1228	IGCM_sys_Cp ${file_in} ${SUBMIT_DIR}/Debug/${file_out}
1229	fi
1230	fi
1231	done
1232	fi
1233	echo
1234	done
1235	IGCM_debug_PopStack "IGCM_comp_Finalize"
1236	}

Note: See TracBrowser for help on using the repository browser.

Context Navigation

source: tags/libIGCM_v2.0_beta2/libIGCM_comp/libIGCM_comp.ksh @ 1211

Download in other formats: