Changeset 1603 for trunk/libIGCM/AA_create_se

Timestamp:

10/25/23 14:34:02 (8 months ago)

Author:

aclsce

Message:

• Changed libIGCM behaviour in case of pb in pack_output.job : now, we exit from the job if there is any problem, whatever we are in PROD, DEVT, TEST mode.
• Specification of pack frequency per file :

In order to reduce the number of inodes, it is possible to specify by file the frequency of packing. The syntax to do that is in the 4th column of OutputFiles? section of the component.card, for example as follows in lmdz.card :
[OutputFiles?]
List= (histmth.nc, ${R_OUT_ATM_O_M}/${PREFIX}_1M_histmth.nc, Post_1M_histmth, 100Y), \

(histday.nc, ${R_OUT_ATM_O_D}/${PREFIX}_1D_histday.nc, Post_1D_histday, 10Y), \

...

In this example, histmth files will be packed every 100 years and histday files will be packed every 10 years.
The pack frequency you defined in config.card is the frequency of pack by default, that means if a specific frequency of pack is specified for a file in a component.card, this file will be packed at the specific frequency whereas all other files will be packed at global pack frequency (specified in config.card) and in this case, the frequency pack (from the config.card) is the frequency the pack_output job will be launched at.
There is a constraint to use this fonctionality : the Packfrequency you defined in config.card must be greater or equal to the pack frequencies you specified for each type of file in component.card, otherwise the computing job will be stopped (with an explicit error message).
Surpack mode :
A surpack mode functionality is available through the use of pack_output.job. To enable this functionality, you have to put "surpack_mode=y" (default value is n). The way to use is similar to restart post-processing pack_output jobs, as indicated here : ​http://forge.ipsl.jussieu.fr/igcmg_doc/wiki/Doc/CheckDebug#RestartPack_output. You can either use a global pack frequency in config.card or specific pack frequency per file, as explained above.

File:

• trunk/libIGCM/AA_create_se (modified) (5 diffs)

trunk/libIGCM/AA_create_se

@@ -308 +308 @@
         #
         if [ ! X$( eval echo \${${compname}_${flag_post}_Seasonal} ) = XON ] ; then
+            (( i_ = i+1 ))
+            eval Testvar_=\${${ListFilesName}[$i_]} > /dev/null 2>&1
+            eval Testvar=${Testvar_}
+            if [[ ${Testvar} =~ [0-9][DMY]$ ]] ; then
+                (( i = i+4 ))
+            else
           (( i=i+3 ))
+            fi
           continue
         fi
@@ -323 +330 @@
         if [ ! $? = 0 ] ; then
           eval set +A LISTE_FILE_${comp} \$\{LISTE_FILE_${comp}[*]} ${FILE}
+          (( i_ = i+1 ))
+          eval Testvar_=\${${ListFilesName}[$i_]} > /dev/null 2>&1
+          eval Testvar=${Testvar_}
+          if [[ ${Testvar} =~ [0-9][DMY]$ ]] ; then
+              eval PeriodPack_FileType=${Testvar}
+          else
+              PeriodPack_FileType=${config_Post_PackFrequency}
+          fi
+          eval set +A LISTE_PACKFREQUENCY_${comp} \${LISTE_PACKFREQUENCY_${comp}[*]} ${PeriodPack_FileType}
           if [ ! ${RebuildFrequency} = true ] ; then
             IGCM_card_DefineArrayFromOption ${card} Post_${FILE} Patches
@@ -337 +353 @@
         fi
       fi
+      (( i_ = i+1 ))
+      eval Testvar_=\${${ListFilesName}[$i_]} > /dev/null 2>&1
+      eval Testvar=${Testvar_}
+      if [[ ${Testvar} =~ [0-9][DMY]$ ]] ; then
+          (( i = i+4 ))
+      else
       (( i=i+3 ))
+      fi
     done # until [ $i -eq $NbFiles ]
   fi
@@ -348 +371 @@
   i=0
   for file in $( eval echo \${LISTE_FILE_${comp}[*]} ); do
+  config_UserChoices_PeriodLength=$( eval echo \${LISTE_PACKFREQUENCY_${comp}[$i]} ) 
     #
     # Determine in which output can we find file
@@ -588 +612 @@
     [ -f ${RESULT_SE} ] && IGCM_sys_Rm ${RESULT_SE}
     #
+    (( i = i + 1 ))
   done
 done