REBUILD_NEMO

[mafoipsl]

To rebuild mesh_mask, use REBUILD_NEMO installed here:

curie > type rebuild_nemo
rebuild_nemo is /ccc/cont003/home/???/???ipsl/REBUILD_NEMO/rebuild_nemo

ada > type rebuild_nemo
rebuild_nemo is /linkhome/rech/???/????035/REBUILD_NEMO/rebuild_nemo

For installation : in IPSLCM installation directory, cd NEMOGCM/TOOLS and use maketools -n REBUILD_NEMO

cd ..../modeles/NEMOGCM/TOOLS
./maketools -n REBUILD_NEMO
cd ~login
mkdir REBUILD_NEMO
cd REBUILD_NEMO
cp -p ...../modeles/NEMOGCM/TOOLS/REBUILD_NEMO/BLD/bin/rebuild_nemo.exe .
cp -p ...../modeles/NEMOGCM/TOOLS/REBUILD_NEMO/rebuild_nemo .

[mafoipsl]

Performances for mesh_mask.nc eORCA1 :

• curie :
  • rebuild_nemo mesh_mask 320 : 52s
  • rebuild -o mesh_mask.nc mesh_mask_????.nc : >14mn
• ada :
  • rebuild_nemo mesh_mask 320 : 10s (use a serial job with large memory)
  • rebuild -o mesh_mask.nc mesh_mask_????.nc : 140 s

Ada's rebuild_nemo.job :

# @ job_type = serial
# @ wall_clock_limit=1:10:00
# @ as_limit=20.0gb
# @ job_name = Mono
# @ output   = $(job_name).$(jobid)
# @ error    = $(job_name).$(jobid)
# @ queue
set -x
cd $LOADL_STEP_INITDIR
# 320 mesh_mask_????.nc files to rebuild
export PATH=/linkhome/rech/???/????035/REBUILD_NEMO:$PATH
time rebuild_nemo mesh_mask 320

[mafoipsl]

Modifs proposés:

• modif comp pour appeler rebuild_nemo qui a une autre syntaxe
• modif curie pour rebuild_nemo efficace installé et testé sur p86ipsl
• modif tous les sys pour appeler rebuild comme avant

  libIGCM > svn status
  M       libIGCM_comp/libIGCM_comp.ksh
  M       libIGCM_sys/libIGCM_sys_curie.ksh
  M       libIGCM_sys/libIGCM_sys_ciclad.ksh
  M       libIGCM_sys/libIGCM_sys_iitm.ksh
  M       libIGCM_sys/libIGCM_sys_obelix.ksh
  M       libIGCM_sys/libIGCM_sys_default.ksh
  M       libIGCM_sys/libIGCM_sys_ada.ksh
  
  > svn diff
  Index: libIGCM_comp/libIGCM_comp.ksh
  ===================================================================
  --- libIGCM_comp/libIGCM_comp.ksh       (revision 1379)
  +++ libIGCM_comp/libIGCM_comp.ksh       (working copy)
  @@ -817,7 +817,7 @@
                # OCE SPECIFIC TO REBUILD RESTART WHEN NUMBER OF RESTART FILES DONT MATCH MPI PROCESS
                if [ X${OCE_PROC_MPI} != X ] ; then
                  if [ ${OCE_PROC_MPI} -ne ${nb_restart_file} ] ; then
  -                  IGCM_sys_rebuild ${generic_restart_file_name_out}.${extension_out} ${generic_restart_file_name_out}_????.${extension_out}
  +                  IGCM_sys_rebuild_nemo ${generic_restart_file_name_out} ${nb_restart_file} ${extension_out} ${generic_restart_file_name_out}_????.${extension_out}
                    IGCM_sys_Rm ${generic_restart_file_name_out}_????.${extension_out}
                  fi
                fi
  Index: libIGCM_sys/libIGCM_sys_curie.ksh
  ===================================================================
  --- libIGCM_sys/libIGCM_sys_curie.ksh   (revision 1379)
  +++ libIGCM_sys/libIGCM_sys_curie.ksh   (working copy)
  @@ -1688,3 +1688,20 @@
    IGCM_debug_PopStack "IGCM_sys_atlas"
  }
  
  +#D-#==================================================
  +#D-function IGCM_sys_rebuild_nemo
  +#D-* Purpose: rebuild nemo parallel files with nemo specific rebuild on curie
  +#D-* Examples:
  +#D-
  +
  +function IGCM_sys_rebuild_nemo {
  +  IGCM_debug_PushStack "IGCM_sys_rebuild_nemo" $@
  +  if ( $DEBUG_sys ) ; then
  +    echo "IGCM_sys_rebuild_nemo :" $@
  +  fi
  +
  +  $( ccc_home -u p86ipsl )/REBUILD_NEMO/rebuild_nemo ${1} ${2}
  +
  +  IGCM_debug_PopStack "IGCM_sys_rebuild_nemo"
  +}
  +
  Index: libIGCM_sys/libIGCM_sys_ciclad.ksh
  ===================================================================
  --- libIGCM_sys/libIGCM_sys_ciclad.ksh  (revision 1379)
  +++ libIGCM_sys/libIGCM_sys_ciclad.ksh  (working copy)
  @@ -1232,3 +1232,25 @@
    IGCM_debug_PopStack "IGCM_sys_atlas"
  }
  
  +#D-#==================================================
  +#D-function IGCM_sys_rebuild_nemo
  +#D-* Purpose: rebuild nemo parallel files with general rebuild
  +#D-* Examples:
  +#D-
  +
  +function IGCM_sys_rebuild_nemo {
  +  IGCM_debug_PushStack "IGCM_sys_rebuild_nemo" $@
  +  if ( $DEBUG_sys ) ; then
  +    echo "IGCM_sys_rebuild_nemo :" $@
  +  fi
  +
  +  nemo_generic_restart_file_name_out=${1}
  +  nemo_extension_out=${3}
  +  shift ; shift ; shift
  +
  +  IGCM_sys_rebuild -o ${nemo_generic_restart_file_name_out}.${nemo_extension_out} $@
  + 
  +  IGCM_debug_PopStack "IGCM_sys_rebuild_nemo"
  +}
  +
  

idem pour autres sys_machines.ksh

[mafoipsl]

See [1380]