Changes between Version 15 and Version 16 of Documentation/UserGuide/IDB

Timestamp:

2018-03-14T10:57:21+01:00 (7 years ago)

Author:

ajornet

Comment:

--

Documentation/UserGuide/IDB

@@ -193 +193 @@
 Totalview is GUI debugger that works very will with mpi/omp binaries. You can find it installed in big HPCs such as Curie or ADA.
 
-* Curie
+== Curie ==
+
+=== SPMD ===
 
 In order to run totalview you need to make available to you like this:
@@ -204 +206 @@
 }}}
 This call ask for 16 processos in the standard queue. -d tv selects totalview as a debugger.
+
+When the startup window shows up, select "Enable memory debugging". 
+
+=== MPMD ===
+
+The script below defines how to run an MPI-OpenMP with totalview (eg: coupled LMDZ + Orchidee) program:
+
+{{{
+#!/bin/bash
+#MSUB -r mictgrm_test # Request name
+#MSUB -n 64 # Number of tasks to use
+#MSUB -c 2 # Number of tasks to use
+#MSUB -T 4000 # Elapsed time limit in seconds
+#MSUB -o orchid_%I.o # Standard output. %I is the job id
+#MSUB -e orchid_%I.e # Error output. %I is the job id
+#MSUB -Q normal 
+#MSUB -D
+#MSUB -X
+#MSUB -A gen6328
+#MSUB -q standard
+
+
+set -x
+module unload netcdf hdf5
+module load netcdf/4.3.3.1_hdf5_parallel
+module load hdf5/1.8.9_parallel
+module load totalview
+
+#module load ddt
+#unset SLURM_SPANK_AUKS
+
+# enable core dump file in case of error
+ulimit -c unlimited
+
+export KMP_STACKSIZE=3g
+export KMP_LIBRARY=turnaround
+export MKL_SERIAL=YES
+OMP_NUM_THREADS=2
+
+cat << END > pp.conf
+4    ./xios.x
+60   totalview ./lmdz.x
+END
+
+mpirun -tv -n 4 ./xios.x : -n 60 ./lmdz.x
+}}}
+
+In this specific case, coupled lmdz + Orchidee runs 60 MPI procs and 4 XIOS procs with 2 OpenMP threads. In total, it requires 128 procs.
 
 When the startup window shows up, select "Enable memory debugging".