Changes between Version 11 and Version 12 of Doc/ComputingCenters/ESPRImesocenter
- Timestamp:
- 02/03/16 08:41:25 (8 years ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
Doc/ComputingCenters/ESPRImesocenter
v11 v12 7 7 ciclad is an IPSL computing server located on the Jussieu campus in Paris, France. 8 8 9 == Documentation == 9 ## General information ## 10 ### Documentation ### 10 11 11 12 http://ciclad-web.ipsl.jussieu.fr … … 15 16 hotline : svp-ciclad_at_ipsl_dot_jussieu_dot_fr 16 17 17 == The machines and file systems == 18 ### The machines and file systems ### 18 19 19 The front-end machine can be accessed via the {{{ciclad.jussieu.ipsl.fr}}} IP.20 The front-end machine can be accessed via the {{{ciclad.jussieu.ipsl.fr}}}. 20 21 21 Data files must be placed in {{{/data/ }}} or in the filesystem dedicated to your project.22 Data files must be placed in {{{/data/yourlogin/}}} or in the filesystem dedicated to your project. 22 23 23 == Shared account == 24 ### Shared account ### 24 25 The repository for shared files are found in '''/ipslfs/igcmg/IGCM'''. 25 26 26 27 Read more: [wiki:DocBenvEcommonfiles Repository for shared files and shared tools] 27 28 28 == Individual account == 29 ### Individual account ### 29 30 30 You must belong to the igcmg users' group. 31 32 Use following command to check to which groups you belong: 31 You must belong to the igcmg users' group. Use following command to check to which groups you belong: 33 32 {{{ 34 33 #!sh 35 34 id -a 36 35 }}} 36 ### How to define your environment ### 37 37 38 == How to define your environment == 39 40 Add the following line in your login file (e.g. `/home/igcmg/.bashrc`) : 38 To set up ferret and FAST tools, add the following line in your login file (e.g. `/home/igcmg/.bashrc`) : 41 39 42 40 {{{ … … 45 43 }}} 46 44 47 This will set up ferret and fast tools.48 49 45 To receive the end-of-job messages returned by the job itself (e.g. end of simulation, error,...) you must specify your email address in the file {{{${HOME}/.forward}}}. 50 46 51 == Compiling at CICLAD == 52 When installing modipsl, the default compiler at CICLAD is set to ifort. In modipsl/util/AA_make.gdef this corresponds to the target ifort_CICLAD. The corresponding arch files for compiling with fcm are named arch-ifort_CICLAD.fcm and arch-ifort_CICLAD.path. To compile at CICLADyou need LMDZ5/trunk rev 2133 or later, ORCHIDEE/trunk rev 2375 or later. Other compilers exist at CICLAD but they have not been tested with all models.47 ## Compiling at ciclad ## 48 When installing modipsl, the default compiler at ciclad is set to ifort. In modipsl/util/AA_make.gdef this corresponds to the target ifort_CICLAD. The corresponding arch files for compiling with fcm are named arch-ifort_CICLAD.fcm and arch-ifort_CICLAD.path. To compile at ciclad you need LMDZ5/trunk rev 2133 or later, ORCHIDEE/trunk rev 2375 or later. Other compilers exist at CICLAD but they have not been tested with all models. 53 49 54 Following forced configurations have been tested on CICLADwith the ifort compiler:50 Following forced configurations have been tested on ciclad with the ifort compiler: 55 51 * NEMO forced mode 56 52 * ORCHIDEE offline 57 53 * LMDZ and LMDZOR forced mode (with configuration LMDZOR_v5.2 or LMDZ_v5) 54 * LMDZOR_v6 (LMDZ testing 3114, ORCHIDEE trunk 2724, XIOS branchs/xios-1.0 rev 604, libIGCM_v2.7). Some modifications are required: 55 * Compiling XIOS using netcdf sequential. For this add in modipsl/config/AA_make : --netcdf_lib netcdf4_seq on the line make_xios as follow: 56 {{{ 57 (cd ../../modeles/XIOS ; ./make_xios --netcdf_lib netcdf4_seq --prod --arch ${FCM_ARCH} --job 8 ; cp bin/xios_server.exe ../../bin/. ; ) 58 }}} 59 * Add following 2 lines in the end of modipsl/models/LMDZ/arch/arch-ifort_CICLAD.path: 60 {{{ 61 XIOS_INCDIR=$LMDGCM/../XIOS/inc 62 XIOS_LIBDIR=$LMDGCM/../XIOS/lib 63 }}} 64 58 65 59 66 The coupled model IPSLCM5 has not been compiled at CICLAD. 60 67 61 68 62 == Example of job for a MPI executable == 69 ## libIGCM at ciclad ## 70 libIGCM can be used since tag libIGCM_v2.6 . No monitoring and atlas are done. No pack is implemented. 71 72 The memory needs to be adapted or added in the job's heading section. For LMDZOR resolution 96x95x39 the following seems to be needed, adjust if needed more : 73 {{{ 74 #PBS -l mem=6gb 75 #PBS -l vmem=30gb 76 }}} 77 78 ### Only MPI ### 79 LMDZOR_v6 configuration (LMDZ testing 3114, ORCHIDEE trunk 2724, XIOS branchs/xios-1.0 rev 604, libIGCM_v2.7) has been tested successfully using XIOS with 1 server when running using only MPI. Only the memory needed to be adapted as said above. Note that default compilation for hybrid mode mpi_omp is used also to run with only MPI. 80 81 ### Mixte MPI-OMP ### 82 #### Attached mode or using one executable #### 83 Add following in the main job but change OMP_NUM_THREADS to the number of threads used in your case : 84 {{{ 85 module load openmpi/1.4.5-ifort 86 export OMP_STACKSIZE=200M 87 export OMP_NUM_THREADS=2 88 }}} 89 90 #### Server mode or using two executables #### 91 Not yet done 92 93 ## Example of job for a MPI executable ## 63 94 64 95 {{{ … … 84 115 The job is launched with '''qsub''' . Use "'''qstat''' -u login" to check the queue. Use '''qdel''' to cancel a job in queue or running. 85 116 86 87 88 == libIGCM specificities on ciclad ==89 libIGCM can be used since tag libIGCM_v2.6 . No monitoring and atlas are done. No pack is implemented.
