| 1 | = General hints for using the NEC SX-Aurora TSUBASA A300-8 system at IMUK = |
| 2 | |
| 3 | The system is part of the [https://www.luis.uni-hannover.de/scientific_computing.html LUIS-cluster at LUH]. |
| 4 | |
| 5 | You need a user-account for the cluster-system to access the NEC-system. The login procesure is as follows: |
| 6 | |
| 7 | 1. Login to the LUIS cluster-system from a workstation at IMUK: |
| 8 | {{{ssh -X <your LUIS username>@login.luis.uni-hannover.de}}} |
| 9 | |
| 10 | 2. From the LUIS system, you need to start an interactive job on the NEC-machine: |
| 11 | {{{qsub -I -l nodes=1:ppn=1,mem=20gb -W x=PARTITION:muk}}} |
| 12 | |
| 13 | By default, the interactive job sessions runs for 24h. Your $HOME-filesystem of the LUIS cluster is mounted on the NEC-System. For storing large output files, use the NEC-local filesystem {{{/scratch/<your LUIS username>}}} |
| 14 | |
| 15 | |
| 16 | |
| 17 | On the NEC-machine only specific software to compile and run PALM is available (NEC Fortran compiler, NetCDF-, |
| 18 | |
| 19 | Furthermore, edit file {{{$HOME/.bash_profile}}} and add the following lines: |
| 20 | {{{ |
| 21 | # User specific environment and startup programs |
| 22 | |
| 23 | PALM_BIN=$HOME/palm/current_version/trunk/SCRIPTS |
| 24 | export PALM_BIN |
| 25 | |
| 26 | PATH=$PALM_BIN:$PATH |
| 27 | export PATH |
| 28 | |
| 29 | LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/local/netcdf/4.1.1/lib |
| 30 | export LD_LIBRARY_PATH |
| 31 | }}} |
| 32 | |
| 33 | == tatara-system [http://www2.cc.kyushu-u.ac.jp/scp/system/general/CX/how_to_use] == |
| 34 | |
| 35 | The system is supported starting from revision r1097. You can find a configuration file adjusted for this system in the svn-repository under [source:/palm/trunk/SCRIPTS/.mrun.config.tatara /palm/trunk/SCRIPTS/.mrun.config.tatara]. Just copy this file to your working directory |
| 36 | {{{ |
| 37 | cd ~/palm/current_version |
| 38 | cp trunk/SCRIPTS/.mrun.config.tatara .mrun.config |
| 39 | }}} |
| 40 | Don't forget to edit the file in order to replace the string {{{<replace by your tatara username>}}} with your respective username. |
| 41 | |
| 42 | For the rest of the installation procedure just follow the instructions given on the [wiki:doc/install installation page]. |
| 43 | |
| 44 | == hayaka-system [http://www2.cc.kyushu-u.ac.jp/scp/system/general/FX10/how_to_use] == |
| 45 | |
| 46 | This system is supported starting from r1103 The configuration file adjusted for this system can be found under [source:/palm/trunk/SCRIPTS/.mrun.config.hayaka /palm/trunk/SCRIPTS/.mrun.config.hayaka]. Copy this file to your working directory |
| 47 | {{{ |
| 48 | cd ~/palm/current_version |
| 49 | cp trunk/SCRIPTS/.mrun.config.hayaka .mrun.config |
| 50 | }}} |
| 51 | Don't forget to edit the file in order to replace the string {{{<replace by your hayaka username>}}} with your respective username. |
| 52 | |
| 53 | === Restrictions on hayaka === |
| 54 | |
| 55 | The hayaka login node only provides a cross compiler ({{{frtpx}}}) for the compute nodes. Therefore, the utility programs like {{{interpret_config}}} and {{{check_parameter_files}}} can be compiled, but they cannot be run. This requires to set appropriate {{{mrun}}} options |
| 56 | {{{ |
| 57 | mrun ... -z -S ... |
| 58 | }}} |
| 59 | in order to switch off the parameter check ({{{-z}}}) and to interpret the configuration file directly from the script ({{{-S}}}). |
| 60 | |
| 61 | For compiling some parts of the PALM code, the Fujitsu compiler (frtpx) requires more memory than given by default. Please increase the maximum virtual memory size by command |
| 62 | {{{ |
| 63 | ulimit -v 8097152 |
| 64 | }}} |
| 65 | For convenience, you should add this command to the file {{{$HOME/.bash_profile}}}. |
| 66 | |
| 67 | No automatic restarts are possible on the hayaka system. You have to submit restart runs manually after the previous job has finished. In the job protocol file (see {{{~/job_queue}}}) of the previous run information is given about which '''mrun''' options are to be used for the restart. |