Changes between Version 6 and Version 7 of doc/app/palm_iofiles


Ignore:
Timestamp:
Nov 21, 2018 5:49:51 PM (6 years ago)
Author:
scharf
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • doc/app/palm_iofiles

    v6 v7  
    1313# List of input-files
    1414#---------------------------------------------------------------------------------------------
    15 PARIN                    in:tr      d3#      $base_data/$jobname/INPUT          _p3d*
    16 PARIN                    in:tr      d3r      $base_data/$jobname/INPUT          _p3dr*
    17 TOPOGRAPHY_DATA          inopt:tr   d3#:d3r  $base_data/$jobname/INPUT          _topo*
    18 DATA_1D_PR_NETCDF        inopt      prr      $base_data/$jobname/OUTPUT         _pr*       nc
     15PARIN                    in:tr      d3#      $base_data/$run_identifier/INPUT          _p3d*
     16PARIN                    in:tr      d3r      $base_data/$run_identifier/INPUT          _p3dr*
     17TOPOGRAPHY_DATA          inopt:tr   d3#:d3r  $base_data/$run_identifier/INPUT          _topo*
     18DATA_1D_PR_NETCDF        inopt      prr      $base_data/$run_identifier/OUTPUT         _pr*       nc
    1919#
    2020#---------------------------------------------------------------------------------------------
    2121# List of output-files
    2222#---------------------------------------------------------------------------------------------
    23 BINOUT*                  out:lnpe   restart  $fast_io_catalog/$jobname/RESTART  _d3d
    24 DATA_3D_NETCDF*          out:tr     *        $base_data/$jobname/OUTPUT         _3d        nc
     23BINOUT*                  out:lnpe   restart  $fast_io_catalog/$run_identifier/RESTART  _d3d
     24DATA_3D_NETCDF*          out:tr     *        $base_data/$run_identifier/OUTPUT         _3d        nc
    2525}}}
    2626
     
    2929The '''second column''' gives the file attributes, which need to be separated by a colon (":"). Two attributes are allowed. The '''first attribute''' says, whether the file is an input ({{{in}}}) or an output file ({{{out}}}). {{{palmrun}}} immediately terminates, if it cannot find the user's input file, because it assumes that PALM cannot run without files with attribute {{{in}}}. If you do not want {{{palmrun}}} to terminate, you may give the attribute {{{inopt}}}, which says that this file is optional. The '''second attribute''' can be
    3030* {{{tr}}} \\
    31   In case of running jobs on remote hosts, transfer the file between the remote and local host via {{{scp}}}. \\\\Input files will be transferred from the user's folder on the local host to palmrun's temporary working directory on the remote host, before PALM is executed. This transfer is actually done before the batch job to the remote host is submitted. Files will be stored on the remote host in folder {{{$fast_io_catalog/SOURCES_FOR_RUN_$jobname}}}. As soon as the batch job executes, files are copied from the SOURCES_FOR_RUN-folder to the temporary working directory. \\\\Output files will be transferred from the temporary working directory on the remote host to the user's folder on the local host, after PALM has finished execution.
     31  In case of running jobs on remote hosts, transfer the file between the remote and local host via {{{scp}}}. \\\\Input files will be transferred from the user's folder on the local host to palmrun's temporary working directory on the remote host, before PALM is executed. This transfer is actually done before the batch job to the remote host is submitted. Files will be stored on the remote host in folder {{{$fast_io_catalog/SOURCES_FOR_RUN_$run_identifier}}}. As soon as the batch job executes, files are copied from the SOURCES_FOR_RUN-folder to the temporary working directory. \\\\Output files will be transferred from the temporary working directory on the remote host to the user's folder on the local host, after PALM has finished execution.
    3232
    3333* {{{tra}}} \\
     
    4545The '''third column''' gives the so-called activation strings. Two or more strings need to be separated by colons (":"). Activation strings are those given in the {{{palmrun}}} option {{{-a}}}. The respective file connection statement is only processed (i.e. the file is copied), if at least one of its activation strings is set with option {{{-a}}}. In case of the above example, {{{-r "d3#"}}} causes {{{palmrun}}} to provide the input files {{{PARIN}}} and {{{TOPOGRAPHY_DATA}}}. Option {{{-r "d3# restart"}}} additional copies/saves the output file {{{BINOUT}}}. Note that activation strings need to be separated by blanks when given with the option {{{-r}}} and that they need to be embraced by {{{"}}}, even if only one string is given (otherwise, a {{{#}}} would cause the shell to interpret the remaining part of the command as a comment). For output files, a wildcard may be given in the third column. Respective local files will then always be copied, in case they exist, independently from the activation strings given with option {{{-r}}}. No warning will be issued if no file exists. Wildcards in the third column are not allowed for input files.
    4646
    47 The path to the user's permanent file is given in the '''fourth column'''. It may contain environment variables that have been defined in the file connection file. {{{$jobname}}} will be replaced with the argument of {{{palmrun}}} option {{{-r}}}.
     47The path to the user's permanent file is given in the '''fourth column'''. It may contain environment variables that have been defined in the file connection file. {{{$run_identifier}}} will be replaced with the argument of {{{palmrun}}} option {{{-r}}}.
    4848
    4949The '''fifth column''' gives the appendix of the user's permanent file.
     
    6060As an example, the file connection statement
    6161{{{
    62 DATA_3D_NETCDF*    out:tr   *    $base_data/$jobname/OUTPUT   _3d   nc
     62DATA_3D_NETCDF*    out:tr   *    $base_data/$run_identifier/OUTPUT   _3d   nc
    6363}}}
    6464plus entry
     
    7676In case of nested runs, masked 3d-output and wind turbine model output, PALM expects or creates multiple input/output files with additional suffixes. As an example, a nested run with a parent and one child requires two parameter files for steering the simulation, where the second file is expected to have the suffix {{{_N02}}}. Each additional nest would require another parameter file with suffixes {{{_N03}}}, {{{_N04}}}, etc.  In order to simplify the file connection file, only one file connection statement
    7777{{{
    78 PARIN     in:tr   d3#    $base_data/$jobname/INPUT     _p3d*
     78PARIN     in:tr   d3#    $base_data/$run_identifier/INPUT     _p3d*
    7979}}}
    8080is required for this, where the wildcard in {{{_p3d*}}} causes {{{palmrun}}} to copy files with these suffixes too. Assuming an INPUT folder with files
     
    9292The same holds for output files. Here the wildcard must be given as part of the local filename (first column). The example given below assumes one nest (root domain plus one child domain), two output masks for the root domain, and three masks for the child. Assuming a file connection statement for an output file
    9393{{{
    94 DATA_MASK_NETCDF*   out:tr   *  $base_data/$jobname/OUTPUT   _masked   nc
     94DATA_MASK_NETCDF*   out:tr   *  $base_data/$run_identifier/OUTPUT   _masked   nc
    9595}}}
    9696and following local files that have been created by PALM