Changes between Version 15 and Version 16 of doc/app/vapor


Ignore:
Timestamp:
Mar 10, 2013 10:52:52 PM (12 years ago)
Author:
hschulz
Comment:

updated to changes in r1110: workstation configuration

Legend:

Unmodified
Added
Removed
Modified
  • doc/app/vapor

    v15 v16  
    1616VAPOR has its own mechanism for storing field data and its associated attributes (metadata). The components of a VAPOR Data Collection (VDC) are distributed across different disk files. All metadata for a VDC are stored in a single .vdf file. See [[http://www.vapor.ucar.edu/docs/vapor-data-preparation/vapor-data-preparation|here]] for more information.\\
    1717\\
    18 For the conversion of NetCDF data output from PALM to the VAPOR format, the tool nc2vdf has been developed at IMUK. It is based on NCL and available from r1046. In order to use the tool on any remote host, the PALM utility programs must be recompiled ({{{mbuild -u -h ...}}}). In case you want to use nc2vdf on other systems than HLRN/IMUK, you need to adapt the script to your machine (it is placed in {{{../current_version/trunk/SCRIPTS}}}. There are some hints within the script how to achieve this. nc2vdf collects a list of parameters and uses the command line tools vdfcreate and ncdf2vdf, that come with VAPOR, to create the metadata file and populate the data collection automatically with all variables and time steps chosen by the user.\\
    19 The tool can be used in two ways, an interactive command line prompt asking for all necessary information and a non interactive mode reading all input parameters from a configuration file. The non interactive mode may be preferred for converting large data sets and can be used as a batch job at HLRN (so far only hicegate2 and bicegate2 are allowed). For large batch jobs that would exceed the wallclock time limit of the shell, you might want to submit a batch job (currently only possible on the UV systems).\\
     18For the conversion of NetCDF data output from PALM to the VAPOR format, the tool nc2vdf has been developed at IMUK. It is based on NCL and available from r1046. In order to use the tool on any remote host, the PALM utility programs must be recompiled ({{{mbuild -u -h ...}}}).\\
     19\\
     20nc2vdf collects a list of parameters and uses the command line tools vdfcreate and ncdf2vdf, that come with VAPOR, to create the metadata file and populate the data collection automatically with all variables and time steps chosen by the user.\\
     21The tool can be used in two ways, an interactive command line prompt asking for all necessary information and a non interactive batch mode reading all input parameters from a configuration file. The batch mode may be preferred. For converting large data sets, a batch job can be started at HLRN (so far only hicegate2 and bicegate2 are allowed). Large batch jobs that would exceed the wallclock time limit of the shell, you might want to submit a job (currently only possible on the UV systems).\\
    2022\\
    2123=== Starting the conversion ===
    22 The conversion can be started interactively, as local batch job at IMUK/HLRN or as batch job at UV. To use nc2vdf on your own workstation with VAPOR installed (Linux or Mac systems) you may edit the appropriate lines in the NCL script nc2vdf.ncl. The following instructions have to been executed in the directory where the data reside.
     24The conversion can be started interactively, as local batch job at IMUK/HLRN or as batch job at UV. To use nc2vdf on your own workstation with VAPOR installed (Linux or Mac systems), you may edit the appropriate lines in the configuration file {{{nc2vdf.config}}}). The following instructions have to been executed.
    2325
    2426==== Interactive mode at IMUK/HLRN ====
     
    3133{{{nc2vdf ./anypath/nc2vdf.config}}}
    3234
     35==== Batch mode on other workstations ====
     36Since r1110, you can easily use nc2vdf on other systems than HLRN/IMUK. Therefore you need to adapt the appropriate block of the configuration file {{{nc2vdf.config}}} to your machine. Please see the instructions in the example file. Run the script as described above.
    3337
    3438==== Batch mode on UV at HLRN ====
    35 For submitting a batch job to the UV system, a job script is required. Please find a default job script in {{{trunk/SCRIPTS/batch_nc2vdfcat}}}. The script should be copied to the directory where your data resides. Change into this directory and submit the job as follows:\\
     39For submitting a batch job to the UV system, a job script is required. Please find a default job script in {{{trunk/SCRIPTS/batch_nc2vdfcat}}}. The script should be copied to the directory where your data resides. Change into this directory and submit the job as follows:\\\\
    3640{{{msub batch_nc2vdfcat}}}
    3741