Current fixed release:

3.7a

Last change of this document: 

$Id: technical_documentation.html 544 2010-08-17 10:44:58Z maronga $

date

author

svn revision

last release

type

description

affected routines

09/09/10

CH

560

3.7a

B

Bugfix of calculating ngp_3d for 64 bit. So far ngp_3d has not been 64 bit.

init_3d_model

07/09/10

CH

557

3.7a

B

Bugfix of message string in if statement (dz_stretch_level) of subroutine set_mask_locations.

The changes concern the masked data output, which is still not documented.

init_masks

07/09/10

SR

556

3.7a

C

Documentation for surface_heatflux in case of prandtl_layer = .F. improved.

bugfix for wrong netcdf/3.6.3 module on lcsgi (mbuild, mrun)

mbuild, mrun

B

Bugfix in if statement (disturb_heatflux)

Bugfix: in 2201 statement: closing " was missing (interpret_config)

Bugfix: default setting of nzb_local for flat topography (init_grid)

Bugfix: wrong dimension used for ts_value_l (user_statistics)

disturb_heatflux, init_grid, user_statistics

interpret_config

01/09/10

CH

553

3.7a

C

d3dpar-parameters for masked output data_output_mask_*, data_output_mask_user_*, mask_*_x, mask_*_y, mask_*_z, mask_*_x_loop, mask_*_y_loop and mask_*_z_loop have been replaced by corresponding arrays data_output_masks, data_output_masks_user, mask_x, mask_y, mask_z, mask_x_loop, mask_y_loop and mask_z_loop

inipar-parameter masks has been removed.

The changes concern the masked data output, which is still not documented.

check_parameters, init_masks, modules, parin, user_parin

17/08/10

BM

544

3.7a

B/C/N

adjustments for lcxt4; bugfix (mbuild): loading of user-defined modules; new .mrun.config.lcxt4 for Cray XT4 in Bergen/Norway

mrun, mbuild, subjob

15/06/10

RH

540

3.7a

C

ssh from compute nodes to login nodes on hosts lcsgih/lcsgib is done using the names hicegate0/bicegate0 instead of the IP addresses

mrun

21/04/10

RH

532

3.7a

C

Large scale vertical motion (subsidence/ascent) can be added as additional source to the prognostic equation for humidity/passive scalar
 
character length for dopr_unit enlarged

Adjustment of the NCL scripts to allow for output of png files

modules, prognostic_equations

.ncl.config.default, cross_sections.ncl, profiles.ncl, timeseries.ncl, spectra.ncl

B

Bugfix: unit of hyp changed to dbar

check_parameters

01/04/10

RH

530

3.7a

B

Bugfix: treatment of special character * in NCL variables containing lists corrected

palmplot

31/03/10

RH

529

3.7a

C

List of variable names have to specified using blank separated lists and single quotes

palmplot

30/03/10

RH

526

3.7a

C

Adjustment of the NCL scripts and palmplot to allow for special characters in NetCDF variable names

palmplot, .ncl.config.default, cross_sections.ncl, profiles.ncl, timeseries.ncl, spectra.ncl

30/03/10

SR

525

3.7a

B

Bugfix: "/" in netcdf profile variable names replaced by ":"

check_parameters

19/03/10

SR

520

3.7a

N

NetCDF4 support for particle data. Total number of particles is allowed to increase during the run, when netcdf_data_format > 2 is used.

advec_particles, check_open, netcdf

C

Special characters like * and " are now allowed for NetCDF variable names. Replacement of these characters has been removed (routine clean_netcdf_varname removed)

18/03/10

SR

516

3.7a

N

Simple installation method has been documented (see chapter 5.0). Respective scripts and configuration files have been updated.

palm_simple_install, palm_simple_run

B

opt=1 is forced for PGI-compiler in routine buoyancy by compiler-directive. Otherwise, program aborts with SIGFPE.

buoyancy

16/03/10

RH

513

3.7a

N

NCL scripts can be run with the shell script palmplot.

palmplot, .ncl.config.default, cross_sections.ncl, profiles.ncl

12/03/10

SR

509

3.7a

B

bugfix for rev 504: remode_md was given a wrong value

mbuild

08/03/10

SR

506

3.7a

C

hack for better usage of mrun on Kyoto computing center machine (lckyoto)

mrun

03/03/10

SR

504

3.7a

C

combine_plot_fields is now directly called within mrun and must not be given by an output command in the configuration file any more. Please remove the respective output command (OC:combine_plot_fields.x) from your configuration file!

Utility programs (combine_plot_fields, interpret_config) are created by mbuild separately for each block in the configuration file. Depending on option -K, mrun is using the utility programs for the respective block.

Utility programs are also compiled in parallel, depending on variable %mopts in the configuration file..

Default configuration files updated.

mbuild, mrun, UTIL/Makefile, SCRIPTS/.mrun.config.*

02/03/10

SR

496

3.7a

C

Particle data for restart runs are only written if environment variable write_binary = .T., i.e. particle data are now handled in the same way as the other restart data.

palm

01/03/10

SR

494

3.7a

N

Output in NetCDF4-format.

NetCDF4 allows for parallel I/O. Also, variables are not limited in size any more (i.e. arrays can be larger than 2GB). The new d3par-parameter netcdf_data_format.can be used to select among the different NetCDF file formats (1: classic format, 2: 64-bit-offset format (this is now the default), 3: NetCDF4/HDF5 format, 4: NetCDF4 format with NF90_CLASSIC_MODEL bit set). Setting netcdf_data_format > 2 only affects 2d- and 3d-output, i.e. there is no parallel output for profiles, time series, spectra, and particles. Parallel output of particle data may realized in the future.

In case of parallel output, all PEs write into one file, which means that postprocessing the data with combine_plot_fields (merging data from single files - one per PE - into one file) is not neccessary. In this case, flag files are automatically set, telling combine_plot_fields that nothing is to be done.

Using NetCDF4 format requires a NetCDF4/HDF library. Respective settings for -I, -L, and -l compiler/loader options for the SGI-ICE at HLRN can be found in the new example configuration file ..../trunk/SCRIPTS/.mrun.config.imuk_ice2_netcdf4

Attention:
So far, NetCDF parallel I/O has only been tested a little. Further performance optimizations may be required, especially in case of large data sets (e.g. data chunking, or lustre file system settings with lfs setstripe). Please report bugs and performance problems immediately!

combine_plot_fields outputs cpu-time needed for file merging.

Modules to be loaded for compilation (mbuild) or job execution (mrun) can/should now be given in the configuration file (.mrun.config) using variable modules. Example:

   %modules     ifort/11.0.069:netcdf       lcsgih parallel

This method replaces the (undocumented) mpilib-variable.

WARNING:
All fixed settings of modules in the scripts mbuild, mrun, and subjob have been removed! Please set the modules variable appropriately and remove the mpilib variable in your configuration file.

Compilation time can be reduced be using parallel make. The number of allowed simultaneous compiler calls (threads) is set in the configuration file using variable mopt, e.g.

   %mopts  -j:4   lcsgih parallel

allows a maximum of 4 routines to be compiled simultaneously (provided that the makefile does not show any dependencies between these routines).

check_open, check_parameters, close_file, data_output_2d, data_output_3d, header, modules, netcdf, parin

combine_plot_fields

mbuild, mrun, subjob

C

d3par-parameters netcdf_64bit and netcdf_64bit_3d have been removed. Use the new d3par-variable netcdf_data_format = 2 for choosing the NetCDF 64bit-offset format (this is the default from now on). The offset-format can not be set independently for the 3d-output-data any more.

d3par-parameters netcdf_format_mask, netcdf_format_mask_av, and variables nc_format_mask, format_parallel_io removed. They are replaced by the new parameter netcdf_data_format. This change concerns the masked data output, which is still not documented.

check_open, close_file,
data_output_mask, header, init_masks, modules, parin

B

Bugfix in trunk/UTIL/Makefile: forgot to compile for interpret_config.

Bugfix: timeseries data have to be collected by PE0 (user_statistics).

user_statistics

trunk/UTIL/Makefile

05/02/10

SR

485

3.7a

B

ngp_3d, ngp_3d_inner changed to 64 bit. Otherwise, on large grids > 2*10**9 grid points some global statistics (e.g. total kinetic energy) have wrong values.

init_3d_model, modules

05/02/10

SR

484

3.7a

B

Typo in file headers removed ("current" instead of "actual").

many

05/02/10

SR

483

3.7a

N

compare_palm_logs is additionally compiled with mbuild -u . (Makefile in trunk/UTIL)

make options (mopts) to be set by configuration file implemented. (mrun, mbuild)

humidity = .T. can be used for runs with topography. wall_humidityflux and
wall_scalarflux are the corresponding new inipar parameters.
(check_parameters, init_3d_model, parin)

Large scale vertical motion (subsidence/ascent) can be added as additional source to the prognostic equation for potential temperature. See new parameters large_scale_subsidence, ws_vertical_gradient, and ws_vertical_gradient_level. (check_parameters, header, Makefile, modules, parin, prognostic_equations, read_var_list, subsidence, write_var_list)

Scripts have been updated for Cray-XT5 machine (lcxt5m) and Hitachi-machine (lckyoto).

A simple method for installing and running palm (with limited features) has been added. (Makefile, new scripts palm_simple_install, palm_simple_run)

Masked data output has been implemented but it is not documented in the user manual so far. This feature can already use NetCDF4 file format. (check_open, check_parameters, close_file, modules, netcdf, parin, time_integration, user_parin, new: data_output_mask, init_masks, user_data_output_mask)

check_open, check parameters, close_file, header, init_3d_model, Makefile, mbuild, modules, mrun, netcdf, parin, prognostic_equations, read_var_list, time_integration, user_parin, write_var_list

new: data_output_mask,  init_masks, palm_simple_install, palm_simple_run, subsidence, user_data_output_mask

C

2d-decomposition is default for Cray-XT machines. (init_pegrid)

var_ts is replaced by dots_max. (modules, init_3d_model)

Every cloud droplet has now an own weighting factor and can be deleted due to collisions. Condensation and collision of cloud droplets are adjusted accordingly. (advec_particles)

Collision efficiency for large cloud droplets has changed according to table of Rogers and Yau. (collision_efficiency)

advec_particles, collision_efficiency, init_3d_model, init_pegrid, modules

B

Bugfix for generating serial jobs. (subjob)

Bugfix: index problem concerning gradient_level indices removed. (header)

Dimension of array stat in cascade change to prevent type problems with mpi2 libraries. (poisfft_hybrid)

Loop was split to make runs reproducible when using ifort compiler. (disturb_field)

Bugfix: exchange of ghost points for prho included. (time_integration)

Bugfix in calculation of time-averaged surface heatfluxes. (sum_up_3d_data)

Bugfix in calculation of precipitation_rate. (calc_precipitation)

Bugfix: initial data assignments to some dvrp arrays changed due to error messages from gfortran compiler. (modules)

Bugfix in calculation of cloud droplet velocity. (advec_particles)

Bugfix in transfer of particles at south/left edge. (advec_particles)

Bugfix in calculation of collision efficiency. (collision_efficiency)

advec_particles, calc_precipitation, collision_efficiency, disturb_field, header, modules, poisfft_hybrid, subjob, sum_up_3d_data, time_integration

23/09/09

SR

392

3.7

N

Most important changes: atmosphere-ocean coupling has been improved and steering of dvr-software is more user-friendly now. Beside that, the release contains a lot of optimizations, changes, and bugfixes which have accumulated over the last months.

The atmosphere-ocean coupling allows to use independent precursor runs in order to account for different spin-up times. The time when coupling has to be started is given by new inipar parameter coupling_start_time. The precursor ocean run has to be started using new mrun option "-y" in order to add the appendix "_O" to all output files. (check_for_restart, check_parameters, data_output_2d, data_output_3d, data_output_profiles, data_output_ptseries, data_output_spectra, data_output_tseries, header, init_coupling, modules, mrun, parin, read_var_list, surface_coupler, time_integration, write_var_list)

Clipping of dvrp output implemented. Default colourtable for particles implemented, particle attributes (color, dvrp_size) can be set with new parameters particle_color, particle_dvrpsize, color_interval, dvrpsize_interval. Slicer attributes (dvrp) are set with new routine set_slicer_attributes_dvrp and are controlled with existing parameters slicer_range_limits. (init_dvrp, data_output_dvrp, modules, set_slicer_attributes_dvrp,  user_data_output_dvrp)

Polygon reduction for topography and ground plate isosurface. Reduction level for buildings can be chosen with parameter cluster_size. (init_dvrp)

Variables bc_lr / bc_ns  in most subroutines replaced by LOGICAL variables bc_lr_cyc,
bc_ns_cyc for speed optimization. This gives a significant speedup of more than 10%. (check_parameters, diffusion_u, diffusion_v, diffusion_w, modules)

Scripts have been adapted for machine lck (Yonsei Univ.). (mrun, mbuild, subjob)

Additional timestep criterion in case of simulations with plant canopy. (timestep)

Check for illegal entries in section_xy|xz|yz that exceed nz+1|ny+1|nx+1. (check_parameters)

External pressure gradient can be used as driving force. (check_parameters, header, init_3d_model, modules, parin, prognostic_equations, read_var_list, write_var_list)

New topography case 'single_street_canyon'. (header, init_grid, modules, parin, read_var_list, user_check_parameters, user_header, user_init_grid, write_var_list)

Option to predefine a target bulk velocity for conserve_volume_flow. (check_parameters, header, init_3d_model, modules, parin, read_var_list, write_var_list)

Option for user defined 2D data output in xy cross sections at z=nzb+1. (data_output_2d, user_data_output_2d)

xy cross section output of surface heatfluxes (sensible and latent). (average_3d_data, check_parameters, data_output_2d, modules, read_3d_binary, sum_up_3d_data, write_3d_binary)

average_3d_data, check_for_restart, check_parameters, data_output_2d, data_output_3d, data_output_dvrp, data_output_profiles, data_output_ptseries, data_output_spectra, data_output_tseries, diffusion_u, diffusion_v, diffusion_w, init_coupling, init_dvrp, init_grid, init_3d_model, header, mbuild, modules, mrun, package_parin, parin, prognostic_equations, read_3d_binary, read_var_list, subjob, sum_up_3d_data, surface_coupler, timestep, time_integration, user_check_parameters, user_data_output_2d, user_data_output_dvrp, user_header, user_init_grid, write_3d_binary, write_var_list

new: set_particle_attributes, set_slicer_attributes_dvrp

C

Output of messages replaced by message handling routine. (advec_particles, advec_s_bc, buoyancy, calc_spectra, check_for_restart, check_open, coriolis, cpu_log, data_output_2d, data_output_3d, data_output_dvrp, data_output_profiles, data_output_spectra, fft_xy, flow_statistics, header,  init_1d_model, init_3d_model, init_dvrp, init_grid, init_particles, init_pegrid, netcdf, parin, plant_canopy_model, poisfft_hybrid, poismg, read_3d_binary, read_var_list, surface_coupler, temperton_fft, timestep, user_actions, user_data_output_dvrp, user_dvrp_coltab, user_init_grid, user_init_plant_canopy, user_parin, user_read_restart_data, user_spectra)

Output of NetCDF messages with aid of message handling routine. (check_open, close_file, data_output_2d, data_output_3d, data_output_profiles, data_output_ptseries, data_output_spectra,  data_output_tseries, netcdf)

__lcmuk changed to __lc to avoid problems with Intel compiler on sgi-ice. (poisfft)

For extended NetCDF files, the updated title attribute includes an update of time_average_text where appropriate. (netcdf)

In case of restart runs without extension, initial profiles are not written to NetCDF-file anymore. So far, time axis always started at t=0. (data_output_profiles, modules, read_var_list, write_var_list)

initializing_actions='read_data_for_recycling' renamed to 'cyclic_fill'. A cyclic fill can now
be used independent of turbulent_inflow. (check_parameters, header, init_3d_model)

2 NetCDF error numbers changed. (data_output_3d)

A link to the webspage appendix_a.html is printed for further information about possible reasons of the error that appeared. (message)

Temperature gradient criterion for estimating the boundary layer height replaced by the gradient criterion of Sullivan et al. (1998). (flow_statistics)

NetCDF unit attribute in timeseries output in case of statistic regions added. (netcdf)

Maximum number of tails is calculated from maximum number of particles and skip_particles_for_tail. (init_particles)

Value of vertical_particle_advection is allowed to differ for each particle group. (advec_particles, header, modules)

First constant in array den also defined as type double. (eqn_state_seawater)

Parameter dvrp_psize moved from particles_par to dvrp_graphics_par. (package_parin)

topography_grid_convention moved from userpar to inipar (check_parameters, header, parin, read_var_list, user_check_parameters, user_header, user_init_grid, user_parin, write_var_list)

Default value of grid_matching changed to 'strict'. (modules)

Adjustments for runs on lcxt4 (necessary due to a software update on CRAY) and for coupled runs on ibmy. (mrun, subjob)

advec_particles, advec_s_bc, buoyancy, calc_spectra, check_for_restart, check_open, check_parameters, close_file, coriolis, cpu_log, data_output_2d, data_output_3d, data_output_dvrp, data_output_profiles, data_output_ptseries, data_output_spectra, data_output_tseries, eqn_state_seawater, fft_xy, flow_statistics, header, init_1d_model, init_3d_model, init_dvrp, init_grid, init_particles, init_pegrid, message, mrun, netcdf, package_parin, parin, plant_canopy_model, poisfft, poisfft_hybrid, poismg, read_3d_binary, read_var_list, subjob, surface_coupler, temperton_fft, timestep, user_actions,user_check_parameters, user_data_output_dvrp, user_dvrp_coltab, user_header, user_init_grid, user_init_plant_canopy, user_parin, user_read_restart_data, user_spectra, write_var_list

B

Bugfix: Initial hydrostatic pressure profile in case of ocean runs is now calculated in 5 iteration steps. (init_ocean)

Bugfix: wrong sign in buoyancy production of ocean part in case of not using the reference density (only in 3D routine production_e). (production_e)

Bugfix: output of averaged 2d/3d quantities requires that an avaraging interval has been set, respective error message is included. (check_parameters)

Bugfix: Output on unit 14 only if requested by write_binary. (user_last_actions)

Bugfix to avoid zero division by km_neutral. (production_e)

Bugfix for extended NetCDF files: In order to avoid 'data mode' errors if updated attributes are larger than their original size, NF90_PUT_ATT is called in 'define mode' enclosed by NF90_REDEF and NF90_ENDDEF calls. This implies a possible performance loss; an alternative strategy would be to ensure equal attribute size in a job chain. (netcdf)

Bugfix: correction of initial volume flow for non-flat topography. (init_3d_model)

Bugfix: zero initialization of arrays within buildings for 'cyclic_fill'. (init_3d_model)

Bugfix: to_be_resorted => s_av for time-averaged scalars. (data_output_2d, data_output_3d)

Bugfix: avoid that ngp_2dh_s_inner becomes zero. (init_3_model)

Typographical error: unit of wpt in dots_unit. (modules)

Bugfix: error in check, if particles moved further than one subdomain length. This check must not be applied for newly released particles. (advec_particles)

Bugfix: several tail counters are initialized, particle_tail_coordinates is only written to file if its third index is > 0, arrays for tails are allocated with a minimum size of 10 tails if there is no tail initially. (advec_particles, init_particles)

Bugfix: pressure included for profile output. (check_parameters)

Bugfix: Type of count and count_rate changed to default INTEGER on NEC machines. (cpu_log)

Bugfix: output of particle time series only if particle advection is switched on. (time_integration)

Bugfix: qsws was calculated in case of constant heatflux = .FALSE.. (prandtl_fluxes)

Bugfix: averaging along z is not allowed for 2d quantities (e.g. u* and z0). (data_output_2d)

Typographical errors. (netcdf)

If the inversion height calculated by the prerun is zero, inflow_damping_height must be explicitly specified. (init_3d_model)

Small bugfix concerning 3d 64bit netcdf output format. (header)

Bugfix: dt_fixed removed from the restart file, because otherwise, no change from a fixed to a variable timestep would be possible in restart runs. (read_var_list, write_var_list)

Bugfix: initial setting of time_coupling in coupled restart runs. (time_integration)

advec_particles, check_parameters, cpu_log, data_output_2d, data_output_3d, header, init_3d_model, init_particles, init_ocean, modules, netcdf, prandtl_fluxes, production_e, read_var_list, time_integration, user_last_actions, write_var_list

02/02/09

SR

228

3.6

N

This release contains further additions, changes, and bugfixes for the SGI-ICE system, as well as important changes like the splitting of the user-interface into single files, a complete revision of the pre-compiling mechanism allowing to use different make-depositories simultaneously, and a revision of the reading-mechanism from restart files, which has no more restrictions in case that the previous and current run have different domain/subdomain sizes. A new handling of all kind of output messages is introduced with this release and will be applied to all existing messages within the next releases.

New features are:

Restart runs on SGI-ICE are working. (mrun)
2d-decomposition is default on SGI-ICE systems. (init_pegrid)

Ocean-atmosphere coupling realized with MPI-1. mrun adjusted for this case (-Y option). Check that PALM is called with mrun-option "-K parallel" for coupling. Adjustments in mrun, mbuild, and subjob for lcxt4.

DVRP arguments changed to single precision, mode pathlines added.

User can add additional routines in files user_additional_routines.

User can check user parameters and deduce further quantities in user_check_parameters

check_for_restart, check_parameters, data_output_dvrp, init_dvrp, init_pegrid, local_stop, modules, package_parin, palm, surface_coupler, timestep

Makefile, mbuild, mrun, subjob

new:
init_coupling, user_additional_routines, user_check_parameters

C

User interface has been split into single files.

Type of variables count and count_rate changed to INTEGER(8) in order to avoid "out of range" problems, which result in measured negative time intervals. (cpu_log, local_tremain, local_tremain_ini)

Reading mechanism from restart files completely revised. The subdomain/total domain size is now allowed to vary arbitrarily between the current and previous run. (read_var_list, read_3d_binary, user_read_restart_data)

Precompilation mechanism (mbuild) completely revised: the source-tarfile remains in the source directory (trunk/SOURCE). One depository per block (given in the config-file) is created. Always all files from the source directory are copied to the respective depository. No additional file checks are done any more (mrun version 2.1). The depository name used contains the conditions given by mrun-option "-K". (mbuild, mrun)

Output messages (including required stop of execution) can now be handled with the new subroutine message. All output messages will be replaced by this routine step by step within the next revisions.

Neumann boundary condition at k=nzb is explicitly set for better reading, although this has been already done in boundary_conds. (advec_s_bc)

Origin of the xy-coordinate system shifted from the center of the first grid cell (indices i=0, j=0) to the south-left corner of this cell. (netcdf) Topography definition according to new user parameter topography_grid_convention. (init_grid, modules, user_header, user_init_grid, user_parin)

advec_s_bc, check_parameters, cpu_log, init_grid, local_stop, local_tremain, local_tremain_ini, modules, netcdf, read_3d_binary, read_var_list, user_read_restart_data

Makefile, mbuild, mrun

removed:
user_interface

new:
message, user_3d_data_averaging, user_actions, user_advec_particles, user_check_data_output, user_check_data_output_pr, user_data_output_2d, user_data_output_3d, user_data_output_dvrp, user_define_netcdf_grid, user_dvrp_coltab, user_header, user_init_3d_model, user_init, user_init_grid, user_init_particles, user_init_plant_canopy, user_last_actions, user_parin, user_parin, user_particle_attributes, user_read_restart_data, user_spectra, user_statistics

B

Bugfix: array d is reallocated in case that multigrid is used. (calc_spectra)

Bugfixes for nonparallel execution. (check_for_restart, cpu_statistics, inflow_turbulence, timestep)

Size of pf3d adjusted to the required output size (1 gridpoint less, along all three dimensions), because output of a subset of the data (pf3d(nxa:nxe...)) in the NF90_PUT_VAR statement caused segmentation fault with the INTEL compiler. (combine_plot_fields)

Bugfix: error in zu index in case of section_xy=-1. (header)

Inconsistency removed: as the thermal stratification is not taken into account for the evaluation of the wall fluxes at vertical walls, the eddy viscosity km must not be used for the evaluation of the velocity gradients dudy, dwdy, dvdx and dwdx. (production_e)

Bugfix in calculating k index in case of oceans runs. (sort_particles)

Bugfix: no output of particle concentration and radius unless particles have been started. (data_output_2d)

Bugfix: reading of spectrum_x|y from restart files ignored if total numbers of grid points do not match. (read_3d_binary)

Bugfix: abort in case that absolute temperature is below zero. (init_cloud_physics)

advec_particles, calc_spectra, check_for_restart, cpu_statistics, data_output_2d, header, inflow_turbulence, init_cloud_physics, production_e, read_3d_binary, timestep

combine_plot_fields