1 | <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN"> |
---|
2 | <html><head> |
---|
3 | <meta http-equiv="CONTENT-TYPE" content="text/html; charset=windows-1252"><title>PALM chapter 3.2</title> <meta name="GENERATOR" content="StarOffice 7 (Win32)"> <meta name="AUTHOR" content="Marcus Oliver Letzel"> <meta name="CREATED" content="20040726;13164873"> <meta name="CHANGED" content="20050119;9245042"> <meta name="KEYWORDS" content="parallel LES model"> <style> |
---|
4 | <!-- |
---|
5 | @page { size: 21cm 29.7cm } |
---|
6 | --> |
---|
7 | </style></head> |
---|
8 | <body style="direction: ltr;" lang="en-US"><h3 style="line-height: 100%;">3.2 Example of a minimum |
---|
9 | configuration |
---|
10 | file</h3> |
---|
11 | <p style="line-height: 100%;">In this chapter a sample |
---|
12 | configuration |
---|
13 | file is described. It contains only instructions which are really |
---|
14 | necessary for the execution of a simple model run (configuration |
---|
15 | files can be much more complex). The example presented here is stored |
---|
16 | in an appropriate <a href="http://www.muk.uni-hannover.de/%7Eraasch/PALM_group/INSTALL/.mrun.config">example |
---|
17 | file</a> (containing more than the configuration data presented |
---|
18 | here) |
---|
19 | and can be used, together with the <a href="http://www.muk.uni-hannover.de/%7Eraasch/PALM_group/INSTALL/example_p3d">parameter |
---|
20 | file</a> presented in <a href="chapter_4.4.1.html">chapter |
---|
21 | 4.4.1</a>, for the execution of a simple model run. In chapter 4.4.1 |
---|
22 | the |
---|
23 | complete <b>mrun</b> options which are necessary for the |
---|
24 | appropriate |
---|
25 | parameter file are described. Furthermore not all details of the |
---|
26 | configuration file are described here. Therefore you should take a |
---|
27 | look at the <a href="http://www.muk.uni-hannover.de/%7Eraasch/Software/mrun_beschreibung.html">mrun</a> |
---|
28 | documentation (sorry: this is only available in German, so far. If you |
---|
29 | think that you |
---|
30 | would profit from an English version, please give a message to the PALM |
---|
31 | group). </p> |
---|
32 | <p style="line-height: 100%;">The following configuration |
---|
33 | data |
---|
34 | exclusively applies to model runs on the SGI ICE system of the |
---|
35 | HLRN when using several processing elements (i.e. for the parallel |
---|
36 | version of the model). The proper installation of the model is |
---|
37 | presumed (see <a href="chapter_5.0.html">chapter |
---|
38 | 5.0</a>). Furthermore it is supposed that the user is located in |
---|
39 | the |
---|
40 | directory <tt><font style="font-size: 10pt;" size="2">$HOME/palm/current_version</font></tt> |
---|
41 | on its local computer, where the configuration file (<tt><font style="font-size: 10pt;" size="2">.mrun.config</font></tt>) should reside. |
---|
42 | The configuration file has the following contents (among other things): |
---|
43 | <br> |
---|
44 | </p><pre style="line-height: 100%;"><font style="font-size: 10pt;" size="2">%mainprog palm.f90<br>%base_directory $HOME/palm/current_version<br>%base_data ~/palm/current_version/JOBS<br>%source_path $base_directory/trunk/SOURCE<br>#<br></font><font style="font-size: 10pt;" size="2">%fopts -g:-w:-xT:-O3:-cpp:-r8:-ftz:-fno-alias:-no-prec-div:-no-prec-sqrt:-ip:-nbs:-convert:little_endian lcsgih parallel<br></font><font style="font-size: 10pt;" size="2">%lopts -g:-w:-xT:-O3:-cpp:-r8:-ftz:-fno-alias:-no-prec-div:-no-prec-sqrt:-ip:-nbs:-Vaxlib lcsgih parallel</font><font style="font-size: 10pt;" size="2"><br>#</font><br><font style="font-size: 10pt;" size="2">EC:[[ \$locat = execution]] & & <i>cat </i>RUN_CONTROL </font><br><font style="font-size: 10pt;" size="2">#</font><br><a href="chapter_3.4.html#PARIN"><font style="font-size: 10pt;" size="2">PARIN</font></a><font style="font-size: 10pt;" size="2"> in:job d3# $base_data/$fname/INPUT _p3d</font><br><font style="font-size: 10pt;" size="2">#</font><br><a href="chapter_3.4.html#RUN_CONTROL"><font style="font-size: 10pt;" size="2">RUN_CONTROL</font></a><font style="font-size: 10pt;" size="2"> out:loc:tr d3# $base_data/$fname/MONITORING _rc</font><br><a href="chapter_3.4.html#HEADER"><font style="font-size: 10pt;" size="2">HEADER</font></a><font style="font-size: 10pt;" size="2"> out:loc:tr d3# $base_data/$fname/MONITORING _header</font><span style="font-family: mon;"><span style="text-decoration: underline;"><br></span><a href="chapter_3.4.html#DATA_1D_PR_NETCDF">DATA_1D_PR_NETCDF</a></span><font style="font-size: 10pt;" size="2"> out:loc:tr pr# ~/palm/current_version/JOBS/$fname/OUTPUT _pr nc</font></pre> |
---|
45 | <p style="line-height: 100%;"><font face="Thorndale, serif">The first |
---|
46 | five lines specify values of |
---|
47 | so-called environment variables. Such lines begin with a |
---|
48 | “%”- |
---|
49 | sign. After at least one blank the name of the variable</font> <font face="Thorndale, serif">(e.g. |
---|
50 | </font><tt><i><font face="Thorndale, serif">source_path</font></i></tt><font face="Thorndale, serif">) |
---|
51 | follows and then seperated by at least one blank the value of the |
---|
52 | variable. Again separated by blank t<font face="Thorndale, serif">he |
---|
53 | so-called validity domain</font> can be indicated (later more). |
---|
54 | With the first four variables <b>mrun</b> gets to know in |
---|
55 | which |
---|
56 | directory the source code lies (</font><tt><i><font face="Thorndale, serif">source_path</font></i></tt><font face="Thorndale, serif">), |
---|
57 | the file name of the main program (</font><tt><i><font face="Thorndale, serif">mainprog</font></i></tt><font face="Thorndale, serif">)</font><font face="Thorndale, serif">. Also, two variables are defined which contain path informations used later in the file (<span style="font-style: italic;">base_directory</span>, <span style="font-style: italic;">base_data</span>). <b>mrun |
---|
58 | </b>needs these information, <font color="#000000">because |
---|
59 | for each |
---|
60 | model run the executable is created by compiling the respective source file.</font> |
---|
61 | Normally, only the main program (palm.f90) will be compiled while all |
---|
62 | other object files are just linked. These object files have already |
---|
63 | been created from the source code files during the installation of the |
---|
64 | model |
---|
65 | (see </font><a href="chapter_5.0.html"><font face="Thorndale, serif">chapter |
---|
66 | 5.0</font></a><font face="Thorndale, serif">). |
---|
67 | <b>mrun</b> uses |
---|
68 | certain standard options for the compilation process. Beyond that you |
---|
69 | can |
---|
70 | declare additional options with the environment variable </font><tt><i><font face="Thorndale, serif">fopts</font></i></tt><font face="Thorndale, serif">. |
---|
71 | Within the value assignment of an environment variable in the |
---|
72 | configuration file no blanks must be |
---|
73 | used. If blanks are necessary they must <font face="Thorndale, serif">be |
---|
74 | replaced </font>by colons (“:”). <b>mrun</b> |
---|
75 | will |
---|
76 | interpret these colons as blanks (2 colons written one behind the |
---|
77 | other will be interpreted as a colon). Thus in the example above</font> fopts |
---|
78 | has the value<tt><font face="Thorndale, serif"> </font></tt>“<tt>-g -w -xT -O3 -cpp -r8 -ftz -fno-alias -no-prec-div -no-prec-sqrt -ip -nbs -convert little_endian<i><font face="Thorndale, serif"><font color="#000000">”</font></font></i></tt><font face="Thorndale, serif"><font color="#000000">. |
---|
79 | Thus a PALM executable is generated using high level optimization (</font></font><font color="#000000"><span style="font-family: monospace;">-O3</span></font><font face="Thorndale, serif"><font color="#000000">).</font></font><font color="#000000"><font face="Thorndale, serif"> |
---|
80 | For all other options |
---|
81 | see the compiler manual on the SGI (</font><font size="2"><font face="Cumberland, monospace">man</font></font></font><tt><font color="#000000"> <span style="font-family: Cumberland,monospace;">ifort</span></font></tt><font face="Thorndale, serif"><font color="#000000">). |
---|
82 | Additional libraries |
---|
83 | which the compiler should use may have to be given by |
---|
84 | the environment variable </font></font><tt><font size="2"><font face="Cumberland, monospace"><font color="#000000">lopts</font></font></font></tt><font color="#000000"> |
---|
85 | <font face="Thorndale, serif">(loader options).</font></font><font color="#000000"><font face="Thorndale, serif"> </font></font> |
---|
86 | </p><p style="line-height: 100%;"><font color="#000000">Compiler and |
---|
87 | loader options usually differ from computer to computer. In the |
---|
88 | configuration file therefore several value assignments for the |
---|
89 | variables </font><tt><font style="font-size: 10pt;" size="2"><font color="#000000">fopts</font></font></tt><font color="#000000"> |
---|
90 | and </font><tt><font style="font-size: 10pt;" size="2"><font color="#000000">lopts</font></font></tt><font color="#000000"> |
---|
91 | exist which become active for different computers.</font><font color="#800000"> |
---|
92 | <font color="#000000">Which value assignment is used is |
---|
93 | described by |
---|
94 | the so-called validity domain which follows in the appropriate |
---|
95 | variable lines after the value of variables.</font></font><font color="#000000"> |
---|
96 | In the example above the entry “</font><font color="#000000"><font style="font-size: 11pt; font-style: italic; font-family: monospace;" size="2">lcsgih</font></font><tt><font color="#000000"><span style="font-style: italic; font-family: monospace;"> |
---|
97 | </span></font><font color="#000000"><i><font style="font-size: 11pt;" size="2">parallel</font></i></font></tt><font color="#000000">” |
---|
98 | stands for </font><tt><font style="font-size: 10pt;" size="2"><font color="#000000">fopts</font></font></tt><font color="#000000"> |
---|
99 | and </font><tt><font style="font-size: 10pt;" size="2"><font color="#000000">lopts</font></font></tt><font color="#000000">. |
---|
100 | These lines only become active if a run on the parallel computer of |
---|
101 | the HLRN (</font><tt><i><font style="font-size: 10pt;" size="2">lcsgih</font></i></tt><font color="#000000">) |
---|
102 | on several <font color="#000000">(</font><tt><i><font style="font-size: 10pt;" size="2"><font color="#000000">parallel</font></font></i></tt><font color="#000000">) |
---|
103 | </font>processors is started. The activation takes place when you |
---|
104 | appropriately specify the <span style="font-weight: bold;">mrun</span> |
---|
105 | options </font><tt><font color="#000000">-h</font></tt><font color="#000000"> |
---|
106 | and </font><tt><font color="#000000">-K</font></tt><font color="#000000"> |
---|
107 | (see below). This way, the validity domain can be limited also for all |
---|
108 | other environment-variables. If no validity domain |
---|
109 | is indicated then the given values of variables are valid for all |
---|
110 | computers. </font> |
---|
111 | </p><p style="line-height: 100%;">After the value |
---|
112 | assignment for the |
---|
113 | variables the so-called error commands follow which have to begin with |
---|
114 | “<tt><font style="font-size: 11pt;" size="2">EC:</font></tt>” |
---|
115 | in the first column (comment lines begin with “<tt>#</tt>”). |
---|
116 | Directly |
---|
117 | after the colon Unix commands follow (korn shell syntax) which are |
---|
118 | processed by <b>mrun</b> if errors arise during |
---|
119 | the model run. The command described in the example (<tt><font style="font-size: 10pt;" size="2">cat |
---|
120 | RUN_CONTROL</font></tt>) is executed thereby only on the |
---|
121 | condition that errors during the execution of the model (<tt><font style="font-size: 10pt;" size="2">execution</font></tt>) |
---|
122 | arise. An <b>mrun </b>internal environment variable which |
---|
123 | indicates |
---|
124 | the |
---|
125 | respective abort place in case of errors is <tt><a href="http://www.muk.uni-hannover.de/institut/software/mrun_beschreibung.html#locat">locat</a></tt>. |
---|
126 | In order to determine the actual value of this variable at the |
---|
127 | execution of <b>mrun</b> the “<tt>$</tt>” |
---|
128 | - prefix |
---|
129 | must be protected by a “\” since the configuration |
---|
130 | file has been |
---|
131 | already interpreted once when reading in through <b>mrun</b> |
---|
132 | and the |
---|
133 | value from |
---|
134 | <tt>locat</tt> would then supply the empty character |
---|
135 | string. If |
---|
136 | errors arise during the model run this command |
---|
137 | copies the data written by the model up to then to the local file |
---|
138 | <a href="chapter_3.4.html#RUN_CONTROL">RUN_CONTROL</a> |
---|
139 | on the standard output where they can be checked after |
---|
140 | job end.<font color="#000000"> RUN_CONTROL is an output |
---|
141 | file of the |
---|
142 | model which has to be copied according to the default configuration |
---|
143 | file |
---|
144 | (see below) after the end of the model run to a permanent file of the |
---|
145 | user but this action would not be performed in case of errors |
---|
146 | in the model run, so that the file content would be lost.</font> |
---|
147 | With |
---|
148 | the help of the error command one can secure it nevertheless. </p> |
---|
149 | <p style="line-height: 100%;">Before and/or after |
---|
150 | the error commands in the example file you can find the so-called input |
---|
151 | and/or output commands which are implemented before and/or after the |
---|
152 | model run. </p> |
---|
153 | <p style="line-height: 100%;">After the output commands<font color="#000000"> |
---|
154 | <font color="#000000">in the example file t</font>he |
---|
155 | so-called file |
---|
156 | connection statements</font> <font color="#000000">follow |
---|
157 | </font>via |
---|
158 | which tell <span style="font-weight: bold;">mrun</span> |
---|
159 | how to connect |
---|
160 | the local files in the temporary working |
---|
161 | directory of the model with the respective permanent files of the user. |
---|
162 | <b>mrun</b> copies the input and output files in accordance |
---|
163 | with the |
---|
164 | data in these connection statements. The file connection statements are |
---|
165 | explained in detail in the <b>mrun</b> |
---|
166 | description (<a href="http://www.muk.uni-hannover.de/institut/software/mrun_beschreibung.html#chapter6.3">chapter |
---|
167 | 6.3</a>, in German) and are described here only as far as |
---|
168 | necessary. A |
---|
169 | file connection statement usually consists of entries in 5 columns |
---|
170 | whereby all columns are separated from each other by one or more blanks |
---|
171 | (the blanks define the individual columns). In the |
---|
172 | first column the local file name (e.g. <tt><font size="2">PARIN</font></tt>) |
---|
173 | is given as it is addressed by the model. It must begin directly at |
---|
174 | the start of the line. In the second column the so-called file |
---|
175 | attributes |
---|
176 | are given. These determine whether the file is an input file (<tt><font style="font-size: 10pt;" size="2">in</font></tt>) |
---|
177 | or an output file (<tt><font size="2">out</font></tt>), |
---|
178 | whether output |
---|
179 | files are to be transferred to the local computer of the user (<tt><font style="font-size: 10pt;" size="2">tr</font></tt>) |
---|
180 | or whether they are to be archived (<font size="2"><font face="Cumberland, monospace">fl</font></font>). |
---|
181 | If a file has several attributes then they are separated by a <font color="#000000">colon |
---|
182 | in each case .</font> </p> |
---|
183 | <p style="line-height: 100%;">With the entries in the |
---|
184 | third column one |
---|
185 | specifies the conditions under which a file connection statement |
---|
186 | becomes active i.e. under |
---|
187 | which circumstances it is executed by <b>mrun</b>. Then <b>mrun</b> |
---|
188 | copies the appropriate in or output files only if at least one of the |
---|
189 | character strings registered in column 3 (again two or more character |
---|
190 | strings have to be separated from each other by a colon) is |
---|
191 | indicated within the mrun <b>call</b> by the option <a href="http://www.muk.uni-hannover.de/institut/software/mrun_beschreibung.html#Opt-r">-r</a>. |
---|
192 | Thus a call of the form </p> |
---|
193 | <ul> <pre style="margin-bottom: 0.5cm; line-height: 100%;"><font style="font-size: 10pt;" size="2">mrun - h lcsgih -d abcde -r "d3#"</font></pre></ul> |
---|
194 | <p style="line-height: 100%;">would lead to the fact that |
---|
195 | the input |
---|
196 | file with the local name PARIN is made available and the output files |
---|
197 | RUN_CONTROL and HEADER are copied to permanent files. The output |
---|
198 | files PLOT1D_PAR and PLOT1D_DATA are not copied so that their |
---|
199 | contents are not available to the user after the end of the job. If |
---|
200 | these files are to be copied of <b>mrun</b> then the call |
---|
201 | must be</p> |
---|
202 | <ul> <pre style="margin-bottom: 0.5cm; line-height: 100%;"><font style="font-size: 10pt;" size="2">mrun -h lcsgih -d abcde -r "d3# pr#"</font></pre></ul> |
---|
203 | <p style="line-height: 100%;">Instead of the option -r you |
---|
204 | can |
---|
205 | separately address the file connection statements for input and/or |
---|
206 | output files with the options -i and -o. If one likes to make sure with |
---|
207 | these two options that in the example configuration |
---|
208 | file all file connection statements are actually executed then |
---|
209 | the call must be: </p> |
---|
210 | <ul> <pre style="margin-bottom: 0.5cm; line-height: 100%;"><font style="font-size: 10pt;" size="2">mrun -h lcsgih -d abcde -i "d3#" -o "d3# pr#"</font></pre></ul> |
---|
211 | <p style="line-height: 100%;"><font color="#000000">The |
---|
212 | names of the |
---|
213 | local files assigned permanent files are build from the entries in |
---|
214 | the 4th and 5th column of the file connection statements and the |
---|
215 | value of the <span style="font-weight: bold;">mrun</span> |
---|
216 | option </font><tt><font style="font-size: 10pt;" size="2"><font color="#000000">-d</font></font></tt><font color="#000000"> |
---|
217 | in the following way:</font><font color="#800000"> </font> |
---|
218 | </p><ul> <p style="line-height: 100%;">File |
---|
219 | name (inclusive path) = “value of |
---|
220 | the 4th column” + “value of the option <tt><font size="2">-d</font></tt>” |
---|
221 | + “value of the 5th column”.</p> |
---|
222 | </ul><p style="line-height: 100%;">The 4th column |
---|
223 | contains the path name |
---|
224 | whereby <tt><a href="http://www.muk.uni-hannover.de/institut/software/mrun_beschreibung.html#fname">$fname</a></tt> |
---|
225 | is replaced by the value indicated for the option <tt><font size="2">-d</font></tt>. |
---|
226 | The 5th column contains the so-called file name extension. The name |
---|
227 | of the permanent file which was copied by <b>mrun</b> to |
---|
228 | the local |
---|
229 | file <tt>PARIN</tt> thereby reads: </p> |
---|
230 | <ul> <pre style="margin-bottom: 0.5cm; line-height: 100%;"><font style="font-size: 10pt;" size="2">~/palm/current_version/JOBS/abcde/INPUT/abcde_p3d.</font></pre></ul> |
---|
231 | <p style="line-height: 100%;">In the same way the names of |
---|
232 | the |
---|
233 | permanent files of the remaining <font color="#000000">file |
---|
234 | connection statements </font>can be formed. </p> |
---|
235 | <p style="line-height: 100%;">With this example |
---|
236 | configuration file |
---|
237 | exactly one input file is copied into the temporary working directory |
---|
238 | of the model. This file has the local name <a href="chapter_3.4.html#PARIN">PARIN</a> |
---|
239 | and contains the steering parameters for the model and has to be |
---|
240 | provided by the user for each model run. </p> |
---|
241 | <p style="line-height: 100%;">The example configuration |
---|
242 | file also |
---|
243 | instructs <b>mrun</b> to copy three output files of the |
---|
244 | model to |
---|
245 | appropriate permanent files of the user at the end of the run. |
---|
246 | There are timestep information (local file name <tt><a href="chapter_3.4.html#RUN_CONTROL">RUN_CONTROL</a></tt>), |
---|
247 | the so-called header file, in which the values of the most selected |
---|
248 | parameters for this run (<tt><a href="chapter_3.4.html#HEADER">HEADER</a></tt>) |
---|
249 | are located, as well as a file with data of horizontally averaged |
---|
250 | vertical profiles |
---|
251 | (<tt><a href="chapter_3.4.html#DATA_1D_PR_NETCDF">DATA_1D_PR_NETCDF</a></tt>). |
---|
252 | A model run does not presuppose neither the file connection statements |
---|
253 | for |
---|
254 | output files nor their activation. But without declaring AND activating |
---|
255 | them usually the data produced by the model |
---|
256 | are lost after the end of the model run! </p> |
---|
257 | <p style="line-height: 100%;">As already mentioned the |
---|
258 | configuration |
---|
259 | file offers a variety of further possibilities to steer the |
---|
260 | execution of the model run. Some of them are described in the next |
---|
261 | chapter. Same applies to possible other options of the <b>mrun</b> |
---|
262 | call. For these please refer to the <a href="http://www.muk.uni-hannover.de/%7Eraasch/Software/mrun_beschreibung.html">mrun</a> |
---|
263 | documentation (in German). An <b>mrun </b>call for the |
---|
264 | execution of a |
---|
265 | model run |
---|
266 | on several processors on the SGI ICE of the HLRN must be |
---|
267 | supplemented by the following options in each case: </p> |
---|
268 | <ul style="font-family: monospace;"> <pre style="margin-bottom: 0.5cm; line-height: 100%;"><font style="font-size: 10pt;" size="2">mrun - K parallel -X ... -T ... -t ... -m ---</font></pre></ul> |
---|
269 | <p style="line-height: 100%;">Only the indication of <tt><font style="font-size: 11pt;" size="2">-K |
---|
270 | parallel</font></tt> causes the parallel execution of the |
---|
271 | run on |
---|
272 | several processors (otherwise a scalar execution on one processor is |
---|
273 | accomplished). In addition to this the number of the |
---|
274 | processing elements which shall be used has to be pre-scribed with the |
---|
275 | option <tt><font style="font-size: 10pt;" size="2">-X</font> |
---|
276 | </tt><font size="2">(</font><font style="font-size: 10pt;" size="2">e.g. |
---|
277 | </font><tt><font style="font-size: 10pt;" size="2">-X 32</font></tt><font size="2">) and the number of tasks (processors) on onde node have to be given by option -T.</font> |
---|
278 | In each case the permitted CPU time in seconds and the required memory |
---|
279 | size in MB must be indicated by the options <tt><font style="font-size: 11pt;" size="2">-t</font></tt> |
---|
280 | and <tt><font style="font-size: 11pt;" size="2">-m</font></tt>, |
---|
281 | respectively<font face="Thorndale, serif">.</font> |
---|
282 | Alternatively, memory and cpu-time demands can be set by the appropriate environment |
---|
283 | variables in the configuration file: </p> |
---|
284 | <blockquote style="line-height: 100%;"><tt><font style="font-size: 10pt;" size="2"><font face="Cumberland, monospace">%memory <i>1500</i> lcsgih parallel</font></font></tt><font style="font-size: 10pt;" size="2"><font face="Cumberland, monospace"><br> </font></font><tt><font style="font-size: 10pt;" size="2"><font face="Cumberland, monospace">%cputime <i>1000</i> lcsgih parallel</font></font></tt></blockquote> |
---|
285 | <p style="line-height: 100%;">The values indicated there |
---|
286 | can be |
---|
287 | overridden with the values of the options <tt><font style="font-size: 10pt;" size="2">-t</font></tt> |
---|
288 | and/or <tt><font style="font-size: 10pt;" size="2">-m</font></tt>, |
---|
289 | respectivly.</p><p style="line-height: 100%;"><span style="font-weight: bold;">Warning: When changing the coniguration file, please never use the TAB key!</span> </p> |
---|
290 | <hr><p style="line-height: 100%;"><br> |
---|
291 | <font color="#000080"><font color="#000080"><a href="chapter_3.1.html"><font color="#000080"><img src="left.gif" name="Grafik1" align="bottom" border="2" height="32" width="32"></font></a><a href="index.html"><font color="#000080"><img src="up.gif" name="Grafik2" align="bottom" border="2" height="32" width="32"></font></a><a href="chapter_3.3.html"><font color="#000080"><img src="right.gif" name="Grafik3" align="bottom" border="2" height="32" width="32"></font></a></font></font></p><p style="line-height: 100%;"><i>Last change: </i> |
---|
292 | $Id: chapter_3.2.html 336 2009-06-10 11:19:35Z weinreis $</p> |
---|
293 | </body></html> |
---|