Tsubame

Tsubame

This document contains local support information for PALM users on the Linux Cluster Tsubame of the Tokyo Institute of Technology, Tokyo, Japan (http://www.gsic.titech.ac.jp/~ccwww). Japanese and English user manuals are available for download (http://www.gsic.titech.ac.jp/~ccwww/tebiki).

Subversion

Installation:
Please install a recent version of subversion or simply copy svn-tyamanas.tgz (subversion 1.4.3) from /work on Tsubame (login). By using following commands subversion will be installed under your home directory.

cd ~
cp /work/
svn-tyamanas.tgz ~
tar xvzf svn-tyamanas.tgz

The following lines should be added to .profile (and should be executed manually on first-time installation):

export LD_LIBRARY_PATH=$HOME/svn/lib
export PATH=$HOME/svn/bin:$PATH

Usage:
Since Tsubame is located behind a firewall, the usual address svn://130.75.105.45 is unreachable from Tsubame. Instead, please login to media-o and use svn://p9c.cc.titech.ac.jp:36900. This port works in both directions, i.e. for svn update as well as svn commit commands.

Batch system

The implementation of the n1ge command on Tsubame requires modifications to mrun and subjob for PALM to run on Tsubame. Since mrun must be executed on one PE only, a one-PE "submitting job" is created when the user calls mrun. At the time when this "submitting job" is actually executed, it starts the main PALM job in the foreground. However, this only works if enough resources are available at that time. Therefore PALM users on Tsubame are advised to consider the queue load of the available queues for the main job (qstat -g c) before job submission.

According to the current queue configuration (http://www.gsic.titech.ac.jp/~ccwww/tgc/q_e.html), the following mrun options are available:

mrun optionexplanationpossible valuesdefault value
-qqueue name for main jobnovice, sla1, sla2, sla3, RAM64GB, RAM128GBsla3
-nqueue name for "submitting job" (always runs on 1 PE only)novice, sla1, sla2, sla3sla3
-ggroup numbername of the N1GE_GROUP that is required to utilize the bes or sla queuesnone

Note that the default value "sla3" of the mrun option -q may not always be the best choice. For code development, debugging or short test runs the value "novice" for both options may be suitable. Production runs should use the respective production queues (see http://www.gsic.titech.ac.jp/~ccwww/tgc/q_e.html for details). 

The computer center advised us that due to restrictions of the batch system the value "novice" should not be mixed with the other queues. Please specify either a combination of slan for -n and slan or RAM* for -q, or specify the combination "novice" + "novice".

The mrun option -t contains the CPU time demand for the main job in s which will be automatically converted into min for the n1ge command. The option -m contains the memory demand for the main job in MB which will be automatically converted into GB for the n1ge command.


Last change:  $Id: Tsubame.html 129 2007-10-30 12:12:24Z letzel $