...
Align | ||||
---|---|---|---|---|
| ||||
|
Summary
All information about the XBeach model can be found at the website http://www.xbeach.org. This page only describes internal Deltares procedures.Below you find instructions to run XBeach on the Deltares H4 cluster
Compiling and running XBeach MPI on the h4 cluster
Step 1: Compiling the program
- Set the intel 11, 32 bit compiler by executing the follwing command lines:
...
- If nor errors you have your executable now.
Step 2: Run XBeach MPI
- Put your run directory with the XBeach input files somewehere accessible for the h4-cluster (i.e. the P-drive)
...
- Put your shell script (<name>.sh) in the simulation directory
- In Putty go to your simulation directory on the h4
- submit your job to the h4-cluster by:
Code Block |
---|
qsub <name>.sh |
Trouble shooting
Ofcourse life is not always straight forward on a linux cluster. Don't feel stupid when you type "qstat" and your name is not part of the list. Stay calm and try not to cry but instead go to your simulation directory and check for the .o file. It will tell you the error. If the error is about mpd please contact Jamie (8176) or Jaap (8363) if not contact ICT.
...
Anchor | ||||
---|---|---|---|---|
|
Compile XBeach parallel version for use on Linux/cluster
- On your Windows PC, start Exceed > Exceed XDMCP Broadcast (or the icon on your desktop).
- Choose 'devux.wldelft.nl'.
- Under Sessions, choose 'GNOME'.
- Use your Deltares user name and password to log in.
- Start a Terminal session (Applications > System Tools > Terminal).
- Make a directory "checkouts":
Code Block mkdir ~/checkouts
- Checkout the latest and greatest version of XBeach (enter your Deltares password if asked for):
If you already have the local repository, but want to update it, use:Code Block svn co https://repos.deltares.nl/repos/XBeach/trunk ~/checkouts/XBeach
Code Block svn update
- Go to the XBeach directory:
Code Block cd ~/checkouts/XBeach
- Run
Code Block FC=ifort ./configure
- Run
Code Block make
- Make sure version 10 of the Intel Fortran compiler is used (instead of version 8):
Code Block . /opt/intel/fc/10/bin/ifortvars.sh
- Delete all files not needed for compiling to get rid of files that could mess it up:
Code Block make clean
- Compile the parallel version:
Code Block PATH=/opt/mpich2-1.0.7/bin:$PATH USEMPI=yes ./configure && make
- (optional) Copy the executable to your personal bin-folder:
Code Block cd ~/bin cp ~/checkouts/bin/xbeach.mpi .
Compiled version
Compiled Linux versions of XBeach (both the MPI and serial version) can be found in Arend's bulletin box:
...
Anchor | ||||
---|---|---|---|---|
|
Run XBeach parallel version on h3 cluster
To run a parallel XBeach job on the h3 cluster (from now on 'h3'), you need 3 things:
- A parallel version of XBeach somewhere on the u-drive (preferably in /u/username/bin)
- A job (shell) file you feed to the cluster
- A directory on your part of the u-drive with the simulation-data (params.txt, bathy.dep, etc)
Logging on to cluster
Windows
The easiest way to log on to h3, is using the program PuTTY, which can be found on the Desktop of your Deltares PC. The first time you connect to h3, you need to supply some basic parameters, which you can save for later use (with 'Save'). In the Dialog Box, under Host Name, fill in: h3.wldelft.nl; you don't need to touch the other options (leave the Protocol to SSH). Optionally, save the information as e.g. 'h3'. The first time you connect to h3, you'll probably see a message about the server's host key. Click Yes to accept. Log in with your Deltares user name and password.
...
to connect to h3. Your user name has already been sent for you, so you only need to submit your password.
Obtain latest version of XBeach executable
There are 2 ways to obtain the latest (or any) version of the parallel XBeach executable:
- Compile it yourself (see the instructions in #compilexbeach)
- Copy it from Arend Pool's BULLETIN:
Code Block cd ~/bin cp /u/pool_ad/BULLETIN/xbeach_linux/current/xbeach.mpi .
Obtain the XBeach MPI job file
There are also 2 ways to obtain the job file to run xbeach.mpi on h3:
- Copy it from Arend Pool's BULLETIN:
In the above instructions, it is assumed you place the job file in the direction /simulations. If you want to place it somewhere else, feel free to do so and change the instructions accordingly.Code Block mkdir ~/simulations # can be skipped if directory already exists cd ~/simulations cp /u/pool_ad/BULLETIN/xbeach_linux/xbeach.sh .
- Create the shell file yourself in a location you prefer. The file should contain the following code:
The second last line should contain the path to xbeach.mpi. Edit this if you have placed it somewhere else.Code Block #!/bin/sh . /opt/sge/InitSGE export PATH="/opt/mpich2/bin:$PATH" echo "numslots: $DELTAQ_NumSlots" echo "nodes: $DELTAQ_NodeList" echo $DELTAQ_NodeList | tr ' ' '\n' | sed 's/.wldelft.nl//' > machines echo "Machines file:" cat machines mpdboot -1 -n $DELTAQ_NumSlots -f machines mpirun -np $DELTAQ_NumSlots ~/bin/xbeach.mpi mpdallexit
Run the parallel job
Make sure you have placed your simulation (directory) somewhere on a shared location (u-drive or p-drive) and go ('cd') there (for example):
...
where N is the number of nodes you want to use and path-to-job-file the path to xbeach.sh.
More info
The SGE User Guide can be found at the ICT department space of this wiki.