Difference: CBCatBologna (1 vs. 4)

Revision 42009-10-02 - GergelyDebreczeni

Line: 1 to 1
 
META TOPICPARENT name="VirgoComputing"


Home
What is Virgo ?
People
CBwaves
GPU_inspiral
Computing activities
Analysis activities
Theory
Galery
Publications
Events
Useful links
Getting started
TDK/BSc/MSc/PhD
Archive
Contact
Other GW groups

How to run analysis pipelines at Bologna (CNAF) computer center

Line: 16 to 16
 

The procedure

Perform the following steps:
Changed:
<
<
>
>
  1. Obtain an account in the CNAF computer center. Instructions could be found here.
 
  1. Logg in to one of the following machines

Line: 98 to 98
  /opt/exp_software/virgo/lscsoft/etc/virgoenv.sh file
Changed:
<
<
  1. An automated software installation script is available under
>
>
  1. An automated software installation script is available in the RMKI Virgo Group SVN repository. You can check it out with the following command:
 
Changed:
<
<
/storage/gpfs_virgo3/home/gdebrecz/scripts
>
>
svn co http://grid.kfki.hu/svn/virgo/scripts
  See the description inside on how to use it.

Revision 32009-09-30 - GergelyDebreczeni

Line: 1 to 1
 
META TOPICPARENT name="VirgoComputing"


Home
What is Virgo ?
People
CBwaves
GPU_inspiral
Computing activities
Analysis activities
Theory
Galery
Publications
Events
Useful links
Getting started
TDK/BSc/MSc/PhD
Archive
Contact
Other GW groups

How to run analysis pipelines at Bologna (CNAF) computer center

Line: 38 to 38
  (cmd.: cd /storage/gpfs_virgo3/home/gdebrecz)
Deleted:
<
<
Create a new directory, and enter into it.
    (cmd.: mkdir mywd; cd mywd)
    
  IMPORTANT: Set the file creation mask to 0002, i.e. the files you are creating from now on will be group writeable.
Line: 50 to 45
 
(cmd.
umask 0002)
Added:
>
>
Create a new directory, and enter into it.
    (cmd.: mkdir mywd; cd mywd)
    
  Source VIRGO environment setting file:
   (cmd.:  . /opt/exp_software/virgo/lscsoft/etc/virgoenv.sh)

Revision 22009-09-04 - GergelyDebreczeni

Line: 1 to 1
 
META TOPICPARENT name="VirgoComputing"


Home
What is Virgo ?
People
CBwaves
GPU_inspiral
Computing activities
Analysis activities
Theory
Galery
Publications
Events
Useful links
Getting started
TDK/BSc/MSc/PhD
Archive
Contact
Other GW groups
Changed:
<
<

How to run analysis pipelines at Bologna (CNAF) computer center

>
>

How to run analysis pipelines at Bologna (CNAF) computer center

 
Added:
>
>

Introduction

The bologna computer center runs LSF batch system and is part of the EGEE Grid. Using the concept of the so called pilot jobs a virtual condor metacluster is maintened which is accessible from the User Interface machines (see below), so CBC condor pipelines can be submitted to it. Follow the procedure and if you have questions, send an e-mail to:

Gergely.Debreczeni@cern.ch

The procedure

 Perform the following steps:

Line: 65 to 77
  your jobs on the Worker Nodes - which are running as a different user - could access it !
Changed:
<
<

Notes:

>
>

Useful remarks

 
  1. You can find a test installation as an example here:
        /opt/exp_software/virgo/lscsoft/
        
Changed:
<
<
and have a look to
>
>
for S5 GRB runs or under /storage/gpfs_virgo3/home/gdebrecz/lscsoft/ /storage/gpfs_virgo3/home/gdebrecz/lscsoft/non-lsc for the s6_20090722 branch.
 
    /opt/exp_software/virgo/lscsoft/etc/s5grbenv.sh
     
Line: 78 to 92
  /opt/exp_software/virgo/lscsoft/etc/s5grbenv.sh to see how I source the various files.
Deleted:
<
<
 
  1. The system python installation should not be used,
Changed:
<
<
use the one installed in the above software area !
>
>
use the one installed in the above software area , this is automatically happens if you source the
   /opt/exp_software/virgo/lscsoft/etc/virgoenv.sh
  
file
  1. An automated software installation script is available under
        /storage/gpfs_virgo3/home/gdebrecz/scripts
       
    See the description inside on how to use it.
 


The RMKI Budapest Virgo Group

Revision 12009-09-03 - GergelyDebreczeni

Line: 1 to 1
Added:
>
>
META TOPICPARENT name="VirgoComputing"


Home
What is Virgo ?
People
CBwaves
GPU_inspiral
Computing activities
Analysis activities
Theory
Galery
Publications
Events
Useful links
Getting started
TDK/BSc/MSc/PhD
Archive
Contact
Other GW groups

How to run analysis pipelines at Bologna (CNAF) computer center

Perform the following steps:

  1. Logg in to one of the following machines
         ui01-virgo.cr.cnaf.infn.it.
         ui02-virgo.cr.cnaf.infn.it.
        
    These are the User Interface machine which shares the following directories with the Worker Nodes:
        /storage/gpfs_virgo3/home
        /storage/gpfs_virgo3/scratch
        /storage/gpfs_virgo3/virgo
      
    If possible use the scratch area, since it is world readable.
  2. Change to one of the shared directories.
        (cmd.: cd /storage/gpfs_virgo3/home/gdebrecz)
        
  3. Create a new directory, and enter into it.
        (cmd.: mkdir mywd; cd mywd)
        
  4. IMPORTANT: Set the file creation mask to 0002, i.e. the files you are creating from now on will be group writeable.
       (cmd.: umask 0002)
        
  5. Source VIRGO environment setting file:
       (cmd.:  . /opt/exp_software/virgo/lscsoft/etc/virgoenv.sh)
        
  6. Launch some condor test job and check whether it works fine or not.
        (cmd:.
        cp /storage/gpfs_virgo3/home/gdebrecz/condortest/* .
        condor_submit vog-testjob.des
        )
        
  7. If the testjobs finished OK, then from this point on you can do everything in the same way as on other clusters. Except the fact, that you have to copy the
        /opt/exp_software/virgo/lscsoft/etc/LSCdataFind
         
    executable and overwrite the one comes with the standard LSCsoft installation !

BE AWARE, that all your files and software _should be installed on the shared areas_ and should be group read/writeable so that your jobs on the Worker Nodes - which are running as a different user - could access it !


Notes:

  1. You can find a test installation as an example here:
        /opt/exp_software/virgo/lscsoft/
        
    and have a look to
        /opt/exp_software/virgo/lscsoft/etc/s5grbenv.sh
         
    to see how I source the various files.

  1. The system python installation should not be used, use the one installed in the above software area !


The RMKI Budapest Virgo Group

 
This site is powered by the TWiki collaboration platform Powered by Perl This site is powered by the TWiki collaboration platformCopyright &© by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback