HES-SO.2

Multi-Site ARC services

Long Title: Multi-Site ARC services
Leading
Organization:
Haute École Spécialisée de Suisse occidentale
Participating
Organizations:
Scuola Universitaria Professionale della Svizzera Italiana
Domain: Grid
Status: finished
Start Date: 01.10.2010
End Date: 30.09.2011
Project Leader: M. Niinimaki
Website: http://www.xtremwebch.net/mediawiki/index.php/MultiSiteArc

This new distributed and heterogeneous cluster is used as platform for research, education, and application development. Applications in the fields of fluid dynamics simulation, migration simulation and image and textual analysis are made available through the Grid infrastructure, and demonstrations, lab assignments and lectures about distributed computing are facilitated by the new cluster, as well as performance analysis for several cluster softwares.

Results

This project makes powerful Grid computing available for students and researchers. Moreover, it puts together resources provided by HEPIA and other organizations. The installations of programs that are available to researchers are an OpenFoam simulation system and a multi-modal search application.

Component Description
Project documentation on XtremWeb-CH
BIS multimodal application running in the cluster Multimodal image/text index. This application developed by BIS combines the GIFT image finder package with textual descriptions of medical images, indexed by the Apache Lucene software package. The image indexing is implemented on ARC.
Runtime environments for OPENFOAM and ROSETTA OpenFoam (open source Computational Fluid Dynamics software) available as ARC runtime environment on the cluster Gordias (availability information)
Cluster capable of executing Windows jobs (bridge for Windows nodes) The ARC-XWCH bridge developed in this project uses a heteregeneous set of computers, some with the Linux operating system, some with Windows. The opsys-field in the ARC job description can be used to instruct the system to execute on Windows. The bridge is installed in arctest.unige.ch and available in SMSCG.
GridKa school The project's achievements (ARC-XWCH bridge, ARC on Gordias) were used as resources during the 9th international GridKa school in Karlsruhe, Germany, Sept 2011.
Implementation part in publication R. Della Ratta Rinaldi, A. Iob and R. Arina: An efficient discontinuous Galerkin method for aeroacoustic propagation, Int. J. of Numerical Methods in Fluids, 2011

Instead of the planned NeuroWeb application deployment on the ARC middleware, the SELECTOR application has been chosen - simulating the migration of individuals through time, as well as their genes, in a geographic area representing East Asia.

Extensions of the ARC-XWCH bridge and the deployment of further applications are planned in the MUSIC project.


Goals

The Multi-Site ARC services project aims at:

  1. Extending the Swiss Multi-Science Grid (SMSCG) platform with a new node providing an access to a high-performance Linux cluster.
    • Hardware: 1 high-performance Linux cluster at hepia (312 2.4 GHz cores, 3Tflops) + desktop PC computing nodes from Sierre/BIS.
    • Local Resource Management Systems (cluster softwares): Sun Grid Engine (SGE) and MPI support.
    • Grid software: ARC middleware.
  2. Integrating the XtremWeb-CH platform, developed partially in the context of the Virtual EZ Grid project, into the SMSCG platform.
    • the bridge will be extended so that the resources of the Windows computers will be available as well. Thus, the hepia ARC node will be visible as two ARC queues to SMSCG, Linux (default) and Windows (available when the user’s job’s ‘os’ attribute has been set to Windows).
  3. Deploying three scientific applications on the SMSCG platform, and therefore making them available for the Swiss academy.
    • OpenFoam: A Computational Fluid Dynamics software application.
    • NeuroWeb: A neural activation mapping application written for XWCH in the framework of the Virtual EZ Grid project. The Multi-Site ARC services project will expand its usability and availability by using Jopera.
    • Multimodal image/text index: This application developed by BIS combines the GIFT image finder package with textual descriptions of medical images, indexed by the Apache Lucene software package.

The project will create a Grid cluster that is available to

  • local users (using the SGE and XtremWebCH cluster software [AB2005]) as well as
  • Grid users of the Swiss MultiScience Computing Grid (SMSCG) using the Advanced Resource Connector (ARC [E2006]) Grid middleware.

The nodes of the cluster are heterogeneous and will be available from two different sites:

  • hepia,
  • HES-SO Geneve and Business Information Systems (BIS),
  • HES-SO Sierre.

Most of the nodes will be from hepia's (physical) one-rack Linux cluster. The nodes of this cluster will naturally be well connected with each other with Infiniband and Gigabit Ethernet. A small number of additional nodes, running under Microsoft Windows OS, will be provided by BIS.

Benefits

The Grid cluster will be available for the researchers and students through the SMSCG project with the same priority as for hepia local users.
It is rare to be able to share Windows resources in the Grid. The hepia ARC node will be visible as two ARC queues to SMSCG, Linux (default) and Windows (available when the user's job's "os" attribute has been set to Windows).
This distributed, heterogeneous cluster will be used as platform for research, education, and application development.
It will:

  • facilitate demonstrations, lab assignments and lectures about distributed computing at HES-SO. These lectures will be given by Marko Niinimaki and Nabil Abdennadher (bachelor and master students) (more details regarding this lecture).
  • serve as a test site for performance analysis for several cluster softwares.

From the research point of view, in the project we will study efficient distribution of computing in an environment where some nodes are closely connected with fast links, and some are remote.
In education, the cluster will be used in lectures, lab assignments and demonstrations for the students of hepia (bachelor and master): Large scale distributed systems (Grid and Volunteer computing).
The cluster will be fully available for the SMSCG even after the termination of the project, maintained by the hepia (IT department and the INIT research institute) as a part of hepia’s computing infrastructure.

Back