Advanced Resource Connector

Advanced Resource Connector

infobox software
name = ARC



caption = NorduGrid logo and monitor screenshot
developer = NorduGrid, KnowARC and NDGF
latest_release_version = 0.6.1
latest_release_date = 7 September 2007
operating_system = Linux
genre = Grid computing
license = GNU General Public License
website = http://www.nordugrid.org/

Advanced Resource Connector, or ARC, is a Grid middleware developed by NorduGrid. ARC is an open source software distributed under the GPL license. It enables production quality computational and data Grids.

Background

Early releases of ARC were known as the "NorduGrid middleware". The first release was announced in May 2002. Since then, this middleware was installed and used in a variety of production Grid environments. Emphasis is put on scalability, stability, reliability and performance of the middleware. Resources inter-connected by the means of ARC constitute one of the largest production Grids in the world.

Middleware description

ARC provides a reliable implementation of the fundamental Grid services, such as information services, resource discovery and monitoring, job submission and management, brokering and data management and resource management. Most of these services are provided through the security layer of the Grid Security Infrastructure. The middleware builds upon standard Open Source solutions like the OpenLDAP, OpenSSL, SASL and Globus Toolkit (GT) libraries. All the external software is provided in the download area and the complete list of external software dependencies can be found here. NorduGrid provides innovative solutions essential for a production quality middleware: the "Grid Manager", "gridftpd" (the ARC/NorduGrid GridFTP server), the information model and providers ("NorduGrid schema"), "User Interface and broker" (a "personal" broker integrated into the user interface), extended Resource Specification Language ("xRSL"), and the monitoring system.

The listed solutions are used as replacements and extensions of the original pre-WS services of the Globus Toolkit. ARC does not use most of GT services, such as GRAM, job submission commands, the WUftp-based gridftp server, the gatekeeper, GRAM job-manager scripts, MDS information providers or schemas. Moreover, ARC extends Globus RSL and makes the Globus MDS functional – without altering the original code. ARC is thus much more than a Globus Toolkit – it is an out-of-the-box Grid solution that offers its own services built upon the GT libraries.

ARC middleware integrates computing resources (usually, computing clusters managed by a batch system or standalone workstations) and Storage Elements, making them available via a secure common Grid layer. An definitive description of the architecture can be found in the [http://dx.doi.org/10.1016/j.future.2006.05.008 dedicated FGCS journal article] . Complete documentation, including component descriptions, installation details, usage instructions, articles and presentations, can be found at the [http://www.nordugrid.org NorduGrid Web site] .

ARC main components

ARC basic components are:

# Grid services running on the resources: the "Grid Manager", "gridftpd" and the "information services". Grid jobs are submitted to a site through "gridftpd" and a separate session directory is created for each job. The Grid session directories are made available through the "gridftpd" server during and after job execution. The "Grid Manager" is a service running on a computing resource taking care of jobs, session directories and the input data cache area. Information services are implemented as efficient scripts populating the NorduGrid information database stored in the Globus-specific OpenLDAP backends.
# Indexing services for the resources and data: a special, simplified usage of the GT-2 GIIS OpenLDAP backend allows to build a hierarchical mesh of Grid-connected sites. For data indexing, ARC middleware can use a variety of services, such as the GT-2 Replica Catalog, the GT-2 RLS or gLite's Fireman. ARC client tools and the Grid Manager are capable of interacting with these services.
# Clients making intelligent use of the distributed information and data available on the Grid. ARC comes with a light-weight command line client, the User Interface. The ARC "User Interface" is a set of tools to submit, monitor and manage jobs on the Grid, move data around and query resource information. The User Interface comes with a built-in broker, which is able to select the best matching resource for a job. Grid job requirements are expressed via xRSL. Another special client is the Grid Monitor, which uses any Web browser as an agent to periodically query the distributed information system and present the results as a set of inter-linked Web pages.

Other important components are:

# Smart Storage Element (SSE): SSE is a replacement of the current ARC gridftpd-based simple storage element. SSE is based on standard protocols such as HTTPS/G and SOAP. SSE will provide flexible access control, data integrity between resources and support for autonomous and reliable data replication.
# Logging service.

ARC is designed to be a scalable, non-intrusive and portable solution. The development is user- and application-driven, with the main requirements being those of performance, stability, usability and portability. As a result of this approach, the standalone client is available for a dozen of platforms and can be installed in a few minutes. The server installation does not require a full site reconfiguration. The middleware can be built on any platform where the external software packages (like GT libraries) are available. While being deployed on a large production Grid and being used by real users, the middleware is naturally undergoing continuous real life tests.

ARC middleware availability

ARC middleware is free to be used anywhere by anybody. It is available from the NorduGrid public repository in pre-built binary distributions for a variety of Linux systems. Source code is also available from this repository and from the NorduGrid CVS.

Furthermore, a standalone client binary tarballs are available for a variety of Linux systems. This client comes with all the required external software (most notably, parts of the Globus Toolkit) and configuration, thus providing a complete, out-of-the-box client package that can be used by other Grids, e.g., for data transfer or data indexing.

Software releases are available under the GNU General Public License (GPL).

Development

The open source development of ARC middleware is coordinated by the NorduGrid collaboration. Contributions to the software, documentation and dissemination activities are coming from the community and from various projects, such as the EU KnowARC project, [http://www.ndgf.org/ Nordic DataGrid Facility] and various national Grid projects.

tandards and interoperability

ARC developers are committed to implementation and development of common Grid standards, considering this the basis for middleware interoperability. The KnowARC project develops a Web Service based version of ARC, also known as ARC1. It strives to comply with all the existing community standards, most of which are developed in the framework of the Open Grid Forum activities. ARC1 thus will become one of the first fully interoperable Grid middlewares.

User support

ARC user support and installation assistance is provided by the NorduGrid via the request tracking system and a variety of mailing lists. Extensive documentation and tutorial materials are available at the NorduGrid Web site.

References

Bibliography

*cite journal|first=Mattias|last=Ellert|coauthors=et.al.|title=Advanced Resource Connector middleware for lightweight computational Grids|journal=Future Generation Computer Systems|month=February|year=2007|volume=23|pages=219–240|doi=10.1016/j.future.2006.05.008

Related projects

A number of projects and initiatives contribute to development or make use of ARC middleware, such as:

* NorduGrid
* EU KnowARC project
* Nordic Data Grid Facility
* [http://www.nordugrid.org/ngin NGIn] : Innovative Tools and Services for NorduGrid
* [http://www.swegrid.se Swegrid] (Sweden)
* [http://www.dcgc.dk/ Dansk Center for Grid Computing] (Denmark)
* [http://www.csc.fi/proj/mgrid Material Sciences National Grid Infrastructure (M-grid)] (Finland)
* [http://grid.eenet.ee/ Eesti Grid] (Estonia)
* [http://www.norgrid.no/ NorGrid] (Norway)
* [http://www.swiss-grid.org Swiss Grid Initiative]

External links

* [http://www.nordugrid.org/middleware/ NorduGrid official website for the Advanced Resource Connector middleware]
* [http://www.knowarc.eu KnowARC] , EU project contributing to the Advanced Resource Connector middleware development
* [http://www.ndgf.org Nordic DataGrid Facility] , a Nordic project contributing to the Advanced Resource Connector middleware development
* [http://www.ogf.org Open Grid Forum] , the home of Grid standards


Wikimedia Foundation. 2010.

Игры ⚽ Поможем написать курсовую

Look at other dictionaries:

  • NorduGrid — Содержание 1 Краткая история 2 Цели и задачи 3 Организация …   Википедия

  • KnowARC — Сайт KnowARC Проект KnowARC («НоуАРК»; англ. KnowARC, Grid enabled Know how Sharing Technology Based on ARC Services and Open Standards) Гридифицированная технология совместного использования научной и технической информации, основанная на… …   Википедия

  • NorduGrid — Contents 1 History 2 Goals 3 ARC Community 4 …   Wikipedia

  • ARC — may stand for: Business*ARC Diversified, a non profit organization that manufactures food products and employs the severely disabled *ARC/Architectural Resources Cambridge, Inc., an architectural design firm located in Cambridge, Massachusetts… …   Wikipedia

  • Grid computing — is a term referring to the combination of computer resources from multiple administrative domains to reach a common goal. The grid can be thought of as a distributed system with non interactive workloads that involve a large number of files. What …   Wikipedia

  • KnowARC — improves and extends the existing state of the art technology found in the ARC Grid middleware. The project aims to significantly increase awareness and usage of such next generation ARC middleware. The result of the project will be extension of… …   Wikipedia

  • NGIn — The primary goal of the NGIn project is to train new Grid experts. The training programme includes a Nordic Grid school and Grid Ph.D. students. The project activities will go in line with the other Grid initiatives, ensuring smooth… …   Wikipedia

  • Berkeley DB — Original author(s) Margo Seltzer and Keith Bostic of Sleepycat Software Developer(s) Sleepycat Software, later Oracle Corporation Stable release 5.2.28 / June 10, 2011; 5 months ago …   Wikipedia

  • ARC — Die Abkürzung ARC steht für: Accounting Regulatory Committee, einen politischen Regelungsausschuss der EU Access to the Region s Core, ein Tunnelprojekt im Grossraum New York, siehe ARC Tunnel Act against Restraints of Competition, die… …   Deutsch Wikipedia

  • KnowARC — (Grid enabled Know how Sharing Technology Based on ARC Services and Open Standards) est un projet de recherche et développement. Il est financé en 2006 2009 par le Sixième programme cadre (FP6) de la Commission européenne à travers le Conseil d… …   Wikipédia en Français

Share the article and excerpts

Direct link
Do a right-click on the link above
and select “Copy Link”