National Technical Reports Library - NTRL

National Technical Reports Library

The National Technical Information Service acquires, indexes, abstracts, and archives the largest collection of U.S. government-sponsored technical reports in existence. The NTRL offers online, free and open access to these authenticated government technical reports. Technical reports and documents in its repository may be available online for free either from the issuing federal agency, the U.S. Government Publishing Office’s Federal Digital System website, or through search engines.




Details
Actions:
Download PDFDownload XML
Download

Secure, efficient data transport and replica management for high-performance data-intensive computing.


DE2001776736

Publication Date 2001
Personal Author Allcock, B.; Bester, J.; Bresnahan, J.; Chervenak, A. L.; Foster, I.; Kesselman, C.; Meder, S.; Nefedova, V.; Quesnel, D.; Tuecke, S.
Page Count 15
Abstract An emerging class of data-intensive applications involve the geographically dispersed extraction of complex scientific information from very large collections of measured or computed data. Such applications arise, for example, in experimental physics, where the data in question is generated by accelerators, and in simulation science, where the data is generated by supercomputers. So-called Data Grids provide essential infrastructure for such applications, much as the Internet provides essential services for applications such as e-mail and the Web. We describe here two services that we believe are fundamental to any Data Grid: reliable, high-speed transport and replica management. Our high-speed transport service, GridFTP, extends the popular FTP protocol with new features required for Data Grid applications, such as striping and partial file access. Our replica management service integrates a replica catalog with GridFTP transfers to provide for the creation, registration, location, and management of dataset replicas. We present the design of both services and also preliminary performance results. Our implementations exploit security and other services provided by the Globus Toolkit.
Keywords
  • Data management systems
  • Data transmission systems
  • Data base management
  • Performance
  • Memory devices
  • Security
  • Computer networks
  • Data grid services
Source Agency
  • Technical Information Center Oak Ridge Tennessee
Corporate Authors Argonne National Lab., IL.; Department of Energy, Washington, DC.
Document Type Conference Proceedings
NTIS Issue Number 200125
Contract Number
  • W-31109-ENG-38
Secure, efficient data transport and replica management for high-performance data-intensive computing.
Secure, efficient data transport and replica management for high-performance data-intensive computing.
DE2001776736

  • Data management systems
  • Data transmission systems
  • Data base management
  • Performance
  • Memory devices
  • Security
  • Computer networks
  • Data grid services
  • Technical Information Center Oak Ridge Tennessee
  • W-31109-ENG-38
Loading