Using semantic information to guide efficient parallel I/O on clusters
Proceedings 11th IEEE International Symposium on High Performance Distributed Computing - Trang 135-142
Tóm tắt
Despite the large I/O capabilities in modern cluster architectures with local disks on each node, applications mostly are not enabled to fully exploit them. This is especially problematic for data intensive applications which often suffer from low I/O performance. As one solution for this problem, a distribution I/O management (DIOM) system has been developed to manage a transparent distribution of data across cluster nodes and to then allow applications to access this data purely from local disks. In order to be effective, however, this distribution process requires semantic information about both the application and the input data. This work therefore extends DIOM to include independent specifications for both data formats and application I/O patterns and thereby decouples them. This work is driven by an application from nuclear medical imaging, the reconstruction of PET images, for which DIOM has proven to be an adequate solution enabling truly scalable I/O and thereby improving the overall application performance.
Từ khóa
#Positron emission tomography #Image reconstruction #Biomedical imaging #Image storage #Middleware #Biomedical image processing #Resource management #Personal communication networks #Operating systems #DetectorsTài liệu tham khảo
1999, An Overview of the Parallel Virtual File System, Proc Extreme Linux Workshop
inc, 0, XFS: A next generation journalled 64-bit filesystem with guaranteed rate I/O, White Paper
leahy, 2000, Recent developments in iterative image reconstruction for PET and SPECT, IEEE Transactions on Nuclear Sciences, 19, 257
1997, Message Passing Interface Forum (MPIF), MPI-2 Extensions to the Message-Passing Interface Technical Report University of Tennessee Knoxville
10.1007/978-3-0348-8534-8_25
nieuwejaar, 1996, Galley: A New Parallel File System For Scientific Workloads, Also available as Technical Report PCS-TR96–300
rullman, 0, An efficient file I/O interface for parallel applications, Draft presented at the Workshop on Scalable I/O Frontiers 1995
schulz, 2001, DIOM: Parallel I/O for Data Intensive Applications on Commodity Clusters, Proceedings of the International Conference on Parallel and Distributed Computing and Systems (PDCS), 623
10.1145/233557.233558
10.1145/266220.266221
10.1016/0167-8191(96)00024-5
folk, 1998, A White Paper: HDF as an Archive Format: Issues and Recommendations, Technical Report
10.1145/224538.224638
hermann, 1998, Nuklearmedizin
chang, 1997, HDF Support For Network Of Workstations Technical report
beguelin, 1991, A User's Guide to PVM Parallel Virtual Machine, 37831
hudson, 1994, Accelerated image reconstruction using ordered subsets of projection data, IEEE Transactions on Medical Imaging, 13, 601, 10.1109/42.363108