Loughborough University
Leicestershire, UK
LE11 3TU
+44 (0)1509 263171
Loughborough University

Loughborough University Institutional Repository

Please use this identifier to cite or link to this item: https://dspace.lboro.ac.uk/2134/28397

Title: Deduplication potential of HPC applications' checkpoints
Authors: Kaiser, Jurgen
Gad, Ramy
Suss, Tim
Padua, Federico
Nagel, Lars
Brinkmann, Andre
Issue Date: 2016
Publisher: © Institute of Electrical and Electronics Engineers (IEEE)
Citation: KAISER, J., ... et al., 2016. Deduplication potential of HPC applications' checkpoints. Presented at the 2016 IEEE International Conference on Cluster Computing (CLUSTER), Taipei, Taiwan, 12-16th Sept, pp. 413-422.
Abstract: © 2016 IEEE. HPC systems contain an increasing number of components, decreasing the mean time between failures. Checkpoint mechanisms help to overcome such failures for long-running applications. A viable solution to remove the resulting pressure from the I/O backends is to deduplicate the checkpoints. However, there is little knowledge about the potential to save I/Os for HPC applications by using deduplication within the checkpointing process. In this paper, we perform a broad study about the deduplication behavior of HPC application checkpointing and its impact on system design.
Description: Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Sponsor: This work was partially supported by the German Ministry for Education and Research (BMBF) under project grant 01IH13004 (Project FAST) and the Intel Parallel Computing Centers (IPCC) project.
Version: Accepted for publication
DOI: 10.1109/CLUSTER.2016.32
URI: https://dspace.lboro.ac.uk/2134/28397
Publisher Link: https://doi.org/10.1109/CLUSTER.2016.32
ISBN: 9781509036530
ISSN: 1552-5244
Appears in Collections:Conference Papers and Presentations (Computer Science)

Files associated with this item:

File Description SizeFormat
Nagel_DeduplicationPotentialOfHPCApplicationsCheckpoints.pdfAccepted version311.61 kBAdobe PDFView/Open

 

SFX Query

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.