Skip to main content
eScholarship
Open Access Publications from the University of California

On the Scalability of Data Reduction Techniques in Current and Upcoming HPC Systems from an Application Perspective

Published Web Location

https://arxiv.org/abs/1706.00522
No data is associated with this publication.
Abstract

We implement and benchmark parallel I/O methods for the fully-manycore driven particle-in-cell code PIConGPU. Identifying throughput and overall I/O size as a major challenge for applications on today’s and future HPC systems, we present a scaling law characterizing performance bottlenecks in state-of-the-art approaches for data reduction. Consequently, we propose, implement and verify multi-threaded data-transformations for the I/O library ADIOS as a feasible way to trade underutilized host-side compute potential on heterogeneous systems for reduced I/O latency.

Item not freely available? Link broken?
Report a problem accessing this item