SC12 Home > SC12 Schedule > SC12 Presentation - Parallel IO, Analysis, and Visualization of a Trillion Particle Simulation

SCHEDULE: NOV 10-16, 2012

When viewing the Technical Program schedule, on the far righthand side is a column labeled "PLANNER." Use this planner to build your own schedule. Once you select an event and want to add it to your personal schedule, just click on the calendar icon of your choice (outlook calendar, ical calendar or google calendar) and that event will be stored there. As you select events in this manner, you will have your own schedule to guide you through the week.

ENTIRE WEEK SATURDAY SUNDAY MONDAY TUESDAY WEDNESDAY THURSDAY FRIDAY

Parallel IO, Analysis, and Visualization of a Trillion Particle Simulation

SESSION: Visualization and Analysis of Massive Data Sets

EVENT TYPE: Papers

TIME: 1:30PM - 2:00PM

SESSION CHAIR: Hank Childs

AUTHOR(S):Surendra Byna, Jerry Chou, Oliver Ruebel, Mr Prabhat, Homa Karimabadi, William Daughton, Vadim Roytershteyn, Wes Bethel, Mark Howison, Ke-Jou Hsu, Kuan-Wu Lin, Arie Shoshani, Andrew Uselton, Kesheng Wu

ROOM:355-D

ABSTRACT:
Petascale plasma physics simulations have recently entered the regime of simulating trillions of particles. These unprecedented simulations generate massive amounts of data, posing significant challenges in storage, analysis, and visualization. In this paper, we present parallel I/O, analysis, and visualization results from a VPIC trillion particle simulation running on 120,000 cores, which produces ~30TB of data for a single timestep. We demonstrate the successful application of H5Part, a particle data extension of parallel HDF5, for writing the dataset at a significant fraction of system peak I/O rates. To enable efficient analysis, we develop hybrid parallel FastQuery to index and query data using multi-core CPUs on distributed memory hardware. We show good scalability results for the FastQuery implementation using up to 10,000 cores. Finally, we apply this indexing/query-driven approach to facilitate the first-ever analysis and visualization of the trillion-particle dataset.

Chair/Author Details:

Hank Childs (Chair) - Lawrence Berkeley National Laboratory

Surendra Byna - Lawrence Berkeley National Laboratory

Jerry Chou - Tsinghua University

Oliver Ruebel - Lawrence Berkeley National Laboratory

Mr Prabhat - Lawrence Berkeley National Laboratory

Homa Karimabadi - University of California, San Diego

William Daughton - Los Alamos National Laboratory

Vadim Roytershteyn - University of California, San Diego

Wes Bethel - Lawrence Berkeley National Laboratory

Mark Howison - Brown University

Ke-Jou Hsu - Tsinghua University