SC12 Home > SC12 Schedule > SC12 Presentation - Memory-Conscious Collective IO for Extreme-Scale HPC Systems

SCHEDULE: NOV 10-16, 2012

When viewing the Technical Program schedule, on the far righthand side is a column labeled "PLANNER." Use this planner to build your own schedule. Once you select an event and want to add it to your personal schedule, just click on the calendar icon of your choice (outlook calendar, ical calendar or google calendar) and that event will be stored there. As you select events in this manner, you will have your own schedule to guide you through the week.

Memory-Conscious Collective IO for Extreme-Scale HPC Systems

SESSION: Research Poster Reception

EVENT TYPE: Posters and Electronic Posters

TIME: 5:15PM - 7:00PM

SESSION CHAIR: Torsten Hoefler

AUTHOR(S):Yin Lu, Yong Chen, Rajeev Thakur, Yu Zhuang

ROOM:East Entrance

ABSTRACT:
The continuing decrease in memory capacity per core and the increasing disparity between core count and off-chip memory bandwidth create significant challenges for I/O operations in exascale systems. The exascale challenges require rethinking collective I/O for the effective exploitation of the correlation among I/O accesses in the exascale system. In this study, considering the major constraint of the memory space, we introduce a Memory-Conscious collective I/O. Given the importance of I/O aggregator in improving the performance of collective I/O, the new collective I/O strategy restricts aggregation data traffic within disjointed subgroups, coordinates I/O accesses in intra-node and inter-node layer and determines I/O aggregators at run time considering data distribution and memory consumption among processes. The preliminary results have demonstrated that the new collective I/O strategy holds promise in substantially reducing the amount of memory pressure, alleviating contention for memory bandwidth and improving the I/O performance for extreme-scale systems.

Chair/Author Details:

Torsten Hoefler (Chair) - ETH Zurich

Yin Lu - Texas Tech University

Yong Chen - Texas Tech University

Rajeev Thakur - Argonne National Laboratory

Yu Zhuang - Texas Tech University

Add to iCal  Click here to download .ics calendar file

Add to Outlook  Click here to download .vcs calendar file

Add to Google Calendarss  Click here to add event to your Google Calendar

Memory-Conscious Collective IO for Extreme-Scale HPC Systems

SESSION: Research Poster Reception

EVENT TYPE:

TIME: 5:15PM - 7:00PM

SESSION CHAIR: Torsten Hoefler

AUTHOR(S):Yin Lu, Yong Chen, Rajeev Thakur, Yu Zhuang

ROOM:East Entrance

ABSTRACT:
The continuing decrease in memory capacity per core and the increasing disparity between core count and off-chip memory bandwidth create significant challenges for I/O operations in exascale systems. The exascale challenges require rethinking collective I/O for the effective exploitation of the correlation among I/O accesses in the exascale system. In this study, considering the major constraint of the memory space, we introduce a Memory-Conscious collective I/O. Given the importance of I/O aggregator in improving the performance of collective I/O, the new collective I/O strategy restricts aggregation data traffic within disjointed subgroups, coordinates I/O accesses in intra-node and inter-node layer and determines I/O aggregators at run time considering data distribution and memory consumption among processes. The preliminary results have demonstrated that the new collective I/O strategy holds promise in substantially reducing the amount of memory pressure, alleviating contention for memory bandwidth and improving the I/O performance for extreme-scale systems.

Chair/Author Details:

Torsten Hoefler (Chair) - ETH Zurich

Yin Lu - Texas Tech University

Yong Chen - Texas Tech University

Rajeev Thakur - Argonne National Laboratory

Yu Zhuang - Texas Tech University

Add to iCal  Click here to download .ics calendar file

Add to Outlook  Click here to download .vcs calendar file

Add to Google Calendarss  Click here to add event to your Google Calendar