SC12 Home > SC12 Schedule > SC12 Presentation - Auto-Tuning of Parallel IO Parameters for HDF5 Applications

SCHEDULE: NOV 10-16, 2012

When viewing the Technical Program schedule, on the far righthand side is a column labeled "PLANNER." Use this planner to build your own schedule. Once you select an event and want to add it to your personal schedule, just click on the calendar icon of your choice (outlook calendar, ical calendar or google calendar) and that event will be stored there. As you select events in this manner, you will have your own schedule to guide you through the week.

Auto-Tuning of Parallel IO Parameters for HDF5 Applications

SESSION: Research Poster Reception

EVENT TYPE: Posters and Electronic Posters

TIME: 5:15PM - 7:00PM

SESSION CHAIR: Torsten Hoefler

AUTHOR(S):Babak Behzad, Joey Huchette, Huong Luu, Ruth Aydt, Quincey Koziol, Mr Prabhat, Suren Byna, Mohamad Chaarawi, Yushu Yao

ROOM:East Entrance

ABSTRACT:
I/O is often a limiting factor for HPC applications. Although well-tuned codes have shown good I/O throughput compared to the theoretical maximum, the majority of applications use default parallel I/O parameter values and achieve poor performance. We have built an extensible framework for benchmark-guided auto-tuning of HDF5, MPI-IO, and Lustre parameters. The framework includes three main components. H5AutoTuner uses a control file to adjust I/O parameters without changing or recompiling the application. H5PerfCapture records performance metrics for HDF5 and MPI-IO. H5Evolve uses genetic algorithms to explore the parameter search space until well-performing values are identified. Early results for three HDF5 application-based I/O benchmarks on two different HPC systems have shown 1.3x6.8x speedup using auto-tuned parameters compared to default values. Our auto-tuning framework can improve I/O performance without hands-on optimization and also provides a general platform for exploring parallel I/O behavior. The printed poster details framework architecture and experimental results.

Chair/Author Details:

Torsten Hoefler (Chair) - ETH Zurich

Babak Behzad - University of Illinois at Urbana-Champaign

Joey Huchette - Lawrence Berkeley National Laboratory

Huong Luu - University of Illinois at Urbana-Champaign

Ruth Aydt - HDF Group

Quincey Koziol - HDF Group

Mr Prabhat - Lawrence Berkeley National Laboratory

Suren Byna - Lawrence Berkeley National Laboratory

Mohamad Chaarawi - HDF Group

Yushu Yao - Lawrence Berkeley National Laboratory

Add to iCal  Click here to download .ics calendar file

Add to Outlook  Click here to download .vcs calendar file

Add to Google Calendarss  Click here to add event to your Google Calendar

Auto-Tuning of Parallel IO Parameters for HDF5 Applications

SESSION: Research Poster Reception

EVENT TYPE:

TIME: 5:15PM - 7:00PM

SESSION CHAIR: Torsten Hoefler

AUTHOR(S):Babak Behzad, Joey Huchette, Huong Luu, Ruth Aydt, Quincey Koziol, Mr Prabhat, Suren Byna, Mohamad Chaarawi, Yushu Yao

ROOM:East Entrance

ABSTRACT:
I/O is often a limiting factor for HPC applications. Although well-tuned codes have shown good I/O throughput compared to the theoretical maximum, the majority of applications use default parallel I/O parameter values and achieve poor performance. We have built an extensible framework for benchmark-guided auto-tuning of HDF5, MPI-IO, and Lustre parameters. The framework includes three main components. H5AutoTuner uses a control file to adjust I/O parameters without changing or recompiling the application. H5PerfCapture records performance metrics for HDF5 and MPI-IO. H5Evolve uses genetic algorithms to explore the parameter search space until well-performing values are identified. Early results for three HDF5 application-based I/O benchmarks on two different HPC systems have shown 1.3x6.8x speedup using auto-tuned parameters compared to default values. Our auto-tuning framework can improve I/O performance without hands-on optimization and also provides a general platform for exploring parallel I/O behavior. The printed poster details framework architecture and experimental results.

Chair/Author Details:

Torsten Hoefler (Chair) - ETH Zurich

Babak Behzad - University of Illinois at Urbana-Champaign

Joey Huchette - Lawrence Berkeley National Laboratory

Huong Luu - University of Illinois at Urbana-Champaign

Ruth Aydt - HDF Group

Quincey Koziol - HDF Group

Mr Prabhat - Lawrence Berkeley National Laboratory

Suren Byna - Lawrence Berkeley National Laboratory

Mohamad Chaarawi - HDF Group

Yushu Yao - Lawrence Berkeley National Laboratory

Add to iCal  Click here to download .ics calendar file

Add to Outlook  Click here to download .vcs calendar file

Add to Google Calendarss  Click here to add event to your Google Calendar