SCHEDULE: NOV 10-16, 2012
When viewing the Technical Program schedule, on the far righthand side is a column labeled "PLANNER." Use this planner to build your own schedule. Once you select an event and want to add it to your personal schedule, just click on the calendar icon of your choice (outlook calendar, ical calendar or google calendar) and that event will be stored there. As you select events in this manner, you will have your own schedule to guide you through the week.
Data-Intensive Spatial Filtering in Large Numerical Simulation Datasets
SESSION: Visualization and Analysis of Massive Data Sets
EVENT TYPE: Papers
TIME: 2:00PM - 2:30PM
SESSION CHAIR: Hank Childs
AUTHOR(S):Kalin Kanov, Randal Burns, Greg Eyink, Charles Meneveau, Alexander Szalay
ROOM:355-D
ABSTRACT:
We present a query processing framework for the efficient evaluation of spatial filters on large numerical simulation datasets stored in a data-intensive cluster. Previously, filtering of large numerical simulations stored in scientific databases has been impractical owing to the immense data requirements. Rather, filtering is done during simulation or by loading snapshots into the aggregate memory of an HPC cluster. Our system performs filtering within the database and supports large filter widths. We present two complementary methods of execution: I/O streaming computes a batch filter query in a single sequential pass using incremental evaluation of decomposable kernels, summed volumes generates an intermediate data set and evaluates each filtered value by accessing only eight points in this dataset. We dynamically choose between these methods depending upon workload characteristics. The system allows us to perform filters against large data sets with little overhead: query performance scales with the clusters aggregate I/O throughput.
Chair/Author Details:
Hank Childs (Chair) - Lawrence Berkeley National Laboratory
Kalin Kanov - Johns Hopkins University
Randal Burns - Johns Hopkins University
Greg Eyink - Johns Hopkins University
Charles Meneveau - Johns Hopkins University
Alexander Szalay - Johns Hopkins University
Click here to download .ics calendar file
Click here to download .vcs calendar file
Click here to add event to your Google Calendar
Data-Intensive Spatial Filtering in Large Numerical Simulation Datasets
SESSION: Visualization and Analysis of Massive Data Sets
EVENT TYPE:
TIME: 2:00PM - 2:30PM
SESSION CHAIR: Hank Childs
AUTHOR(S):Kalin Kanov, Randal Burns, Greg Eyink, Charles Meneveau, Alexander Szalay
ROOM:355-D
ABSTRACT:
We present a query processing framework for the efficient evaluation of spatial filters on large numerical simulation datasets stored in a data-intensive cluster. Previously, filtering of large numerical simulations stored in scientific databases has been impractical owing to the immense data requirements. Rather, filtering is done during simulation or by loading snapshots into the aggregate memory of an HPC cluster. Our system performs filtering within the database and supports large filter widths. We present two complementary methods of execution: I/O streaming computes a batch filter query in a single sequential pass using incremental evaluation of decomposable kernels, summed volumes generates an intermediate data set and evaluates each filtered value by accessing only eight points in this dataset. We dynamically choose between these methods depending upon workload characteristics. The system allows us to perform filters against large data sets with little overhead: query performance scales with the clusters aggregate I/O throughput.
Chair/Author Details:
Hank Childs (Chair) - Lawrence Berkeley National Laboratory
Kalin Kanov - Johns Hopkins University
Randal Burns - Johns Hopkins University
Greg Eyink - Johns Hopkins University
Charles Meneveau - Johns Hopkins University
Alexander Szalay - Johns Hopkins University
Click here to download .ics calendar file