SC12 Home > SC12 Schedule > SC12 Presentation - Scalable Cooperative Caching with RDMA-Based Directory Management for Large-Scale Data Processing

SCHEDULE: NOV 10-16, 2012

When viewing the Technical Program schedule, on the far righthand side is a column labeled "PLANNER." Use this planner to build your own schedule. Once you select an event and want to add it to your personal schedule, just click on the calendar icon of your choice (outlook calendar, ical calendar or google calendar) and that event will be stored there. As you select events in this manner, you will have your own schedule to guide you through the week.

Scalable Cooperative Caching with RDMA-Based Directory Management for Large-Scale Data Processing

SESSION: ACM Student Research Competition Poster Session

EVENT TYPE: ACM Student Research Competition

TIME: 5:15PM - 7:00PM

SESSION CHAIR: Torsten Hoefler

AUTHOR(S):Junya Arai

ROOM:East Entrance

ABSTRACT:
Cooperative caching provides an extensive virtual file cache by combining file caches on all clients. We propose a novel cooperative caching system that addresses two problems of existing systems: lack of utilization of high-throughput, low-latency remote direct memory access (RDMA) and low scalability against concentrated request for a particular cache block. The proposed system uses only RDMA to look up a block location in cache directories distributed to servers and transfer a block from another node, reducing access times to a cache block. In addition, to provide more robust scalability, nodes are divided into groups and managed semi-independently, so that access concentration on a particular node is mitigated. We are going to run over 10,000 processes on the K computer for evaluation and present experimental results on the poster. To our knowledge, this will be the first study that investigates performance of cooperative caching with over 1,000 processes.

Chair/Author Details:

Torsten Hoefler (Chair) - ETH Zurich

Junya Arai - University of Tokyo

Add to iCal  Click here to download .ics calendar file

Add to Outlook  Click here to download .vcs calendar file

Add to Google Calendarss  Click here to add event to your Google Calendar