Tag Archives: in-memory databases

NVMRocks: RocksDB on Non-Volatile Memory Systems

By Jianhong Li (CMU), Andrew Pavlo (CMU), and Siying Dong (Facebook) Non-volatile memory (NVM) has been a game-changing memory technology. In contrast to traditional block-based durable storage devices, it provides low latency comparable to DRAM and byte-addressability. Although NVM is … Continue reading

Posted in Big Data Architecture, DBMS, ISTC for Big Data Blog, Storage | Tagged , , , , , | 2 Comments

ISTC for Big Data 2016 Research Highlights

In 2016, ISTC for Big Data principal investigators, researchers and their students continued to break down the barriers to data analytics at scale, with creative new approaches and infrastructure software. Developments are being integrated into BigDAWG, the next-generation polystore architecture … Continue reading

Posted in Big Data Architecture, Data Management, ISTC for Big Data Blog, Polystores | Tagged , , , , , , , , , , , | Leave a comment

Write-Behind Logging

By Joy Arulraj, Matthew Perron, and Andrew Pavlo, Carnegie Mellon University In a joint collaboration between Carnegie Mellon University and Intel Labs, we explore the changes required in the logging and recovery algorithms in non-volatile memory database management systems (DBMSs). The results of this work … Continue reading

Posted in Big Data Architecture, Data Management, DBMS, ISTC for Big Data Blog, Math and Algorithms, Storage | Tagged , , , , , , , | Leave a comment

Larger-than-Memory Data Management on Modern Storage Hardware for In-Memory OLTP Database Systems

By Lin Ma, Carnegie Mellon University; Joy Arulraj, Carnegie Mellon University; Sam Zhao, Brown University; Andrew Pavlo, Carnegie Mellon University; Subramanya R. Dulloor, Intel Labs; Michael J. Giardino, Georgia Institute of Technology; Jeff Parkhurst, Jason L. Gardner, Kshitij Doshi, Intel Labs; and Col. Stanley Zdonik, Brown … Continue reading

Posted in Big Data Architecture, Data Management, DBMS, ISTC for Big Data Blog, Storage | Tagged , , , , , | Leave a comment

2015: Momentum, Moments and Memories

Greetings of the season from the Intel Science and Technology Center for Big Data.  As 2015 comes to a close, we thought we would share some moments and memories that were captured here in the ISTC for Big Data blog … Continue reading

Posted in Analytics, Big Data Applications, Big Data Architecture, Data Management, Databases and Analytics, DBMS, High-Performance Computing, ISTC for Big Data Blog, Storage, Streaming Big Data, Visualizing Big Data | Tagged , , , , , , , , , , , , , , , , , , , | Leave a comment

Let’s Talk About Storage & Recovery Methods for Non-Volatile Memory Database Systems

By Joy Arulraj and Andrew Pavlo, Carnegie Mellon; and Subramanya Dulloor, Intel Labs In a joint collaboration between Carnegie Mellon University and Intel Labs, we explore the changes required in future database management systems to fully leverage the unique set of characteristics of non-volatile memory (NVM) technologies. … Continue reading

Posted in Big Data Architecture, Data Management, DBMS, ISTC for Big Data Blog, Storage, Streaming Big Data | Tagged , , , , , , | Leave a comment

Memory Wall? What Memory Wall?

by Holger Pirk, MIT CSAIL* Background With current RAM prices at less than $10K for a Terabyte, in-memory data management is viable, even for “big” data – especially for big data. Given enough Variety and Veracity, however, analyzing a Terabyte of “big” data … Continue reading

Posted in Big Data Architecture, Computer Architecture, Data Management, DBMS, ISTC for Big Data Blog, Storage | Tagged , , , | Leave a comment

Optimizing Transaction Processing for In-Memory Databases on Large Multicore Machines

By Stephen Tu, MIT CSAIL When people think of “big data” storage systems, they generally think of huge clusters with hundreds of machines working together to serve a large distributed datastore. To this end, lots of people in both academia … Continue reading

Posted in Big Data Architecture, Databases and Analytics, DBMS, ISTC for Big Data Blog | Tagged , , , , | Leave a comment