Solving the “One Concurrency Control Does Not Fit All” Problem for OLTP Databases

By Dixin Tang and Aaron J. Elmore, University of Chicago In this post, we present a new transactional database system that adaptively changes data organization and concurrency control protocols in response to workload changes. With the increasing memory sizes of … Continue reading

Posted in Big Data Architecture, Data Management, DBMS, ISTC for Big Data Blog | Tagged , , , , , | Leave a comment

Improving Clinical Decision-Making with Big Data

An Interview with Peter Szolovits, MIT CSAIL Doctors, nurses and other healthcare professionals have always had to “read” and respond quickly to often-imperfect data under stressful circumstances. What has changed over time is the volume and types of data that … Continue reading

Posted in Big Data Applications, ISTC for Big Data Blog | Tagged , , , , , , | Leave a comment

ISTC Releases Open Source Code for BigDAWG Polystore System

By Dr. Tim Mattson, Intel and Dr. Vijay Gadepally and Kyle O’Brien, MIT Lincoln Laboratory Today, the ISTC for Big Data released the first version of BigDAWG, our polystore system for simplifying integration and analytics of disparate data at scale. BigDAWG is … Continue reading

Posted in Analytics, Big Data Architecture, Data Management, Databases and Analytics, DBMS, ISTC for Big Data Blog, Polystores, Query Engines, Storage | Tagged , , , , , , , , | Leave a comment

ISTC Researchers Present Work at NEDB Day 2017

ISTC for Big Data principal investigators, researchers and their students presented work at North East Database Day 2017, held at MIT’s Stata Center in Cambridge, Mass., on January 27, 2017. Microsoft and Facebook sponsored the event. The 9th Annual North East … Continue reading

Posted in Big Data Architecture, Data Management, Databases and Analytics, DBMS, ISTC for Big Data Blog, Storage, Streaming Big Data, Visualizing Big Data | Tagged , , , , , , , , , , | Leave a comment

NVMRocks: RocksDB on Non-Volatile Memory Systems

By Jianhong Li (CMU), Andrew Pavlo (CMU), and Siying Dong (Facebook) Non-volatile memory (NVM) has been a game-changing memory technology. In contrast to traditional block-based durable storage devices, it provides low latency comparable to DRAM and byte-addressability. Although NVM is … Continue reading

Posted in Big Data Architecture, DBMS, ISTC for Big Data Blog, Storage | Tagged , , , , , | 2 Comments

Supercharging Big Data Research with New England’s Fastest Supercomputer

An Interview with Jeremy Kepner of MIT Lincoln Laboratory MIT recently announced that the MIT Lincoln Laboratory Supercomputing Center (LLSC) system, housed in Holyoke, Massachusetts, has been ranked the most powerful supercomputer in New England. We caught up with ISTC … Continue reading

Posted in Big Data Architecture, Computer Architecture, High-Performance Computing, ISTC for Big Data Blog, Polystores | Tagged , , , , | Leave a comment

ISTC for Big Data 2016 Research Highlights

In 2016, ISTC for Big Data principal investigators, researchers and their students continued to break down the barriers to data analytics at scale, with creative new approaches and infrastructure software. Developments are being integrated into BigDAWG, the next-generation polystore architecture … Continue reading

Posted in Big Data Architecture, Data Management, ISTC for Big Data Blog, Polystores | Tagged , , , , , , , , , , , | Leave a comment

Write-Behind Logging

By Joy Arulraj, Matthew Perron, and Andrew Pavlo, Carnegie Mellon University In a joint collaboration between Carnegie Mellon University and Intel Labs, we explore the changes required in the logging and recovery algorithms in non-volatile memory database management systems (DBMSs). The results of this work … Continue reading

Posted in Big Data Architecture, Data Management, DBMS, ISTC for Big Data Blog, Math and Algorithms, Storage | Tagged , , , , , , , | Leave a comment

Polystore Databases to be Examined at IEEE, CIDR Conferences

Polystores, a more-modern approach to sharing heterogeneous data that addresses Big Data’s volume, variety and velocity demands, will be the topic of discussion at two upcoming conferences: The first IEEE Workshop on Methods to Manage Heterogeneous Big Data and Polystore Databases, … Continue reading

Posted in Big Data Applications, Big Data Architecture, Data Management, ISTC for Big Data Blog, Polystores, Tools for Big Data | Tagged , , , , , | Leave a comment

PipeGen: A Data Pipe Generator for Hybrid Analytics

By Brandon Haynes, Alvin Cheung, and Magdalena Balazinska, University of Washington As the number of big data management systems continues to grow, users increasingly seek to leverage multiple systems in the context of a single data analysis task. A critical challenge … Continue reading

Posted in Big Data Applications, Big Data Architecture, Data Management, ISTC for Big Data Blog, Polystores | Tagged , , , , , | Leave a comment