Interactive Search and Exploration over Large Multidimensional Data

by Alexander Kalinin, Ugur Cetintemel and Stan Zdonik of Brown University In the Big Data era, professionals across scientific areas need efficient, interactive ad-hoc data analysis. Ideally, they need generic and reusable systems tools for interactive search, exploration and mining … Continue reading

Posted in Analytics, Big Data Applications, Data Management, Databases and Analytics, DBMS, ISTC for Big Data Blog | Tagged , , , , , | Leave a comment

Genomics Data, Analytics and the Future of Climate Change

By Vijay Gadepally, MIT CSAIL, in collaboration with the Chisholm Laboratory at MIT Meet Prochlorococcus marinus, a marine cyanobacterium that’s intricately linked to the global carbon cycle, widely present in seawater, and possibly holds secrets to future climate change. These … Continue reading

Posted in Big Data Applications, Big Data Architecture, Data Management, Databases and Analytics, DBMS, Graph Computation, ISTC for Big Data Blog, Polystores, Streaming Big Data, Tools for Big Data, Visualizing Big Data | Tagged , , , , , , , , | Leave a comment

Rethinking Streaming: Correct State Matters!

by Nesime Tatbul, Intel Labs and MIT CSAIL; Kristin Tufte, Portland State University; and Stan Zdonik, Brown University Stream processing has largely been thought of as real-time analytics. Data enters the system as streams and analytic functions (aggregates) are computed on the … Continue reading

Posted in Big Data Applications, DBMS, ISTC for Big Data Blog, Streaming Big Data | Tagged , , , , , , , , , | Leave a comment

Larger-than-Memory Data Management on Modern Storage Hardware for In-Memory OLTP Database Systems

By Lin Ma, Carnegie Mellon University; Joy Arulraj, Carnegie Mellon University; Sam Zhao, Brown University; Andrew Pavlo, Carnegie Mellon University; Subramanya R. Dulloor, Intel Labs; Michael J. Giardino, Georgia Institute of Technology; Jeff Parkhurst, Jason L. Gardner, Kshitij Doshi, Intel Labs; and Col. Stanley Zdonik, Brown … Continue reading

Posted in Big Data Architecture, Data Management, DBMS, ISTC for Big Data Blog, Storage | Tagged , , , , , | Leave a comment

TicToc: Time Traveling Optimistic Concurrency Control

By Xiangyao Yu, MIT CSAIL; Andrew Pavlo, Carnegie Mellon; Daniel Sanchez and Srinivas Devadas, MIT CSAIL The TicToc algorithm enables scalable and high-performing concurrency control for future multi- and many-core systems. Large-scale, highly parallel transaction processing systems can be built with TicToc. We … Continue reading

Posted in Big Data Architecture, Data Management, DBMS, ISTC for Big Data Blog, Math and Algorithms | Tagged , , , , | Leave a comment

TileDB and GenomicsDB Now Available in Open Source

by Stavros Papadopoulos, Intel Parallel Computing Lab The ISTC for Big Data has recently released TileDB, a novel efficient data management system for scientific data, such as graphs, DNA sequences, matrices, maps, and imaging. We have also released an adaptation of TileDB … Continue reading

Posted in Big Data Applications, Data Management, DBMS, High-Performance Computing, ISTC for Big Data Blog | Tagged , , , , , , , | Leave a comment

Just-in-time Data Transformation and Migration in Polystores

by Aaron Elmore and Adam Dziedzic, University of Chicago Organizations face managing and deriving value from an ever-growing amount of data. Beyond its size, this data is often varied in both structure (e.g., relational data, linked data, numerical data and streaming data) … Continue reading

Posted in Analytics, Big Data Architecture, Data Management, Databases and Analytics, DBMS, Graph Computation, ISTC for Big Data Blog, Polystores, Query Engines, Streaming Big Data | Tagged , , , , , , , , , | Leave a comment

ISTC for Big Data Researchers Present at NEDB Day 2016

ISTC for Big Data principal investigators and researchers presented a broad base of research at North East Database Day 2016, which was sponsored by Microsoft and held at MIT’s Stata Center in Cambridge, Mass., January 28, 2016. The 8th Annual North … Continue reading

Posted in Analytics, Big Data Applications, Big Data Architecture, DBMS, ISTC for Big Data Blog, Polystores, Query Engines, Streaming Big Data, Tools for Big Data, Visualizing Big Data | Tagged , , , , , , , , , | Leave a comment

The End of Slow Networks: It’s Time for a Redesign

by Tim Kraska and Carsten Binnig, Brown University Data Management Research Group The next generation of high-performance RDMA-capable networks requires a fundamental rethinking of the design of modern distributed database systems (DDBMS). Current distributed databases are commonly designed under the … Continue reading

Posted in Big Data Architecture, Computer Architecture, Data Management, DBMS, ISTC for Big Data Blog | Tagged , , , , , | Leave a comment

Michael Stonebraker On Six Weeks of Turing Award Travels

ISTC for Big Data co-founder and MIT CSAIL professor Michael Stonebraker received the Association for Computing Machinery’s 2014 A.M. Turing Award for his contributions to the field of database management systems (DBMSs), including creating multiple successful database companies to commercialize … Continue reading

Posted in DBMS, ISTC for Big Data Blog | Tagged , , | Leave a comment