The Big Data ISTC: A Retrospection by Michael Stonebraker, Samuel Madden and Timothy Mattson

The Big Data ISTC is a research project sponsored by Intel that ran for five years (August 2012- August 2017).  This blog post highlights some of the accomplishments and lessons learned during this period. Big data is usually categorized into … Continue reading

Posted in Analytics, Benchmarks, Big Data Applications, Big Data Architecture, Data Management, Databases and Analytics, DBMS, ISTC for Big Data Blog, Polystores, Query Engines, Storage, Streaming Big Data, Tools for Big Data, Visualizing Big Data | Tagged , , , , , , , , , , , , , , , , , , , , , , | Leave a comment

ISTC Researchers to Present Papers at VLDB 2017 Conference

ISTC for Big Data principal Investigators, researchers, and their students will present a number of papers at the 2017 International Conference on Very Large Databases (VLDB 2017) in Munich, Germany, August 28-September 1, 2017.  (To read any of the papers, … Continue reading

Posted in Analytics, Big Data Architecture, Data Management, Databases and Analytics, DBMS, ISTC for Big Data Blog, Visualizing Big Data | Tagged , , , , , , , , , , , , , | Leave a comment

ISTC Releases Open Source Code for BigDAWG Polystore System

By Dr. Tim Mattson, Intel and Dr. Vijay Gadepally and Kyle O’Brien, MIT Lincoln Laboratory Today, the ISTC for Big Data released the first version of BigDAWG, our polystore system for simplifying integration and analytics of disparate data at scale. BigDAWG is … Continue reading

Posted in Analytics, Big Data Architecture, Data Management, Databases and Analytics, DBMS, ISTC for Big Data Blog, Polystores, Query Engines, Storage | Tagged , , , , , , , , | Leave a comment

Interactive Search and Exploration over Large Multidimensional Data

by Alexander Kalinin, Ugur Cetintemel and Stan Zdonik of Brown University In the Big Data era, professionals across scientific areas need efficient, interactive ad-hoc data analysis. Ideally, they need generic and reusable systems tools for interactive search, exploration and mining … Continue reading

Posted in Analytics, Big Data Applications, Data Management, Databases and Analytics, DBMS, ISTC for Big Data Blog | Tagged , , , , , | Leave a comment

Analytic Monitoring for the Internet of Things

By Peter Bailis, Stanford Infolab, and Sam Madden, MIT CSAIL An increasing proportion of data today is generated by automated processes, sensors and devices—collectively called the Internet of Things (IoT).   Inexpensive hardware, widespread access to communication networks, and decreased … Continue reading

Posted in Analytics, Big Data Applications, Big Data Architecture, Databases and Analytics, ISTC for Big Data Blog, Streaming Big Data | Tagged , , , | Leave a comment

Urban Analytics for Smart Cities: Connecting Data to People

By Kristin Tufte, Portland State University “A Smart City is one where data and technology improve people’s lives.¹” Governments, NGOs and academic researchers are looking to data and analytics to create more livable cities. Ideas and innovation are flowering. The … Continue reading

Posted in Analytics, Big Data Applications, ISTC for Big Data Blog | Tagged , , , , , , | Leave a comment

ForeCache: Raising the Bar in Big Data Visual Exploration

By Leilani Battle, MIT CSAIL In many discussions with scientists across a variety of specialties, we have found that interactive visualizations are important tools for helping people make sense of massive amounts of data. In particular, interactive visualizations are critical … Continue reading

Posted in Analytics, Big Data Applications, ISTC for Big Data Blog, Tools for Big Data, Visualizing Big Data | Tagged , , , , , , | Leave a comment

Guaranteeing Query Runtimes for Analytics-as-a-Service

By Jennifer Ortiz and Magdalena Balazinska, University of Washington A variety of data analytics systems are available as cloud services today, including Amazon Elastic MapReduce (EMR), Redshift and Azure’s HDInsight. With these services, users have access to compute clusters that come … Continue reading

Posted in Analytics, Data Management, ISTC for Big Data Blog, Tools for Big Data | Tagged , , , , , | Leave a comment

Just-in-time Data Transformation and Migration in Polystores

by Aaron Elmore and Adam Dziedzic, University of Chicago Organizations face managing and deriving value from an ever-growing amount of data. Beyond its size, this data is often varied in both structure (e.g., relational data, linked data, numerical data and streaming data) … Continue reading

Posted in Analytics, Big Data Architecture, Data Management, Databases and Analytics, DBMS, Graph Computation, ISTC for Big Data Blog, Polystores, Query Engines, Streaming Big Data | Tagged , , , , , , , , , | Leave a comment

ISTC for Big Data Researchers Present at NEDB Day 2016

ISTC for Big Data principal investigators and researchers presented a broad base of research at North East Database Day 2016, which was sponsored by Microsoft and held at MIT’s Stata Center in Cambridge, Mass., January 28, 2016. The 8th Annual North … Continue reading

Posted in Analytics, Big Data Applications, Big Data Architecture, DBMS, ISTC for Big Data Blog, Polystores, Query Engines, Streaming Big Data, Tools for Big Data, Visualizing Big Data | Tagged , , , , , , , , , | Leave a comment