Improving Clinical Decision-Making with Big Data

An Interview with Peter Szolovits, MIT CSAIL Doctors, nurses and other healthcare professionals have always had to “read” and respond quickly to often-imperfect data under stressful circumstances. What has changed over time is the volume and types of data that … Continue reading

Posted in Big Data Applications, ISTC for Big Data Blog | Tagged , , , , , , | Leave a comment

Polystore Databases to be Examined at IEEE, CIDR Conferences

Polystores, a more-modern approach to sharing heterogeneous data that addresses Big Data’s volume, variety and velocity demands, will be the topic of discussion at two upcoming conferences: The first IEEE Workshop on Methods to Manage Heterogeneous Big Data and Polystore Databases, … Continue reading

Posted in Big Data Applications, Big Data Architecture, Data Management, ISTC for Big Data Blog, Polystores, Tools for Big Data | Tagged , , , , , | Leave a comment

PipeGen: A Data Pipe Generator for Hybrid Analytics

By Brandon Haynes, Alvin Cheung, and Magdalena Balazinska, University of Washington As the number of big data management systems continues to grow, users increasingly seek to leverage multiple systems in the context of a single data analysis task. A critical challenge … Continue reading

Posted in Big Data Applications, Big Data Architecture, Data Management, ISTC for Big Data Blog, Polystores | Tagged , , , , , | Leave a comment

Interactive Search and Exploration over Large Multidimensional Data

by Alexander Kalinin, Ugur Cetintemel and Stan Zdonik of Brown University In the Big Data era, professionals across scientific areas need efficient, interactive ad-hoc data analysis. Ideally, they need generic and reusable systems tools for interactive search, exploration and mining … Continue reading

Posted in Analytics, Big Data Applications, Data Management, Databases and Analytics, DBMS, ISTC for Big Data Blog | Tagged , , , , , | Leave a comment

Analytic Monitoring for the Internet of Things

By Peter Bailis, Stanford Infolab, and Sam Madden, MIT CSAIL An increasing proportion of data today is generated by automated processes, sensors and devices—collectively called the Internet of Things (IoT).   Inexpensive hardware, widespread access to communication networks, and decreased … Continue reading

Posted in Analytics, Big Data Applications, Big Data Architecture, Databases and Analytics, ISTC for Big Data Blog, Streaming Big Data | Tagged , , , | Leave a comment

Genomics Data, Analytics and the Future of Climate Change

By Vijay Gadepally, MIT CSAIL, in collaboration with the Chisholm Laboratory at MIT Meet Prochlorococcus marinus, a marine cyanobacterium that’s intricately linked to the global carbon cycle, widely present in seawater, and possibly holds secrets to future climate change. These … Continue reading

Posted in Big Data Applications, Big Data Architecture, Data Management, Databases and Analytics, DBMS, Graph Computation, ISTC for Big Data Blog, Polystores, Streaming Big Data, Tools for Big Data, Visualizing Big Data | Tagged , , , , , , , , | Leave a comment

Urban Analytics for Smart Cities: Connecting Data to People

By Kristin Tufte, Portland State University “A Smart City is one where data and technology improve people’s lives.¹” Governments, NGOs and academic researchers are looking to data and analytics to create more livable cities. Ideas and innovation are flowering. The … Continue reading

Posted in Analytics, Big Data Applications, ISTC for Big Data Blog | Tagged , , , , , , | Leave a comment

Rethinking Streaming: Correct State Matters!

by Nesime Tatbul, Intel Labs and MIT CSAIL; Kristin Tufte, Portland State University; and Stan Zdonik, Brown University Stream processing has largely been thought of as real-time analytics. Data enters the system as streams and analytic functions (aggregates) are computed on the … Continue reading

Posted in Big Data Applications, DBMS, ISTC for Big Data Blog, Streaming Big Data | Tagged , , , , , , , , , | Leave a comment

ModelDB: A System for Managing Machine Learning Models

By Manasi Vartak, Harihar Subramanyam, Wei-En Lee, Srinidhi Viswanathan, Saadiyah Husnoo, Sam Madden and Matei Zaharia, MIT CSAIL Building real-world machine learning (ML) algorithms is an iterative process. A data scientist will build many 10s to 100s of models before arriving … Continue reading

Posted in Big Data Applications, Big Data Architecture, ISTC for Big Data Blog, Tools for Big Data | Tagged , , | 4 Comments

PolyPEG: A Proposal for Polystore Optimization

By Dylan Hutchison, Bill Howe, Dan Suciu, and Zachary Tatlock, University of Washington There has been a “cambrian explosion” of systems and languages for large-scale data analytics:  Postgres and H-Store accept SQL queries; Datomic and Myria accept Datalog; SciDB accepts … Continue reading

Posted in Big Data Applications, Big Data Architecture, ISTC for Big Data Blog, Polystores, Tools for Big Data | Tagged , , , | Leave a comment