Tag Archives: Stream Processing

ISTC Researchers Present Work at NEDB Day 2017

ISTC for Big Data principal investigators, researchers and their students presented work at North East Database Day 2017, held at MIT’s Stata Center in Cambridge, Mass., on January 27, 2017. Microsoft and Facebook sponsored the event. The 9th Annual North East … Continue reading

Posted in Big Data Architecture, Data Management, Databases and Analytics, DBMS, ISTC for Big Data Blog, Storage, Streaming Big Data, Visualizing Big Data | Tagged , , , , , , , , , , | Leave a comment

Analytic Monitoring for the Internet of Things

By Peter Bailis, Stanford Infolab, and Sam Madden, MIT CSAIL An increasing proportion of data today is generated by automated processes, sensors and devices—collectively called the Internet of Things (IoT).   Inexpensive hardware, widespread access to communication networks, and decreased … Continue reading

Posted in Analytics, Big Data Applications, Big Data Architecture, Databases and Analytics, ISTC for Big Data Blog, Streaming Big Data | Tagged , , , | Leave a comment

Genomics Data, Analytics and the Future of Climate Change

By Vijay Gadepally, MIT CSAIL, in collaboration with the Chisholm Laboratory at MIT Meet Prochlorococcus marinus, a marine cyanobacterium that’s intricately linked to the global carbon cycle, widely present in seawater, and possibly holds secrets to future climate change. These … Continue reading

Posted in Big Data Applications, Big Data Architecture, Data Management, Databases and Analytics, DBMS, Graph Computation, ISTC for Big Data Blog, Polystores, Streaming Big Data, Tools for Big Data, Visualizing Big Data | Tagged , , , , , , , , | Leave a comment

Rethinking Streaming: Correct State Matters!

by Nesime Tatbul, Intel Labs and MIT CSAIL; Kristin Tufte, Portland State University; and Stan Zdonik, Brown University Stream processing has largely been thought of as real-time analytics. Data enters the system as streams and analytic functions (aggregates) are computed on the … Continue reading

Posted in Big Data Applications, DBMS, ISTC for Big Data Blog, Streaming Big Data | Tagged , , , , , , , , , | Leave a comment

Just-in-time Data Transformation and Migration in Polystores

by Aaron Elmore and Adam Dziedzic, University of Chicago Organizations face managing and deriving value from an ever-growing amount of data. Beyond its size, this data is often varied in both structure (e.g., relational data, linked data, numerical data and streaming data) … Continue reading

Posted in Analytics, Big Data Architecture, Data Management, Databases and Analytics, DBMS, Graph Computation, ISTC for Big Data Blog, Polystores, Query Engines, Streaming Big Data | Tagged , , , , , , , , , | Leave a comment

2015: Momentum, Moments and Memories

Greetings of the season from the Intel Science and Technology Center for Big Data.  As 2015 comes to a close, we thought we would share some moments and memories that were captured here in the ISTC for Big Data blog … Continue reading

Posted in Analytics, Big Data Applications, Big Data Architecture, Data Management, Databases and Analytics, DBMS, High-Performance Computing, ISTC for Big Data Blog, Storage, Streaming Big Data, Visualizing Big Data | Tagged , , , , , , , , , , , , , , , , , , , | Leave a comment

ISTC for Big Data: 2015 and Beyond

By Sam Madden, ISTC for Big Data Co-Director Happy New Year, ISTC for Big Data blog readers! It’s been a busy year here at the ISTC for Big Data.  In this post, I call out a few of our highlights … Continue reading

Posted in Analytics, Big Data Applications, Big Data Architecture, Data Management, Databases and Analytics, DBMS, Graph Computation, ISTC for Big Data Blog, Math and Algorithms, Streaming Big Data, Visualizing Big Data | Tagged , , , , , , , , , , , , | Leave a comment

S-Store: A Big-Velocity Database System

By John Meehan, PhD Candidate, Brown University At the 2014 Intel Science and Technology Center for Big Data annual Research Retreat, Nesime Tatbul of Intel Labs and MIT provided an update on S-Store. Background Recently, the architectures of transactional processing DBMSs … Continue reading

Posted in Analytics, Big Data Applications, ISTC for Big Data Blog, Streaming Big Data | Tagged , , , , , , | Leave a comment

S-Store: Real-Time Analytics Meets Transaction Processing

By Nesime Tatbul, Intel Labs and MIT Managing high-speed data streams generated in real time is an integral part of today’s big data applications. In a wide range of domains from social media to financial trading, there is a growing … Continue reading

Posted in Big Data Applications, Databases and Analytics, DBMS, ISTC for Big Data Blog, Streaming Big Data | Tagged , , , , , | Leave a comment