Genomics Data, Analytics and the Future of Climate Change

By Vijay Gadepally, MIT CSAIL, in collaboration with the Chisholm Laboratory at MIT Meet Prochlorococcus marinus, a marine cyanobacterium that’s intricately linked to the global carbon cycle, widely present in seawater, and possibly holds secrets to future climate change. These … Continue reading

Posted in Big Data Applications, Big Data Architecture, Data Management, Databases and Analytics, DBMS, Graph Computation, ISTC for Big Data Blog, Polystores, Streaming Big Data, Tools for Big Data, Visualizing Big Data | Tagged , , , , , , , , | Leave a comment

Just-in-time Data Transformation and Migration in Polystores

by Aaron Elmore and Adam Dziedzic, University of Chicago Organizations face managing and deriving value from an ever-growing amount of data. Beyond its size, this data is often varied in both structure (e.g., relational data, linked data, numerical data and streaming data) … Continue reading

Posted in Analytics, Big Data Architecture, Data Management, Databases and Analytics, DBMS, Graph Computation, ISTC for Big Data Blog, Polystores, Query Engines, Streaming Big Data | Tagged , , , , , , , , , | Leave a comment

Query Modeling and Optimization in the BigDAWG Polystore System

By Jennie Duggan, Northwestern University At VLDB 2015, the ISTC for Big Data team presented a demo of the BigDAWG polystore system. This blog post highlights some of the research challenges we are exploring as we build this novel system. … Continue reading

Posted in Analytics, Big Data Architecture, Databases and Analytics, Graph Computation, ISTC for Big Data Blog, Polystores, Query Engines, Tools for Big Data | Tagged , , , , , | Leave a comment

Winning at Big Data: What’s Math Got to Do with It? (A Lot)

Big Data describes a new era in the digital age in which the volume, velocity and variety of data created across a wide range of fields – from Internet search and social media to finance and healthcare to defense and … Continue reading

Posted in Databases and Analytics, Graph Computation, ISTC for Big Data Blog, Math and Algorithms, Tools for Big Data | Tagged , , , , | Leave a comment

ISTC for Big Data Researchers Present Work at NEDB Day 2015

ISTC for Big Data principal investigators (PIs) and researchers presented a broad base of research work at New England Database Day 2015, which was sponsored by Microsoft and held at the Stata Center at MIT in Cambridge, Mass., on Friday, … Continue reading

Posted in Big Data Applications, Big Data Architecture, Computer Architecture, Data Management, DBMS, Graph Computation, ISTC for Big Data Blog, Math and Algorithms, Query Engines, Streaming Big Data | Tagged , , , , , , , , , | Leave a comment

ISTC for Big Data: 2015 and Beyond

By Sam Madden, ISTC for Big Data Co-Director Happy New Year, ISTC for Big Data blog readers! It’s been a busy year here at the ISTC for Big Data.  In this post, I call out a few of our highlights … Continue reading

Posted in Analytics, Big Data Applications, Big Data Architecture, Data Management, Databases and Analytics, DBMS, Graph Computation, ISTC for Big Data Blog, Math and Algorithms, Streaming Big Data, Visualizing Big Data | Tagged , , , , , , , , , , , , | Leave a comment

Research Updates from the ISTC for Big Data

In August, researchers from Intel and participating institutions gathered at the Intel Science and Technology Center for Big Data’s annual Research Retreat at Intel’s Jones Farm campus in Hillsboro, Oregon to present their latest work and describe their progress. Here … Continue reading

Posted in Benchmarks, Big Data Architecture, DBMS, Graph Computation, ISTC for Big Data Blog, Storage | Tagged , , , , , | Leave a comment

Graph Analytics: The New Use Case for Relational Databases

ByAlekh Jindal, MIT CSAIL Graph analytics are becoming increasingly popular with several new big-data application domains such as social networks, transportation networks, ad networks, e-commerce, and web search. However, these graph analytics workloads are seen as quite different from traditional database … Continue reading

Posted in Analytics, Databases and Analytics, Graph Computation, ISTC for Big Data Blog | Tagged , , , , , , , | 3 Comments

Improving Query Speeds on Vital Industry Big Data Sets

The Intel Science & Technology Center for Big Data is working on many ways to make it easier to access, store, manage and perform analytics on big, gnarly data sets that are vital to major fields of research. One way … Continue reading

Posted in Analytics, Benchmarks, Big Data Applications, Databases and Analytics, Graph Computation, ISTC for Big Data Blog, Tools for Big Data | Tagged , , , , , , | Leave a comment

Benchmarking Graph Databases – Updates

By Alekh Jindal, MIT CSAIL After our last post about benchmarking graph databases, Neo Technology representatives contacted us and said that they repeated the shortest path queries on Neo4j with the Facebook dataset and they observed 2-4 orders of magnitude better … Continue reading

Posted in Analytics, Big Data Applications, Big Data Architecture, Databases and Analytics, DBMS, Graph Computation, ISTC for Big Data Blog | Tagged , , , , , , , , | Comments Off on Benchmarking Graph Databases – Updates