Supercharging Big Data Research with New England’s Fastest Supercomputer

An Interview with Jeremy Kepner of MIT Lincoln Laboratory MIT recently announced that the MIT Lincoln Laboratory Supercomputing Center (LLSC) system, housed in Holyoke, Massachusetts, has been ranked the most powerful supercomputer in New England. We caught up with ISTC … Continue reading

Posted in Big Data Architecture, Computer Architecture, High-Performance Computing, ISTC for Big Data Blog, Polystores | Tagged , , , , | Leave a comment

Compiling Queries for High-Performance Computing

By Brandon Myers and Bill Howe, University of Washington High performance computing (HPC) is traditionally about compute, but its users have data management problems, too. In a recent paper, we demonstrated a promising technique for bringing ad hoc query processing into … Continue reading

Posted in Big Data Applications, Data Management, High-Performance Computing, ISTC for Big Data Blog | Tagged , , , , , | Leave a comment

TileDB and GenomicsDB Now Available in Open Source

by Stavros Papadopoulos, Intel Parallel Computing Lab The ISTC for Big Data has recently released TileDB, a novel efficient data management system for scientific data, such as graphs, DNA sequences, matrices, maps, and imaging. We have also released an adaptation of TileDB … Continue reading

Posted in Big Data Applications, Data Management, DBMS, High-Performance Computing, ISTC for Big Data Blog | Tagged , , , , , , , | Leave a comment

2015: Momentum, Moments and Memories

Greetings of the season from the Intel Science and Technology Center for Big Data.  As 2015 comes to a close, we thought we would share some moments and memories that were captured here in the ISTC for Big Data blog … Continue reading

Posted in Analytics, Big Data Applications, Big Data Architecture, Data Management, Databases and Analytics, DBMS, High-Performance Computing, ISTC for Big Data Blog, Storage, Streaming Big Data, Visualizing Big Data | Tagged , , , , , , , , , , , , , , , , , , , | Leave a comment

Fast Data Analysis with SVD

By Jack Dongarra, University of Tennessee Knoxville and Innovative Computing Laboratory The GenBase benchmark was developed as a collaboration with the Intel Parallel Computing Lab, the Broad Institute and Novartis, and the MIT Database Group. Among many challenging tests that the benchmark includes is a computation of the Singular Value … Continue reading

Posted in Analytics, Benchmarks, Big Data Architecture, High-Performance Computing, ISTC for Big Data Blog, Math and Algorithms | Tagged , , , , , | Leave a comment

High-Performance Computing Meets Databases

By Bill Howe, Ph.D., University of Washington eScience Institute The large-scale data systems associated with high performance computing (HPC) applications ― e.g., parallel file systems ― are becoming increasingly “smart,” augmenting basic open(), seek() and read() interfaces with sophisticated indexing … Continue reading

Posted in Computer Architecture, DBMS, High-Performance Computing, ISTC for Big Data Blog | Tagged , , , | Leave a comment