Dynamic distributed dimensional data model (D4M) database and computation system

Jeremy Kepner, William Arcand, William Bergeron, Nadya Bliss, Robert Bond, Chansup Byun, Gary Condon, Kenneth Gregson, Matthew Hubbell, Jonathan Kurz, Andrew McCabe, Peter Michaleas, Andrew Prout, Albert Reuther, Antonio Rosa, Charles Yee

Research output: Chapter in Book/Report/Conference proceedingConference contribution

63 Citations (Scopus)

Abstract

A crucial element of large web companies is their ability to collect and analyze massive amounts of data. Tuple store databases are a key enabling technology employed by many of these companies (e.g., Google Big Table and Amazon Dynamo). Tuple stores are highly scalable and run on commodity clusters, but lack interfaces to support efficient development of mathematically based analytics. D4M (Dynamic Distributed Dimensional Data Model) has been developed to provide a mathematically rich interface to tuple stores (and structured query language "SQL" databases). D4M allows linear algebra to be readily applied to databases. Using D4M, it is possible to create composable analytics with significantly less effort than using traditional approaches. This work describes the D4M technology and its application and performance.

Original languageEnglish (US)
Title of host publicationICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
Pages5349-5352
Number of pages4
DOIs
StatePublished - 2012
Externally publishedYes
Event2012 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2012 - Kyoto, Japan
Duration: Mar 25 2012Mar 30 2012

Other

Other2012 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2012
CountryJapan
CityKyoto
Period3/25/123/30/12

Fingerprint

Data structures
Linear algebra
Query languages
Industry

Keywords

  • associative array
  • database
  • fuzzy algebra
  • linear algebra
  • tuple store

ASJC Scopus subject areas

  • Signal Processing
  • Software
  • Electrical and Electronic Engineering

Cite this

Kepner, J., Arcand, W., Bergeron, W., Bliss, N., Bond, R., Byun, C., ... Yee, C. (2012). Dynamic distributed dimensional data model (D4M) database and computation system. In ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings (pp. 5349-5352). [6289129] https://doi.org/10.1109/ICASSP.2012.6289129

Dynamic distributed dimensional data model (D4M) database and computation system. / Kepner, Jeremy; Arcand, William; Bergeron, William; Bliss, Nadya; Bond, Robert; Byun, Chansup; Condon, Gary; Gregson, Kenneth; Hubbell, Matthew; Kurz, Jonathan; McCabe, Andrew; Michaleas, Peter; Prout, Andrew; Reuther, Albert; Rosa, Antonio; Yee, Charles.

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings. 2012. p. 5349-5352 6289129.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Kepner, J, Arcand, W, Bergeron, W, Bliss, N, Bond, R, Byun, C, Condon, G, Gregson, K, Hubbell, M, Kurz, J, McCabe, A, Michaleas, P, Prout, A, Reuther, A, Rosa, A & Yee, C 2012, Dynamic distributed dimensional data model (D4M) database and computation system. in ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings., 6289129, pp. 5349-5352, 2012 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2012, Kyoto, Japan, 3/25/12. https://doi.org/10.1109/ICASSP.2012.6289129
Kepner J, Arcand W, Bergeron W, Bliss N, Bond R, Byun C et al. Dynamic distributed dimensional data model (D4M) database and computation system. In ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings. 2012. p. 5349-5352. 6289129 https://doi.org/10.1109/ICASSP.2012.6289129
Kepner, Jeremy ; Arcand, William ; Bergeron, William ; Bliss, Nadya ; Bond, Robert ; Byun, Chansup ; Condon, Gary ; Gregson, Kenneth ; Hubbell, Matthew ; Kurz, Jonathan ; McCabe, Andrew ; Michaleas, Peter ; Prout, Andrew ; Reuther, Albert ; Rosa, Antonio ; Yee, Charles. / Dynamic distributed dimensional data model (D4M) database and computation system. ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings. 2012. pp. 5349-5352
@inproceedings{4150df02c693414684af3d60266031f2,
title = "Dynamic distributed dimensional data model (D4M) database and computation system",
abstract = "A crucial element of large web companies is their ability to collect and analyze massive amounts of data. Tuple store databases are a key enabling technology employed by many of these companies (e.g., Google Big Table and Amazon Dynamo). Tuple stores are highly scalable and run on commodity clusters, but lack interfaces to support efficient development of mathematically based analytics. D4M (Dynamic Distributed Dimensional Data Model) has been developed to provide a mathematically rich interface to tuple stores (and structured query language {"}SQL{"} databases). D4M allows linear algebra to be readily applied to databases. Using D4M, it is possible to create composable analytics with significantly less effort than using traditional approaches. This work describes the D4M technology and its application and performance.",
keywords = "associative array, database, fuzzy algebra, linear algebra, tuple store",
author = "Jeremy Kepner and William Arcand and William Bergeron and Nadya Bliss and Robert Bond and Chansup Byun and Gary Condon and Kenneth Gregson and Matthew Hubbell and Jonathan Kurz and Andrew McCabe and Peter Michaleas and Andrew Prout and Albert Reuther and Antonio Rosa and Charles Yee",
year = "2012",
doi = "10.1109/ICASSP.2012.6289129",
language = "English (US)",
isbn = "9781467300469",
pages = "5349--5352",
booktitle = "ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings",

}

TY - GEN

T1 - Dynamic distributed dimensional data model (D4M) database and computation system

AU - Kepner, Jeremy

AU - Arcand, William

AU - Bergeron, William

AU - Bliss, Nadya

AU - Bond, Robert

AU - Byun, Chansup

AU - Condon, Gary

AU - Gregson, Kenneth

AU - Hubbell, Matthew

AU - Kurz, Jonathan

AU - McCabe, Andrew

AU - Michaleas, Peter

AU - Prout, Andrew

AU - Reuther, Albert

AU - Rosa, Antonio

AU - Yee, Charles

PY - 2012

Y1 - 2012

N2 - A crucial element of large web companies is their ability to collect and analyze massive amounts of data. Tuple store databases are a key enabling technology employed by many of these companies (e.g., Google Big Table and Amazon Dynamo). Tuple stores are highly scalable and run on commodity clusters, but lack interfaces to support efficient development of mathematically based analytics. D4M (Dynamic Distributed Dimensional Data Model) has been developed to provide a mathematically rich interface to tuple stores (and structured query language "SQL" databases). D4M allows linear algebra to be readily applied to databases. Using D4M, it is possible to create composable analytics with significantly less effort than using traditional approaches. This work describes the D4M technology and its application and performance.

AB - A crucial element of large web companies is their ability to collect and analyze massive amounts of data. Tuple store databases are a key enabling technology employed by many of these companies (e.g., Google Big Table and Amazon Dynamo). Tuple stores are highly scalable and run on commodity clusters, but lack interfaces to support efficient development of mathematically based analytics. D4M (Dynamic Distributed Dimensional Data Model) has been developed to provide a mathematically rich interface to tuple stores (and structured query language "SQL" databases). D4M allows linear algebra to be readily applied to databases. Using D4M, it is possible to create composable analytics with significantly less effort than using traditional approaches. This work describes the D4M technology and its application and performance.

KW - associative array

KW - database

KW - fuzzy algebra

KW - linear algebra

KW - tuple store

UR - http://www.scopus.com/inward/record.url?scp=84867585940&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84867585940&partnerID=8YFLogxK

U2 - 10.1109/ICASSP.2012.6289129

DO - 10.1109/ICASSP.2012.6289129

M3 - Conference contribution

AN - SCOPUS:84867585940

SN - 9781467300469

SP - 5349

EP - 5352

BT - ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

ER -