RecStore: An extensible and adaptive framework for online recommender queries inside the database engine

Justin J. Levandoski, Mohamed Sarwat, Mohamed F. Mokbel, Michael D. Ekstrand

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Scopus citations

Abstract

Most recommendation methods (e.g., collaborative filtering) consist of (1) a computationally intense offline phase that computes a recommender model based on users' opinions of items, and (2) an online phase consisting of SQL-based queries that use the model (generated offline) to derive user preferences and provide recommendations for interesting items. Current application usage trends require a completely online recommender process, meaning the recommender model must update in real time as new opinions enter the system. To tackle this problem, we propose RecStore, a DBMS storage engine module capable of efficient online model maintenance. Externally, models managed by RecStore behave as relational tables, thus existing SQL-based recommendation queries remain unchanged while gaining online model support. RecStore maintains internal statistics and data structures aimed at providing efficient incremental updates to the recommender model, while employing an adaptive strategy for internal maintenance and load shedding to realize a balance between efficiency in updates or query processing based on system workloads. RecStore is also extensible, supporting a declarative syntax for defining recommender models. The efficacy of RecStore is demonstrated by providing the implementation details of three state-of-the-art collaborative filtering models. We provide an extensive experimental evaluation of a prototype of RecStore, built inside the storage engine of PostgreSQL, using a real-life recommender system workload.

Original languageEnglish (US)
Title of host publicationAdvances in Database Technology - EDBT 2012
Subtitle of host publication15th International Conference on Extending Database Technology, Proceedings
Pages86-96
Number of pages11
DOIs
StatePublished - Jul 10 2012
Externally publishedYes
Event15th International Conference on Extending Database Technology, EDBT 2012 - Berlin, Germany
Duration: Mar 27 2012Mar 30 2012

Publication series

NameACM International Conference Proceeding Series

Other

Other15th International Conference on Extending Database Technology, EDBT 2012
CountryGermany
CityBerlin
Period3/27/123/30/12

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Vision and Pattern Recognition
  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'RecStore: An extensible and adaptive framework for online recommender queries inside the database engine'. Together they form a unique fingerprint.

  • Cite this

    Levandoski, J. J., Sarwat, M., Mokbel, M. F., & Ekstrand, M. D. (2012). RecStore: An extensible and adaptive framework for online recommender queries inside the database engine. In Advances in Database Technology - EDBT 2012: 15th International Conference on Extending Database Technology, Proceedings (pp. 86-96). (ACM International Conference Proceeding Series). https://doi.org/10.1145/2247596.2247608