First-order open-universe POMDPs

Siddharth Srivastava, Stuart Russell, Paul Ruan, Xiang Cheng

Research output: Chapter in Book/Report/Conference proceedingConference contribution

11 Citations (Scopus)

Abstract

Open-universe probability models, representable by a variety of probabilistic programming languages (PPLs), handle uncertainty over the existence and identity of objects-forms of uncertainty occurring in many real-world situations. We examine the problem of extending a declarative PPL to define decision problems (specifically, POMDPs) and identify non-trivial representational issues in describing an agent's capability for observation and action-issues that were avoided in previous work only by making strong and restrictive assumptions. We present semantic definitions that lead to POMDP specifications provably consistent with the sensor and actuator capabilities of the agent. We also describe a variant of point-based value iteration for solving open-universe POMDPs. Thus, we handle cases-such as seeing a new object and picking it up-that could not previously be represented or solved.

Original languageEnglish (US)
Title of host publicationUncertainty in Artificial Intelligence - Proceedings of the 30th Conference, UAI 2014
EditorsNevin L. Zhang, Jin Tian
PublisherAUAI Press
Pages742-751
Number of pages10
ISBN (Electronic)9780974903910
StatePublished - Jan 1 2014
Externally publishedYes
Event30th Conference on Uncertainty in Artificial Intelligence, UAI 2014 - Quebec City, Canada
Duration: Jul 23 2014Jul 27 2014

Other

Other30th Conference on Uncertainty in Artificial Intelligence, UAI 2014
CountryCanada
CityQuebec City
Period7/23/147/27/14

Fingerprint

Computer programming languages
Actuators
Semantics
Specifications
Sensors
Uncertainty

ASJC Scopus subject areas

  • Artificial Intelligence

Cite this

Srivastava, S., Russell, S., Ruan, P., & Cheng, X. (2014). First-order open-universe POMDPs. In N. L. Zhang, & J. Tian (Eds.), Uncertainty in Artificial Intelligence - Proceedings of the 30th Conference, UAI 2014 (pp. 742-751). AUAI Press.

First-order open-universe POMDPs. / Srivastava, Siddharth; Russell, Stuart; Ruan, Paul; Cheng, Xiang.

Uncertainty in Artificial Intelligence - Proceedings of the 30th Conference, UAI 2014. ed. / Nevin L. Zhang; Jin Tian. AUAI Press, 2014. p. 742-751.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Srivastava, S, Russell, S, Ruan, P & Cheng, X 2014, First-order open-universe POMDPs. in NL Zhang & J Tian (eds), Uncertainty in Artificial Intelligence - Proceedings of the 30th Conference, UAI 2014. AUAI Press, pp. 742-751, 30th Conference on Uncertainty in Artificial Intelligence, UAI 2014, Quebec City, Canada, 7/23/14.
Srivastava S, Russell S, Ruan P, Cheng X. First-order open-universe POMDPs. In Zhang NL, Tian J, editors, Uncertainty in Artificial Intelligence - Proceedings of the 30th Conference, UAI 2014. AUAI Press. 2014. p. 742-751
Srivastava, Siddharth ; Russell, Stuart ; Ruan, Paul ; Cheng, Xiang. / First-order open-universe POMDPs. Uncertainty in Artificial Intelligence - Proceedings of the 30th Conference, UAI 2014. editor / Nevin L. Zhang ; Jin Tian. AUAI Press, 2014. pp. 742-751
@inproceedings{4e69149fcc6442bbbd696a5a44a27fbb,
title = "First-order open-universe POMDPs",
abstract = "Open-universe probability models, representable by a variety of probabilistic programming languages (PPLs), handle uncertainty over the existence and identity of objects-forms of uncertainty occurring in many real-world situations. We examine the problem of extending a declarative PPL to define decision problems (specifically, POMDPs) and identify non-trivial representational issues in describing an agent's capability for observation and action-issues that were avoided in previous work only by making strong and restrictive assumptions. We present semantic definitions that lead to POMDP specifications provably consistent with the sensor and actuator capabilities of the agent. We also describe a variant of point-based value iteration for solving open-universe POMDPs. Thus, we handle cases-such as seeing a new object and picking it up-that could not previously be represented or solved.",
author = "Siddharth Srivastava and Stuart Russell and Paul Ruan and Xiang Cheng",
year = "2014",
month = "1",
day = "1",
language = "English (US)",
pages = "742--751",
editor = "Zhang, {Nevin L.} and Jin Tian",
booktitle = "Uncertainty in Artificial Intelligence - Proceedings of the 30th Conference, UAI 2014",
publisher = "AUAI Press",

}

TY - GEN

T1 - First-order open-universe POMDPs

AU - Srivastava, Siddharth

AU - Russell, Stuart

AU - Ruan, Paul

AU - Cheng, Xiang

PY - 2014/1/1

Y1 - 2014/1/1

N2 - Open-universe probability models, representable by a variety of probabilistic programming languages (PPLs), handle uncertainty over the existence and identity of objects-forms of uncertainty occurring in many real-world situations. We examine the problem of extending a declarative PPL to define decision problems (specifically, POMDPs) and identify non-trivial representational issues in describing an agent's capability for observation and action-issues that were avoided in previous work only by making strong and restrictive assumptions. We present semantic definitions that lead to POMDP specifications provably consistent with the sensor and actuator capabilities of the agent. We also describe a variant of point-based value iteration for solving open-universe POMDPs. Thus, we handle cases-such as seeing a new object and picking it up-that could not previously be represented or solved.

AB - Open-universe probability models, representable by a variety of probabilistic programming languages (PPLs), handle uncertainty over the existence and identity of objects-forms of uncertainty occurring in many real-world situations. We examine the problem of extending a declarative PPL to define decision problems (specifically, POMDPs) and identify non-trivial representational issues in describing an agent's capability for observation and action-issues that were avoided in previous work only by making strong and restrictive assumptions. We present semantic definitions that lead to POMDP specifications provably consistent with the sensor and actuator capabilities of the agent. We also describe a variant of point-based value iteration for solving open-universe POMDPs. Thus, we handle cases-such as seeing a new object and picking it up-that could not previously be represented or solved.

UR - http://www.scopus.com/inward/record.url?scp=84923305328&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84923305328&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:84923305328

SP - 742

EP - 751

BT - Uncertainty in Artificial Intelligence - Proceedings of the 30th Conference, UAI 2014

A2 - Zhang, Nevin L.

A2 - Tian, Jin

PB - AUAI Press

ER -