AI-MIX: Using automated planning to steer human workers towards better crowdsourced plans

Lydia Manikonda, Tathagata Chakraborti, Sushovan De, Kartik Talamadupula, Subbarao Kambhampati

Research output: Chapter in Book/Report/Conference proceedingConference contribution

8 Citations (Scopus)

Abstract

One subclass of human computation applications are those directed at tasks that involve planning (e.g. tour planning) and scheduling (e.g. conference scheduling). Interestingly, work on these systems shows that even primitive forms of automated oversight on the human contributors helps in sig-nificantly improving the effectiveness of the humans/crowd. In this paper, we argue that the automated oversight used in these systems can be viewed as a primitive automated planner, and that there are several opportunities for more sophisticated automated planning in effectively steering the crowd. Straightforward adaptation of current planning technology is however hampered by the mismatch between the capabilities of human workers and automated planners. We identify and partially address two important challenges that need to be overcome before such adaptation of planning technology can occur: (i) interpreting inputs of the human workers (and the requester) and (ii) steering or critiquing plans produced by the human workers, armed only with incomplete domain and preference models. To these ends, we describe the implementation of AI-MIX, a tour plan generation system that uses automated checks and alerts to improve the quality of plans created by human workers; and present a preliminary evaluation of the effectiveness of steering provided by automated planning.

Original languageEnglish (US)
Title of host publicationProceedings of the National Conference on Artificial Intelligence
PublisherAI Access Foundation
Pages3004-3009
Number of pages6
Volume4
ISBN (Print)9781577356806
StatePublished - 2014
Event28th AAAI Conference on Artificial Intelligence, AAAI 2014, 26th Innovative Applications of Artificial Intelligence Conference, IAAI 2014 and the 5th Symposium on Educational Advances in Artificial Intelligence, EAAI 2014 - Quebec City, Canada
Duration: Jul 27 2014Jul 31 2014

Other

Other28th AAAI Conference on Artificial Intelligence, AAAI 2014, 26th Innovative Applications of Artificial Intelligence Conference, IAAI 2014 and the 5th Symposium on Educational Advances in Artificial Intelligence, EAAI 2014
CountryCanada
CityQuebec City
Period7/27/147/31/14

Fingerprint

Planning
Scheduling

ASJC Scopus subject areas

  • Software
  • Artificial Intelligence

Cite this

Manikonda, L., Chakraborti, T., De, S., Talamadupula, K., & Kambhampati, S. (2014). AI-MIX: Using automated planning to steer human workers towards better crowdsourced plans. In Proceedings of the National Conference on Artificial Intelligence (Vol. 4, pp. 3004-3009). AI Access Foundation.

AI-MIX : Using automated planning to steer human workers towards better crowdsourced plans. / Manikonda, Lydia; Chakraborti, Tathagata; De, Sushovan; Talamadupula, Kartik; Kambhampati, Subbarao.

Proceedings of the National Conference on Artificial Intelligence. Vol. 4 AI Access Foundation, 2014. p. 3004-3009.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Manikonda, L, Chakraborti, T, De, S, Talamadupula, K & Kambhampati, S 2014, AI-MIX: Using automated planning to steer human workers towards better crowdsourced plans. in Proceedings of the National Conference on Artificial Intelligence. vol. 4, AI Access Foundation, pp. 3004-3009, 28th AAAI Conference on Artificial Intelligence, AAAI 2014, 26th Innovative Applications of Artificial Intelligence Conference, IAAI 2014 and the 5th Symposium on Educational Advances in Artificial Intelligence, EAAI 2014, Quebec City, Canada, 7/27/14.
Manikonda L, Chakraborti T, De S, Talamadupula K, Kambhampati S. AI-MIX: Using automated planning to steer human workers towards better crowdsourced plans. In Proceedings of the National Conference on Artificial Intelligence. Vol. 4. AI Access Foundation. 2014. p. 3004-3009
Manikonda, Lydia ; Chakraborti, Tathagata ; De, Sushovan ; Talamadupula, Kartik ; Kambhampati, Subbarao. / AI-MIX : Using automated planning to steer human workers towards better crowdsourced plans. Proceedings of the National Conference on Artificial Intelligence. Vol. 4 AI Access Foundation, 2014. pp. 3004-3009
@inproceedings{2e423ced6fc34a4cba13400d80d0a768,
title = "AI-MIX: Using automated planning to steer human workers towards better crowdsourced plans",
abstract = "One subclass of human computation applications are those directed at tasks that involve planning (e.g. tour planning) and scheduling (e.g. conference scheduling). Interestingly, work on these systems shows that even primitive forms of automated oversight on the human contributors helps in sig-nificantly improving the effectiveness of the humans/crowd. In this paper, we argue that the automated oversight used in these systems can be viewed as a primitive automated planner, and that there are several opportunities for more sophisticated automated planning in effectively steering the crowd. Straightforward adaptation of current planning technology is however hampered by the mismatch between the capabilities of human workers and automated planners. We identify and partially address two important challenges that need to be overcome before such adaptation of planning technology can occur: (i) interpreting inputs of the human workers (and the requester) and (ii) steering or critiquing plans produced by the human workers, armed only with incomplete domain and preference models. To these ends, we describe the implementation of AI-MIX, a tour plan generation system that uses automated checks and alerts to improve the quality of plans created by human workers; and present a preliminary evaluation of the effectiveness of steering provided by automated planning.",
author = "Lydia Manikonda and Tathagata Chakraborti and Sushovan De and Kartik Talamadupula and Subbarao Kambhampati",
year = "2014",
language = "English (US)",
isbn = "9781577356806",
volume = "4",
pages = "3004--3009",
booktitle = "Proceedings of the National Conference on Artificial Intelligence",
publisher = "AI Access Foundation",

}

TY - GEN

T1 - AI-MIX

T2 - Using automated planning to steer human workers towards better crowdsourced plans

AU - Manikonda, Lydia

AU - Chakraborti, Tathagata

AU - De, Sushovan

AU - Talamadupula, Kartik

AU - Kambhampati, Subbarao

PY - 2014

Y1 - 2014

N2 - One subclass of human computation applications are those directed at tasks that involve planning (e.g. tour planning) and scheduling (e.g. conference scheduling). Interestingly, work on these systems shows that even primitive forms of automated oversight on the human contributors helps in sig-nificantly improving the effectiveness of the humans/crowd. In this paper, we argue that the automated oversight used in these systems can be viewed as a primitive automated planner, and that there are several opportunities for more sophisticated automated planning in effectively steering the crowd. Straightforward adaptation of current planning technology is however hampered by the mismatch between the capabilities of human workers and automated planners. We identify and partially address two important challenges that need to be overcome before such adaptation of planning technology can occur: (i) interpreting inputs of the human workers (and the requester) and (ii) steering or critiquing plans produced by the human workers, armed only with incomplete domain and preference models. To these ends, we describe the implementation of AI-MIX, a tour plan generation system that uses automated checks and alerts to improve the quality of plans created by human workers; and present a preliminary evaluation of the effectiveness of steering provided by automated planning.

AB - One subclass of human computation applications are those directed at tasks that involve planning (e.g. tour planning) and scheduling (e.g. conference scheduling). Interestingly, work on these systems shows that even primitive forms of automated oversight on the human contributors helps in sig-nificantly improving the effectiveness of the humans/crowd. In this paper, we argue that the automated oversight used in these systems can be viewed as a primitive automated planner, and that there are several opportunities for more sophisticated automated planning in effectively steering the crowd. Straightforward adaptation of current planning technology is however hampered by the mismatch between the capabilities of human workers and automated planners. We identify and partially address two important challenges that need to be overcome before such adaptation of planning technology can occur: (i) interpreting inputs of the human workers (and the requester) and (ii) steering or critiquing plans produced by the human workers, armed only with incomplete domain and preference models. To these ends, we describe the implementation of AI-MIX, a tour plan generation system that uses automated checks and alerts to improve the quality of plans created by human workers; and present a preliminary evaluation of the effectiveness of steering provided by automated planning.

UR - http://www.scopus.com/inward/record.url?scp=84908205012&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84908205012&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:84908205012

SN - 9781577356806

VL - 4

SP - 3004

EP - 3009

BT - Proceedings of the National Conference on Artificial Intelligence

PB - AI Access Foundation

ER -