Abstract

The Conformal Predictions framework is a new game-theoretic approach to reliable machine learning, which provides a methodology to obtain error calibration under classification and regression settings. The framework combines principles of transductive inference, algorithmic randomness and hypothesis testing to provide guaranteed error calibration in online settings (and calibration in offline settings supported by empirical studies). As the framework is being increasingly used in a variety of machine learning settings such as active learning, anomaly detection, feature selection, and change detection, there is a need to develop algorithmic implementations of the framework that can be used and further improved by researchers and practitioners. In this paper, we introduce PyCP, an open-source implementation of the Conformal Predictions framework that currently provides support for classification problems within transductive and Mondrian settings. PyCP is modular, extensible and intended for community sharing and development.

Original languageEnglish (US)
Title of host publicationArtificial Intelligence Applications and Innovations - 9th IFIPWG 12.5 International Conference, AIAI 2013, Proceedings
PublisherSpringer New York LLC
Pages361-370
Number of pages10
ISBN (Print)9783642411410
DOIs
StatePublished - Jan 1 2013
Event9th IFIP WG 12.5 International Conference on Artificial Intelligence Applications and Innovations, AIAI 2013 - Paphos, Cyprus
Duration: Sep 30 2013Oct 2 2013

Publication series

NameIFIP Advances in Information and Communication Technology
Volume412
ISSN (Print)1868-4238

Other

Other9th IFIP WG 12.5 International Conference on Artificial Intelligence Applications and Innovations, AIAI 2013
CountryCyprus
CityPaphos
Period9/30/1310/2/13

Keywords

  • Conformal predictions
  • Open-source software

ASJC Scopus subject areas

  • Information Systems
  • Computer Networks and Communications
  • Information Systems and Management

Fingerprint Dive into the research topics of 'PyCP: An open-source Conformal Predictions toolkit'. Together they form a unique fingerprint.

  • Cite this

    Balasubramanian, V. N., Baker, A., Yanez, M., Chakraborty, S., & Panchanathan, S. (2013). PyCP: An open-source Conformal Predictions toolkit. In Artificial Intelligence Applications and Innovations - 9th IFIPWG 12.5 International Conference, AIAI 2013, Proceedings (pp. 361-370). (IFIP Advances in Information and Communication Technology; Vol. 412). Springer New York LLC. https://doi.org/10.1007/978-3-642-41142-7_37