A server for automated performance analysis of benchmarking data

Hans Mittelmann, Armin Pruessner

Research output: Contribution to journalArticlepeer-review

12 Scopus citations

Abstract

As part of Performance World, we describe an automation server (PAVER: http://www.gamsworld.org/performance/paver ) to help facilitate reproducible performance analysis of benchmarking data for optimization software. Although PAVER does not solve optimization problems, it automates the task of performance data analysis and visualization, taking into account various performance metrics. These include not only robustness and efficiency, but also quality of solution. This paper discusses the tools and the performance metrics used, as well as the design of the server. We give examples of performance data analysis using an instance of the COPS test case for nonlinear programming to illustrate the features of the server.

Original languageEnglish (US)
Pages (from-to)105-120
Number of pages16
JournalOptimization Methods and Software
Volume21
Issue number1
DOIs
StatePublished - Feb 2006

Keywords

  • Performance data analysis
  • Performance metrics
  • Web-based service

ASJC Scopus subject areas

  • Software
  • Control and Optimization
  • Applied Mathematics

Fingerprint Dive into the research topics of 'A server for automated performance analysis of benchmarking data'. Together they form a unique fingerprint.

Cite this