Enriching programming content semantics: An evaluation of visual analytics approach

Ihan Hsiao, Yi Ling Lin

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

In this work, we present an intelligent classroom orchestration technology to capture semantic learning analytics from paper-based programming exams. We design and study an innovative visual analytics system, EduAnalysis, to support programming content semantics extraction and analysis. EduAnalysis indexes each programming exam question to a set of concepts based on the ontology. It utilizes automatic indexing algorithm and interactive visualization interfaces to establish the concepts and questions associations. We collect the indexing ground truths of the targeted set from teachers and experts from the crowd. We found that the system significantly extracted more and diverse concepts from exams and achieved high coherence within exam. We also discovered that indexing effectiveness was especially prevalent for complex content. Overall, the semantic enriching approach for programming problems reveals systematic learning analytics from the paper exams.

Original languageEnglish (US)
JournalComputers in Human Behavior
DOIs
StateAccepted/In press - May 1 2016

Fingerprint

Computer programming
Semantics
Learning
Automatic indexing
Interfaces (computer)
Technology
Ontology
Visualization
Semantic Content
Programming
Evaluation
Indexing

Keywords

  • Automatic indexing
  • Interactive visualization
  • Learning analytics
  • Programming learning
  • Semantic indexing
  • Visual analytics

ASJC Scopus subject areas

  • Arts and Humanities (miscellaneous)
  • Human-Computer Interaction
  • Psychology(all)

Cite this

Enriching programming content semantics : An evaluation of visual analytics approach. / Hsiao, Ihan; Lin, Yi Ling.

In: Computers in Human Behavior, 01.05.2016.

Research output: Contribution to journalArticle

@article{29399a2ba2d0423c8db863890c85a967,
title = "Enriching programming content semantics: An evaluation of visual analytics approach",
abstract = "In this work, we present an intelligent classroom orchestration technology to capture semantic learning analytics from paper-based programming exams. We design and study an innovative visual analytics system, EduAnalysis, to support programming content semantics extraction and analysis. EduAnalysis indexes each programming exam question to a set of concepts based on the ontology. It utilizes automatic indexing algorithm and interactive visualization interfaces to establish the concepts and questions associations. We collect the indexing ground truths of the targeted set from teachers and experts from the crowd. We found that the system significantly extracted more and diverse concepts from exams and achieved high coherence within exam. We also discovered that indexing effectiveness was especially prevalent for complex content. Overall, the semantic enriching approach for programming problems reveals systematic learning analytics from the paper exams.",
keywords = "Automatic indexing, Interactive visualization, Learning analytics, Programming learning, Semantic indexing, Visual analytics",
author = "Ihan Hsiao and Lin, {Yi Ling}",
year = "2016",
month = "5",
day = "1",
doi = "10.1016/j.chb.2016.10.012",
language = "English (US)",
journal = "Computers in Human Behavior",
issn = "0747-5632",
publisher = "Elsevier Limited",

}

TY - JOUR

T1 - Enriching programming content semantics

T2 - An evaluation of visual analytics approach

AU - Hsiao, Ihan

AU - Lin, Yi Ling

PY - 2016/5/1

Y1 - 2016/5/1

N2 - In this work, we present an intelligent classroom orchestration technology to capture semantic learning analytics from paper-based programming exams. We design and study an innovative visual analytics system, EduAnalysis, to support programming content semantics extraction and analysis. EduAnalysis indexes each programming exam question to a set of concepts based on the ontology. It utilizes automatic indexing algorithm and interactive visualization interfaces to establish the concepts and questions associations. We collect the indexing ground truths of the targeted set from teachers and experts from the crowd. We found that the system significantly extracted more and diverse concepts from exams and achieved high coherence within exam. We also discovered that indexing effectiveness was especially prevalent for complex content. Overall, the semantic enriching approach for programming problems reveals systematic learning analytics from the paper exams.

AB - In this work, we present an intelligent classroom orchestration technology to capture semantic learning analytics from paper-based programming exams. We design and study an innovative visual analytics system, EduAnalysis, to support programming content semantics extraction and analysis. EduAnalysis indexes each programming exam question to a set of concepts based on the ontology. It utilizes automatic indexing algorithm and interactive visualization interfaces to establish the concepts and questions associations. We collect the indexing ground truths of the targeted set from teachers and experts from the crowd. We found that the system significantly extracted more and diverse concepts from exams and achieved high coherence within exam. We also discovered that indexing effectiveness was especially prevalent for complex content. Overall, the semantic enriching approach for programming problems reveals systematic learning analytics from the paper exams.

KW - Automatic indexing

KW - Interactive visualization

KW - Learning analytics

KW - Programming learning

KW - Semantic indexing

KW - Visual analytics

UR - http://www.scopus.com/inward/record.url?scp=85006021071&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85006021071&partnerID=8YFLogxK

U2 - 10.1016/j.chb.2016.10.012

DO - 10.1016/j.chb.2016.10.012

M3 - Article

AN - SCOPUS:85006021071

JO - Computers in Human Behavior

JF - Computers in Human Behavior

SN - 0747-5632

ER -