Abstract

In this paper, we utilize feature extraction and model-fitting techniques to process the rhetoric found in the web sites of 23 Indonesian Islamic religious organizations to profile their ideology and activity patterns along a hypothesized radical/counter-radical scale, and present an end-to-end system that is able to help researchers to visualize the data in an interactive fashion on a timeline. The subject data of this study is 37,000 articles downloaded from the web sites of these organizations dating from 2001 to 2011. We develop algorithms to rank these organizations by assigning them to probable positions on the scale. We show that the developed Rasch model fits the data using Andersen’s LR-test. We create a gold standard of the ranking of these organizations through an expertise elicitation tool. We compute expert-to-expert agreements, and we present experimental results comparing the performance of three baseline methods to show that the Rasch model not only outperforms the baseline methods, but it is also the only system that performs at expert-level accuracy.

Original languageEnglish (US)
Pages (from-to)313-328
Number of pages16
JournalSocial Network Analysis and Mining
Volume3
Issue number3
DOIs
StatePublished - Jan 1 2013

Fingerprint

ranking
expert
Websites
gold standard
Feature extraction
rhetoric
expertise
ideology
performance

ASJC Scopus subject areas

  • Computer Science Applications
  • Human-Computer Interaction
  • Information Systems
  • Communication
  • Media Technology

Cite this

A system for ranking organizations using social scale analysis. / Tikves, Sukru; Banerjee, Sujogya; Temkit, Hamy; Gokalp, Sedat; Davulcu, Hasan; Sen, Arunabha; Corman, Steven; Woodward, Mark; Nair, Shreejay; Rohmaniyah, Inayah; Amin, Ali.

In: Social Network Analysis and Mining, Vol. 3, No. 3, 01.01.2013, p. 313-328.

Research output: Contribution to journalArticle

Tikves, Sukru ; Banerjee, Sujogya ; Temkit, Hamy ; Gokalp, Sedat ; Davulcu, Hasan ; Sen, Arunabha ; Corman, Steven ; Woodward, Mark ; Nair, Shreejay ; Rohmaniyah, Inayah ; Amin, Ali. / A system for ranking organizations using social scale analysis. In: Social Network Analysis and Mining. 2013 ; Vol. 3, No. 3. pp. 313-328.
@article{1654933c639b4df799e43027c912452a,
title = "A system for ranking organizations using social scale analysis",
abstract = "In this paper, we utilize feature extraction and model-fitting techniques to process the rhetoric found in the web sites of 23 Indonesian Islamic religious organizations to profile their ideology and activity patterns along a hypothesized radical/counter-radical scale, and present an end-to-end system that is able to help researchers to visualize the data in an interactive fashion on a timeline. The subject data of this study is 37,000 articles downloaded from the web sites of these organizations dating from 2001 to 2011. We develop algorithms to rank these organizations by assigning them to probable positions on the scale. We show that the developed Rasch model fits the data using Andersen’s LR-test. We create a gold standard of the ranking of these organizations through an expertise elicitation tool. We compute expert-to-expert agreements, and we present experimental results comparing the performance of three baseline methods to show that the Rasch model not only outperforms the baseline methods, but it is also the only system that performs at expert-level accuracy.",
author = "Sukru Tikves and Sujogya Banerjee and Hamy Temkit and Sedat Gokalp and Hasan Davulcu and Arunabha Sen and Steven Corman and Mark Woodward and Shreejay Nair and Inayah Rohmaniyah and Ali Amin",
year = "2013",
month = "1",
day = "1",
doi = "10.1007/s13278-012-0072-x",
language = "English (US)",
volume = "3",
pages = "313--328",
journal = "Social Network Analysis and Mining",
issn = "1869-5450",
publisher = "Springer Wien",
number = "3",

}

TY - JOUR

T1 - A system for ranking organizations using social scale analysis

AU - Tikves, Sukru

AU - Banerjee, Sujogya

AU - Temkit, Hamy

AU - Gokalp, Sedat

AU - Davulcu, Hasan

AU - Sen, Arunabha

AU - Corman, Steven

AU - Woodward, Mark

AU - Nair, Shreejay

AU - Rohmaniyah, Inayah

AU - Amin, Ali

PY - 2013/1/1

Y1 - 2013/1/1

N2 - In this paper, we utilize feature extraction and model-fitting techniques to process the rhetoric found in the web sites of 23 Indonesian Islamic religious organizations to profile their ideology and activity patterns along a hypothesized radical/counter-radical scale, and present an end-to-end system that is able to help researchers to visualize the data in an interactive fashion on a timeline. The subject data of this study is 37,000 articles downloaded from the web sites of these organizations dating from 2001 to 2011. We develop algorithms to rank these organizations by assigning them to probable positions on the scale. We show that the developed Rasch model fits the data using Andersen’s LR-test. We create a gold standard of the ranking of these organizations through an expertise elicitation tool. We compute expert-to-expert agreements, and we present experimental results comparing the performance of three baseline methods to show that the Rasch model not only outperforms the baseline methods, but it is also the only system that performs at expert-level accuracy.

AB - In this paper, we utilize feature extraction and model-fitting techniques to process the rhetoric found in the web sites of 23 Indonesian Islamic religious organizations to profile their ideology and activity patterns along a hypothesized radical/counter-radical scale, and present an end-to-end system that is able to help researchers to visualize the data in an interactive fashion on a timeline. The subject data of this study is 37,000 articles downloaded from the web sites of these organizations dating from 2001 to 2011. We develop algorithms to rank these organizations by assigning them to probable positions on the scale. We show that the developed Rasch model fits the data using Andersen’s LR-test. We create a gold standard of the ranking of these organizations through an expertise elicitation tool. We compute expert-to-expert agreements, and we present experimental results comparing the performance of three baseline methods to show that the Rasch model not only outperforms the baseline methods, but it is also the only system that performs at expert-level accuracy.

UR - http://www.scopus.com/inward/record.url?scp=84947282068&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84947282068&partnerID=8YFLogxK

U2 - 10.1007/s13278-012-0072-x

DO - 10.1007/s13278-012-0072-x

M3 - Article

VL - 3

SP - 313

EP - 328

JO - Social Network Analysis and Mining

JF - Social Network Analysis and Mining

SN - 1869-5450

IS - 3

ER -