Assessing population structure

FST and related measures

Patrick G. Meirmans, Philip W. Hedrick

Research output: Contribution to journalArticle

602 Citations (Scopus)

Abstract

Although FST is widely used as a measure of population structure, it has been criticized recently because of its dependency on within-population diversity. This dependency can lead to difficulties in interpretation and in the comparison of estimates among species or among loci and has led to the development of two replacement statistics, F'ST and D. F'ST is the normal FST standardized by the maximum value it can obtain, given the observed within-population diversity. D uses a multiplicative partitioning of diversity, based on the effective number of alleles rather than on the expected heterozygosity. In this study, we review the relationships between the three classes of statistics (FST, F'ST and D), their estimation and their properties. We illustrate the relationships between the statistics using a data set of estimates from 84 species taken from the last 4 years of Molecular Ecology. As with FST, unbiased estimators are available for the two new statistics D and F'ST. Here, we develop a new unbiased F'ST estimator based on GST, which we call G''ST. However, F'ST can be calculated using any FST estimator for which the maximum value can be obtained. As all three statistics have their advantages and their drawbacks, we recommend continued use of FST in combination with either F'ST or D. In most cases, F'ST would be the best choice among the latter two as it is most suited for inferences of the influence of demographic processes such as genetic drift and migration on genetic population structure.

Original languageEnglish (US)
Pages (from-to)5-18
Number of pages14
JournalMolecular Ecology Resources
Volume11
Issue number1
DOIs
StatePublished - Jan 2011

Fingerprint

population structure
statistics
Population
Genetic Drift
molecular ecology
Genetic Structures
genetic drift
Ecology
heterozygosity
allele
demographic statistics
partitioning
replacement
Alleles
Demography
alleles
ecology
loci

Keywords

  • D
  • F-statistics
  • Fixation
  • G'
  • Heterozygosity
  • Population differentiation

ASJC Scopus subject areas

  • Ecology, Evolution, Behavior and Systematics
  • Biotechnology
  • Genetics

Cite this

Assessing population structure : FST and related measures. / Meirmans, Patrick G.; Hedrick, Philip W.

In: Molecular Ecology Resources, Vol. 11, No. 1, 01.2011, p. 5-18.

Research output: Contribution to journalArticle

Meirmans, Patrick G. ; Hedrick, Philip W. / Assessing population structure : FST and related measures. In: Molecular Ecology Resources. 2011 ; Vol. 11, No. 1. pp. 5-18.
@article{490b7e64fdd34e7b85655ef99506c6f6,
title = "Assessing population structure: FST and related measures",
abstract = "Although FST is widely used as a measure of population structure, it has been criticized recently because of its dependency on within-population diversity. This dependency can lead to difficulties in interpretation and in the comparison of estimates among species or among loci and has led to the development of two replacement statistics, F'ST and D. F'ST is the normal FST standardized by the maximum value it can obtain, given the observed within-population diversity. D uses a multiplicative partitioning of diversity, based on the effective number of alleles rather than on the expected heterozygosity. In this study, we review the relationships between the three classes of statistics (FST, F'ST and D), their estimation and their properties. We illustrate the relationships between the statistics using a data set of estimates from 84 species taken from the last 4 years of Molecular Ecology. As with FST, unbiased estimators are available for the two new statistics D and F'ST. Here, we develop a new unbiased F'ST estimator based on GST, which we call G''ST. However, F'ST can be calculated using any FST estimator for which the maximum value can be obtained. As all three statistics have their advantages and their drawbacks, we recommend continued use of FST in combination with either F'ST or D. In most cases, F'ST would be the best choice among the latter two as it is most suited for inferences of the influence of demographic processes such as genetic drift and migration on genetic population structure.",
keywords = "D, F-statistics, Fixation, G', Heterozygosity, Population differentiation",
author = "Meirmans, {Patrick G.} and Hedrick, {Philip W.}",
year = "2011",
month = "1",
doi = "10.1111/j.1755-0998.2010.02927.x",
language = "English (US)",
volume = "11",
pages = "5--18",
journal = "Molecular Ecology Resources",
issn = "1755-098X",
publisher = "Wiley-Blackwell",
number = "1",

}

TY - JOUR

T1 - Assessing population structure

T2 - FST and related measures

AU - Meirmans, Patrick G.

AU - Hedrick, Philip W.

PY - 2011/1

Y1 - 2011/1

N2 - Although FST is widely used as a measure of population structure, it has been criticized recently because of its dependency on within-population diversity. This dependency can lead to difficulties in interpretation and in the comparison of estimates among species or among loci and has led to the development of two replacement statistics, F'ST and D. F'ST is the normal FST standardized by the maximum value it can obtain, given the observed within-population diversity. D uses a multiplicative partitioning of diversity, based on the effective number of alleles rather than on the expected heterozygosity. In this study, we review the relationships between the three classes of statistics (FST, F'ST and D), their estimation and their properties. We illustrate the relationships between the statistics using a data set of estimates from 84 species taken from the last 4 years of Molecular Ecology. As with FST, unbiased estimators are available for the two new statistics D and F'ST. Here, we develop a new unbiased F'ST estimator based on GST, which we call G''ST. However, F'ST can be calculated using any FST estimator for which the maximum value can be obtained. As all three statistics have their advantages and their drawbacks, we recommend continued use of FST in combination with either F'ST or D. In most cases, F'ST would be the best choice among the latter two as it is most suited for inferences of the influence of demographic processes such as genetic drift and migration on genetic population structure.

AB - Although FST is widely used as a measure of population structure, it has been criticized recently because of its dependency on within-population diversity. This dependency can lead to difficulties in interpretation and in the comparison of estimates among species or among loci and has led to the development of two replacement statistics, F'ST and D. F'ST is the normal FST standardized by the maximum value it can obtain, given the observed within-population diversity. D uses a multiplicative partitioning of diversity, based on the effective number of alleles rather than on the expected heterozygosity. In this study, we review the relationships between the three classes of statistics (FST, F'ST and D), their estimation and their properties. We illustrate the relationships between the statistics using a data set of estimates from 84 species taken from the last 4 years of Molecular Ecology. As with FST, unbiased estimators are available for the two new statistics D and F'ST. Here, we develop a new unbiased F'ST estimator based on GST, which we call G''ST. However, F'ST can be calculated using any FST estimator for which the maximum value can be obtained. As all three statistics have their advantages and their drawbacks, we recommend continued use of FST in combination with either F'ST or D. In most cases, F'ST would be the best choice among the latter two as it is most suited for inferences of the influence of demographic processes such as genetic drift and migration on genetic population structure.

KW - D

KW - F-statistics

KW - Fixation

KW - G'

KW - Heterozygosity

KW - Population differentiation

UR - http://www.scopus.com/inward/record.url?scp=78650079113&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=78650079113&partnerID=8YFLogxK

U2 - 10.1111/j.1755-0998.2010.02927.x

DO - 10.1111/j.1755-0998.2010.02927.x

M3 - Article

VL - 11

SP - 5

EP - 18

JO - Molecular Ecology Resources

JF - Molecular Ecology Resources

SN - 1755-098X

IS - 1

ER -