MLED: A Layered Architecture for Reducing Undetected Error Probability in File Transfer

Arash Sarabi; Ibrahim Matta; Violet R. Syrotiuk

doi:10.1109/LCOMM.2021.3105096

MLED: A Layered Architecture for Reducing Undetected Error Probability in File Transfer

Arash Sarabi, Ibrahim Matta, Violet R. Syrotiuk

Research output: Contribution to journal › Article › peer-review

Abstract

Reliability in petabyte-scale file transfers is critical for data collected from scientific instruments. We introduce a Multi-Layer Error Detection (MLED) architecture that significantly reduces the Undetected Error Probability (UEP) in file transfer. MLED is parameterized by a number of layers $n$ , and a policy $P{i}$ for each layer $1 \le i \le n$ that describes its operation. MLED generalizes existing error detection approaches used in file transfer. We show conditions under which MLED reduces UEP. Analytical results show that a petabyte-size file transfer in MLED with $n=2$ using CRC-32s improves UEP by $2.49E\,+\,28$ compared to a single-layer CRC-64, when the BER is 10-10.

Original language	English (US)
Pages (from-to)	3542-3545
Number of pages	4
Journal	IEEE Communications Letters
Volume	25
Issue number	11
DOIs	https://doi.org/10.1109/LCOMM.2021.3105096
State	Published - Nov 1 2021

Keywords

Large-scale data transfer
cost/performance analysis
high-speed wide area network
multi-layer error detection
recursive architecture

ASJC Scopus subject areas

Modeling and Simulation
Computer Science Applications
Electrical and Electronic Engineering

Access to Document

10.1109/LCOMM.2021.3105096

Cite this

@article{589dc0da35a64124bc954a01bc178c44,

title = "MLED: A Layered Architecture for Reducing Undetected Error Probability in File Transfer",

abstract = "Reliability in petabyte-scale file transfers is critical for data collected from scientific instruments. We introduce a Multi-Layer Error Detection (MLED) architecture that significantly reduces the Undetected Error Probability (UEP) in file transfer. MLED is parameterized by a number of layers $n$ , and a policy $P{i}$ for each layer $1 \le i \le n$ that describes its operation. MLED generalizes existing error detection approaches used in file transfer. We show conditions under which MLED reduces UEP. Analytical results show that a petabyte-size file transfer in MLED with $n=2$ using CRC-32s improves UEP by $2.49E\,+\,28$ compared to a single-layer CRC-64, when the BER is 10-10.",

keywords = "Large-scale data transfer, cost/performance analysis, high-speed wide area network, multi-layer error detection, recursive architecture",

author = "Arash Sarabi and Ibrahim Matta and Syrotiuk, {Violet R.}",

note = "Publisher Copyright: {\textcopyright} 1997-2012 IEEE.",

year = "2021",

month = nov,

day = "1",

doi = "10.1109/LCOMM.2021.3105096",

language = "English (US)",

volume = "25",

pages = "3542--3545",

journal = "IEEE Communications Letters",

issn = "1089-7798",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

number = "11",

}

TY - JOUR

T1 - MLED

T2 - A Layered Architecture for Reducing Undetected Error Probability in File Transfer

AU - Sarabi, Arash

AU - Matta, Ibrahim

AU - Syrotiuk, Violet R.

PY - 2021/11/1

Y1 - 2021/11/1

N2 - Reliability in petabyte-scale file transfers is critical for data collected from scientific instruments. We introduce a Multi-Layer Error Detection (MLED) architecture that significantly reduces the Undetected Error Probability (UEP) in file transfer. MLED is parameterized by a number of layers $n$ , and a policy $P{i}$ for each layer $1 \le i \le n$ that describes its operation. MLED generalizes existing error detection approaches used in file transfer. We show conditions under which MLED reduces UEP. Analytical results show that a petabyte-size file transfer in MLED with $n=2$ using CRC-32s improves UEP by $2.49E\,+\,28$ compared to a single-layer CRC-64, when the BER is 10-10.

AB - Reliability in petabyte-scale file transfers is critical for data collected from scientific instruments. We introduce a Multi-Layer Error Detection (MLED) architecture that significantly reduces the Undetected Error Probability (UEP) in file transfer. MLED is parameterized by a number of layers $n$ , and a policy $P{i}$ for each layer $1 \le i \le n$ that describes its operation. MLED generalizes existing error detection approaches used in file transfer. We show conditions under which MLED reduces UEP. Analytical results show that a petabyte-size file transfer in MLED with $n=2$ using CRC-32s improves UEP by $2.49E\,+\,28$ compared to a single-layer CRC-64, when the BER is 10-10.

KW - Large-scale data transfer

KW - cost/performance analysis

KW - high-speed wide area network

KW - multi-layer error detection

KW - recursive architecture

UR - http://www.scopus.com/inward/record.url?scp=85113196018&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85113196018&partnerID=8YFLogxK

U2 - 10.1109/LCOMM.2021.3105096

DO - 10.1109/LCOMM.2021.3105096

M3 - Article

AN - SCOPUS:85113196018

SN - 1089-7798

VL - 25

SP - 3542

EP - 3545

JO - IEEE Communications Letters

JF - IEEE Communications Letters

IS - 11

ER -

MLED: A Layered Architecture for Reducing Undetected Error Probability in File Transfer

Abstract

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this