TY - JOUR
T1 - On Achieving Zero Delay with Power-of-d-Choices Load Balancing
AU - Liu, Xin
AU - Ying, Lei
N1 - Funding Information:
This work was supported in part by NSF ECCS-1547294, ECCS-1609202, ECCS-1739344, CNS-1824393 and CNS- 1813392 and the U.S. Office of Naval Research (ONR Grant No. N00014-15-1-2169).
Funding Information:
This work was supported in part by NSF ECCS-1547294, ECCS-1609202, ECCS-1739344, CNS-1824393 and CNS-1813392 and the U.S. Office of Naval Research (ONR Grant No. N00014-15-1-2169).
Publisher Copyright:
© 2013 IEEE.
PY - 2019/10/1
Y1 - 2019/10/1
N2 - Power-of-d-choices is a popular load balancing algorithm for many-server systems such as large-scale data centers. For each incoming job, the algorithm probes d servers, chosen uniformly at random from a total of N servers (N is the number of servers in the system), and routes the job to the least loaded one. It is well known that power-of-d-choices reduces queueing delays by orders of magnitude compared to the policy that routes each incoming job to a randomly selected server. The question to be addressed in this paper is how large d needs to be so that power-of-d-choices achieves asymptotic zero delay like the join-the-shortest-queue (JSQ) algorithm, which is a special case of power-of-d-choices with d=N. We are interested in the heavy-traffic regime where the load of the system, denoted by λ, approaches to one as N increases, and assume λ =1-γ N-α for 0<γ <1. This paper establishes that when d=Ω log N 1-λ, finite buffer size b and 0 α 1/6, the probability that an incoming job is routed to a busy server is asymptotically zero, i.e., a job experiences zero queueing delay with probability one asymptotically; and when d=O\left(\frac{1}{1-\lambda }\right) and infinite buffer size b=∞, the probability that a job is routed to a busy server is lower bounded by a positive constant independent of N. Therefore, our results show that d=Ω \left(\frac{\log N}{1-λ }\right) is sufficient and almost necessary for achieving zero delay with the power-of-d-choices policy.
AB - Power-of-d-choices is a popular load balancing algorithm for many-server systems such as large-scale data centers. For each incoming job, the algorithm probes d servers, chosen uniformly at random from a total of N servers (N is the number of servers in the system), and routes the job to the least loaded one. It is well known that power-of-d-choices reduces queueing delays by orders of magnitude compared to the policy that routes each incoming job to a randomly selected server. The question to be addressed in this paper is how large d needs to be so that power-of-d-choices achieves asymptotic zero delay like the join-the-shortest-queue (JSQ) algorithm, which is a special case of power-of-d-choices with d=N. We are interested in the heavy-traffic regime where the load of the system, denoted by λ, approaches to one as N increases, and assume λ =1-γ N-α for 0<γ <1. This paper establishes that when d=Ω log N 1-λ, finite buffer size b and 0 α 1/6, the probability that an incoming job is routed to a busy server is asymptotically zero, i.e., a job experiences zero queueing delay with probability one asymptotically; and when d=O\left(\frac{1}{1-\lambda }\right) and infinite buffer size b=∞, the probability that a job is routed to a busy server is lower bounded by a positive constant independent of N. Therefore, our results show that d=Ω \left(\frac{\log N}{1-λ }\right) is sufficient and almost necessary for achieving zero delay with the power-of-d-choices policy.
KW - Power-of-d-choices
KW - heavy traffic
KW - mean-field model
UR - http://www.scopus.com/inward/record.url?scp=85055692582&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85055692582&partnerID=8YFLogxK
U2 - 10.1109/TNSE.2018.2878403
DO - 10.1109/TNSE.2018.2878403
M3 - Article
AN - SCOPUS:85055692582
VL - 6
SP - 909
EP - 916
JO - IEEE Transactions on Network Science and Engineering
JF - IEEE Transactions on Network Science and Engineering
SN - 2327-4697
IS - 4
M1 - 8510844
ER -