TY - JOUR
T1 - Energy and Loss-aware Selective Updating for SplitFed Learning with Energy Harvesting-Powered Devices
AU - Chen, Xing
AU - Li, Jingtao
AU - Chakrabarti, Chaitali
N1 - Publisher Copyright:
© 2022, The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature.
PY - 2022/10
Y1 - 2022/10
N2 - SplitFed learning (SFL) is a promising data-privacy preserving decentralized learning framework for IoT devices that has low computation requirement but high communication overhead. To reduce the communication overhead, we present a selective model update method that sends/receives activations/gradients only in selected epochs. However for IoT devices that are powered by harvested energy, the client-side model computations can take place only when the harvested energy can support it. So in this paper, we propose an energy+loss-aware selective updating method for SFL systems where the client-side model is updated based on both the clients’ energy and loss changes. When all clients have the same energy harvesting capability, we show that the proposed method can save energy by 43.7% to 80.5% with 0.5% drop in accuracy compared to an energy-aware method for VGG11 and ResNet20 models on CIFAR-10 and CIFAR-100 datasets. When the energy harvesting capability of the clients are different, the proposed method can save energy by up to 28.8% to 70.0% with 0.5% drop in accuracy.
AB - SplitFed learning (SFL) is a promising data-privacy preserving decentralized learning framework for IoT devices that has low computation requirement but high communication overhead. To reduce the communication overhead, we present a selective model update method that sends/receives activations/gradients only in selected epochs. However for IoT devices that are powered by harvested energy, the client-side model computations can take place only when the harvested energy can support it. So in this paper, we propose an energy+loss-aware selective updating method for SFL systems where the client-side model is updated based on both the clients’ energy and loss changes. When all clients have the same energy harvesting capability, we show that the proposed method can save energy by 43.7% to 80.5% with 0.5% drop in accuracy compared to an energy-aware method for VGG11 and ResNet20 models on CIFAR-10 and CIFAR-100 datasets. When the energy harvesting capability of the clients are different, the proposed method can save energy by up to 28.8% to 70.0% with 0.5% drop in accuracy.
KW - Decentralized machine learning
KW - Energy harvesting
KW - Split learning
UR - http://www.scopus.com/inward/record.url?scp=85133476358&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85133476358&partnerID=8YFLogxK
U2 - 10.1007/s11265-022-01781-4
DO - 10.1007/s11265-022-01781-4
M3 - Article
AN - SCOPUS:85133476358
SN - 1939-8018
JO - Journal of Signal Processing Systems
JF - Journal of Signal Processing Systems
ER -