Abstract

Construction of robust and accurate deep neural networks (DNNs) is a computationally demanding and time-consuming process. Such networks also end up being memory intensive. Today, there is ever-increasing need to provide proactive and personalized support for users of smart devices. We could provide better personalization if we have the ability to update/train the DNN on edge devices. Also, by moving some computation to the edge of the cloud infrastructure, we could reduce the load on computing clusters, thus providing them more resources to handle core and complex tasks. To this end, weight pruning for DNNs has been proposed to reduce their storage footprint by an order of magnitude. However, it is yet unclear as to how to update/re-train DNNs once they are deployed on mobile devices. In this paper, we introduce the concept of re-training of pruned networks that should aid personalization of smart devices as well as increase their fault tolerance. We assume that the data used to re-train the pruned network comes from a distribution similar to what used in the original, unpruned network. We propose various strategies for pruning and re-training the networks and show that we may obtain a significant improvement on the new data while minimizing the reduction in performance on the original data.

Original languageEnglish (US)
Title of host publicationProceedings - 2017 IEEE 1st International Conference on Edge Computing, EDGE 2017
EditorsAndrzej M Goscinski, Min Luo
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages244-247
Number of pages4
ISBN (Electronic)9781538620175
DOIs
StatePublished - Sep 7 2017
Event1st IEEE International Conference on Edge Computing, EDGE 2017 - Honolulu, United States
Duration: Jun 25 2017Jun 30 2017

Publication series

NameProceedings - 2017 IEEE 1st International Conference on Edge Computing, EDGE 2017

Other

Other1st IEEE International Conference on Edge Computing, EDGE 2017
CountryUnited States
CityHonolulu
Period6/25/176/30/17

Keywords

  • Deep neural network
  • Edge computing
  • Personalization
  • Weight pruning

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Hardware and Architecture

Fingerprint Dive into the research topics of 'Strategies for Re-Training a Pruned Neural Network in an Edge Computing Paradigm'. Together they form a unique fingerprint.

  • Cite this

    Chandakkar, P. S., Li, Y., Ding, P. L. K., & Li, B. (2017). Strategies for Re-Training a Pruned Neural Network in an Edge Computing Paradigm. In A. M. Goscinski, & M. Luo (Eds.), Proceedings - 2017 IEEE 1st International Conference on Edge Computing, EDGE 2017 (pp. 244-247). [8029286] (Proceedings - 2017 IEEE 1st International Conference on Edge Computing, EDGE 2017). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IEEE.EDGE.2017.45