On-Device Deep Learning for Mobile and Wearable Sensing Applications: A Review

Incel O. D., Bursa S. O.

IEEE Sensors Journal, cilt.23, sa.6, ss.5501-5512, 2023 (SCI-Expanded) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 23 Sayı: 6
  • Basım Tarihi: 2023
  • Doi Numarası: 10.1109/jsen.2023.3240854
  • Dergi Adı: IEEE Sensors Journal
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Aerospace Database, Communication Abstracts, Compendex, INSPEC, Metadex, Civil Engineering Abstracts
  • Sayfa Sayıları: ss.5501-5512
  • Anahtar Kelimeler: Sensors, Wearable computers, Deep learning, Data models, Computational modeling, Hardware, Training, Deep learning (DL), resource management, sensing, wearable devices
  • Galatasaray Üniversitesi Adresli: Evet

Özet

Although running deep learning algorithms is challenging due to resource constraints on mobile and wearable devices, they provide performance improvements compared to lightweight or shallow architectures. The widespread application areas for ondevice deep learning include computer vision, image processing, natural language processing, and audio classification. However, mobile and wearable sensing applications are also gaining attention. They can benefit from on-device deep learning, given that these devices are integrated with various sensors and produce large amounts of data. This paper reviews state-of-the-art studies on on-device deep learning for mobile and wearable devices, particularly from the sensor data analytics perspective. We first discuss the general optimization techniques of deep learning algorithms to meet the resource limitations of the devices. Then, we elaborate on model update and personalization techniques and review the studies by classifying them according to several aspects, including application areas, sensors, types of devices, utilized DL algorithms, mode of implementation, methods for optimizing DL algorithms for the target devices, training method, implementation toolkit/platform, performance metrics and resource consumption analysis. Finally, we discuss the open issues and future research directions about on-device deep learning for mobile and wearable sensing applications.