3.8 Proceedings Paper

To Talk or to Work: Flexible Communication Compression for Energy Efficient Federated Learning over Heterogeneous Mobile Edge Devices

Publisher

IEEE
DOI: 10.1109/INFOCOM42981.2021.9488839

Keywords

Federated Learning over Wireless Networks; Gradient Compression; Local SGD; Edge Computing on GPUs

Funding

  1. National Natural Science Foundation of China [61571351]
  2. State Key Laboratory of Computer Architecture (ICT, CAS) [CARCH201904]
  3. Major Research plan of the Shaanxi Science Foundation of China [2019ZDLGY12-08]
  4. 111 project [B16037]
  5. OPPO
  6. U.S. National Science Foundation [US CNS-1646607, CNS-1801925, CNS-2029569]
  7. NSF [EARS1839818, CNS-1717454, CNS-1731424, CNS-1702850]

Ask authors/readers for more resources

This work focuses on improving the energy efficiency of federated learning over mobile edge networks, enabling flexible communication compression while balancing the energy consumption of local computing and wireless communication. The developed algorithm and compression control scheme aim to adapt to various computing and communication environments of participating devices, showing efficacy in energy saving through extensive simulations.
Recent advances in machine learning, wireless communication, and mobile hardware technologies promisingly enable federated learning (FL) over massive mobile edge devices, which opens new horizons for numerous intelligent mobile applications. Despite the potential benefits, FL imposes huge communication and computation burdens on participating devices due to periodical global synchronization and continuous local training, raising great challenges to battery constrained mobile devices. In this work, we target at improving the energy efficiency of FL over mobile edge networks to accommodate heterogeneous participating devices without sacrificing the learning performance. To this end, we develop a convergence-guaranteed FL algorithm enabling flexible communication compression. Guided by the derived convergence bound, we design a compression control scheme to balance the energy consumption of local computing (i.e., working) and wireless communication (i.e., talking) from the long-term learning perspective. In particular, the compression parameters are elaborately chosen fir FL participants adapting to their computing and communication environments. Extensive simulations are conducted using various datasets to validate our theoretical analysis, and the results also demonstrate the efficacy of the proposed scheme in energy saving.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

3.8
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available