4.7 Article

Optimized Power Control Design for Over-the-Air Federated Edge Learning

Journal

IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS
Volume 40, Issue 1, Pages 342-358

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/JSAC.2021.3126060

Keywords

Power control; Servers; Performance evaluation; Training; Convergence; Atmospheric modeling; Distortion; Federated learning; over-the-air computation; stochastic gradient descent; power control; edge intelligence

Funding

  1. Key Area Research and Development Program of Guangdong Province [2018B030338001]
  2. National Key Research and Development Program of China [2018YFB1800800]
  3. Shenzhen Outstanding Talents Training Fund
  4. Guangdong Research Project [2017ZT07X152]
  5. National Natural Science Foundation of China [U2001208, 61871137, 62001310]
  6. Science and Technology Program of Guangdong Province [2021A0505030002]

Ask authors/readers for more resources

The paper investigates transmission power control to combat against aggregation errors in Air-FEEL. It proposes a new power control design aiming at maximizing convergence speed by analyzing the convergence behavior of Air-FEEL subject to aggregation errors. Optimized power control is achieved to minimize optimality gaps under unbiased aggregation constraints, leading to significantly faster convergence compared to benchmark policies.
Over-the-air federated edge learning (Air-FEEL) has emerged as a communication-efficient solution to enable distributed machine learning over edge devices by using their data locally to preserve the privacy. By exploiting the waveform superposition property of wireless channels, Air-FEEL allows the one-shot over-the-air aggregation of gradient-updates to enhance the communication efficiency, but at the cost of a compromised learning performance due to the aggregation errors caused by channel fading and noise. This paper investigates the transmission power control to combat against such aggregation errors in Air-FEEL. Different from conventional power control designs (e.g., to minimize the individual mean squared error (MSE) of the over-the-air aggregation at each round), we consider a new power control design aiming at directly maximizing the convergence speed. Towards this end, we first analyze the convergence behavior of Air-FEEL (in terms of the optimality gap) subject to aggregation errors at different communication rounds. It is revealed that if the aggregation estimates are unbiased, then the training algorithm would converge exactly to the optimal point with mild conditions; while if they are biased, then the algorithm would converge with an error floor determined by the accumulated estimate bias over communication rounds. Next, building upon the convergence results, we optimize the power control to directly minimize the derived optimality gaps under the cases without and with unbiased aggregation constraints, subject to a set of average and maximum power constraints at individual edge devices. We transform both problems into convex forms, and obtain their structured optimal solutions, both appearing in a form of regularized channel inversion, by using the Lagrangian duality method. Finally, numerical results show that the proposed power control policies achieve significantly faster convergence for Air-FEEL, as compared with benchmark policies with fixed power transmission or conventional MSE minimization.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available