4.5 Article

AutoRank: Automated Rank Selection for Effective Neural Network Customization

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/JETCAS.2021.3127433

Keywords

Hardware; Tensors; Costs; Runtime; Matrix decomposition; Training; Field programmable gate arrays; Computational and artificial intelligence; neural networks; artificial neural networks

Funding

  1. National Science Foundation (NSF) [2016737]
  2. Semiconductor Research Corporation (SRC) [2899.001]
  3. Intelligence Advanced Research Projects Activity (IARPA) [2018-18022100004]
  4. Intel Private AI Institute
  5. Direct For Computer & Info Scie & Enginr
  6. Division Of Computer and Network Systems [2016737] Funding Source: National Science Foundation

Ask authors/readers for more resources

Tensor decomposition is a promising method for implementing low-power and real-time neural network applications on resource-constrained embedded devices. The proposed AutoRank framework allows customization of neural network decomposition through cross-layer rank selection, incorporating both inference accuracy and platform specifications while minimizing engineering costs. This framework is hardware-aware and delivers high accuracy decomposed deep neural networks with low execution costs, with an automated API for compatibility with popular deep learning libraries.
Tensor decomposition is a promising approach for low-power and real-time application of neural networks on resource-constrained embedded devices. This paper proposes AutoRank, an end-to-end framework for customizing neural network decomposition using cross-layer rank-selection. For many-layer networks, determining the optimal decomposition ranks is a cumbersome task. To overcome this challenge, we establish a state-action-reward system that effectively absorbs inference accuracy and platform specifications into the rank-selection policy. Our proposed framework brings platform characteristics and performance in the customization loop to enable direct incorporation of hardware cost, e.g., runtime and memory footprint. By means of this hardware-awareness, AutoRank customization engine delivers high accuracy decomposed deep neural networks with low execution cost. Our framework minimizes the engineering cost associated with rank selection by providing an automated API for AutoRank that is compatible with popular deep learning libraries and can be readily used by developers.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.5
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available