Neural Architecture Search Survey: A Hardware Perspective
نویسندگان
چکیده
We review the problem of automating hardware-aware architectural design process Deep Neural Networks (DNNs). The field Convolutional Network (CNN) algorithm has led to advancements in many fields, such as computer vision, virtual reality, and autonomous driving. end-to-end a CNN is challenging time-consuming task, it requires expertise multiple areas signal image processing, neural networks, optimization. At same time, several hardware platforms, general- special-purpose, have equally contributed training deployment these complex networks different setting. Hardware-Aware Architecture Search (HW-NAS) automates DNNs alleviate human effort generate efficient models accomplishing acceptable accuracy-performance tradeoffs. goal this article provide insights understanding HW-NAS techniques for various platforms (MCU, CPU, GPU, ASIC, FPGA, ReRAM, DSP, VPU), followed by co-search methodologies accelerator specifications.
منابع مشابه
Neural Networks in Hardware: A Survey
Over the past decade a large variety of hardware has been designed to exploit the inherent parallelism of the artificial neural network models. This paper presents an overview of neural network hardware. Neural network basics, hardware specification and performance evaluation are introduced. Major categories of neural network architectures are reviewed. Two examples of neurohardware, CNAPS and ...
متن کاملProgressive Neural Architecture Search
We propose a method for learning CNN structures that is more efficient than previous approaches: instead of using reinforcement learning (RL) or genetic algorithms (GA), we use a sequential model-based optimization (SMBO) strategy, in which we search for architectures in order of increasing complexity, while simultaneously learning a surrogate function to guide the search, similar to A* search....
متن کاملDifferentiable Neural Network Architecture Search
The successes of deep learning in recent years has been fueled by the development of innovative new neural network architectures. However, the design of a neural network architecture remains a difficult problem, requiring significant human expertise as well as computational resources. In this paper, we propose a method for transforming a discrete neural network architecture space into a continu...
متن کاملA low-power hardware search architecture for speech recognition
High-performance speech recognition is extremely computationally expensive, limiting its use in the mobile domain. We therefore propose a low-power hardware speech recognition architecture for mobile applications, exploiting the orders-of-magnitude efficiency improvements dedicated hardware can offer. Our system is based on the Sphinx 3.0 software recognizer developed at Carnegie Mellon Univers...
متن کاملSurvey: Implementing Dense Neural Networks in Hardware
Neural networks are useful structures for enabling computers to learn and become better at complex activities such as pattern recognition and classification. When simulated in software, they are limited by the low levels of parallelism in today’s commodity processors. To run optimally, a hardware implementation is desirable. Unfortunately, most neural networks are extremely dense and contain ma...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: ACM Computing Surveys
سال: 2022
ISSN: ['0360-0300', '1557-7341']
DOI: https://doi.org/10.1145/3524500