Neural Network Panning: Screening the Optimal Sparse Network Before Training

نویسندگان

چکیده

Pruning on neural networks before training not only compresses the original models, but also accelerates network phase, which has substantial application value. The current work focuses fine-grained pruning, uses metrics to calculate weight scores for screening, and extends from initial single-order pruning iterative pruning. Through these works, we argue that can be summarized as an expressive force transfer process of weights, where reserved weights will take removed ones purpose maintaining performance networks. In order achieve optimal scheduling, propose a scheme called Neural Network Panning guides through multi-index multi-process steps, designs kind panning agent based reinforcement learning automate processes. Experimental results show performs better than various available methods. Our code is made public at: https://github.com/kangxiatao/RLPanning.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Lecture Notes in Computer Science

سال: 2023

ISSN: ['1611-3349', '0302-9743']

DOI: https://doi.org/10.1007/978-3-031-26319-4_36