Influence Function Based Second-Order Channel Pruning-Evaluating True Loss Changes For Pruning Is Possible Without Retraining
It motivates us to develop a technique to evaluate true loss changes without retraining, with which channels to prune can be selected more reliably and confidently.
Tags:Paper and LLMsPricing Type
- Pricing Type: Free
- Price Range Start($):
GitHub Link
The GitHub link is https://github.com/hrcheng1066/ifso
Introduce
The GitHub repository “IFSO” presents an approach for second-order channel pruning using influence functions. The method enables evaluating true loss changes without the need for retraining. The repository provides instructions to set up the environment, download the code, and replace certain files. It outlines steps for pre-training, pruning, and fine-tuning. The repository also acknowledges the contributions of related codes that served as the basis for this work.
Content

Related

LAMA utilizes a reinforcement learning framework combined with a motion matching algorithm. Reinforcement learning helps the model make appropriate decisions in various scenarios, while motion matching algorithms ensure that synthesized actions match real human actions. In addition, LAMA also utilizes the motion editing framework of manifold learning to cover various possible changes in interactions and operations.








