Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Some confusions about code #10

Open
zongjuede opened this issue Apr 19, 2019 · 1 comment
Open

Some confusions about code #10

zongjuede opened this issue Apr 19, 2019 · 1 comment

Comments

@zongjuede
Copy link

Thanks for your paper and sharing code. I have some confusions about code, can you explain it for me.

  1. In function channel_selection(), why the original model is replaced by pruned model? Is it since the loaded pre-trained model without fine-tuning.
  2. In function update_model, why the network is splited repeatly(the network will be split a time if the update_model() be called)?But the segment seems same after each split,
  3. Is it original net just be a baselone. Why origin net is continualy updated(line 503 in channel_pruning.py) if it is just be a baseline ?
    Thank you very much.
    Expect for yor reply.
@liujingcs
Copy link
Contributor

  1. To reduce the discrepancy between the original model and pruned model, we replace the original model with the fine-tuned model at the first stage.
  2. After channel selection, the pruned model has changed. Therefore, we need to update the pruned model in the trainer.
  3. Except in the first stage of fine-tuning, we fix the original model during channel pruning.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants