We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Hi,
The L1 and L2 regularisation for both the linear and logistic regression models includes the bias, rather than just the weights. e.g. as seen here: https://github.com/PyTorchLightning/lightning-bolts/blob/master/pl_bolts/models/regression/linear_regression.py#L61
The regularisation is commonly only applies to the weights and the bias remains unaffected. More discussion: https://stats.stackexchange.com/questions/86991/reason-for-not-shrinking-the-bias-intercept-term-in-regression?rq=1
The text was updated successfully, but these errors were encountered:
Hi! thanks for your contribution!, great first issue!
Sorry, something went wrong.
Successfully merging a pull request may close this issue.
Hi,
The L1 and L2 regularisation for both the linear and logistic regression models includes the bias, rather than just the weights.
e.g. as seen here:
https://github.com/PyTorchLightning/lightning-bolts/blob/master/pl_bolts/models/regression/linear_regression.py#L61
The regularisation is commonly only applies to the weights and the bias remains unaffected. More discussion:
https://stats.stackexchange.com/questions/86991/reason-for-not-shrinking-the-bias-intercept-term-in-regression?rq=1
The text was updated successfully, but these errors were encountered: