Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

vector-valued Hessian #47

Open
naodell opened this issue May 6, 2019 · 1 comment
Open

vector-valued Hessian #47

naodell opened this issue May 6, 2019 · 1 comment

Comments

@naodell
Copy link

naodell commented May 6, 2019

I use the Hessian tool to calculate the covariance matrix of a cost function (NLL). The NLL is calculated for multiple categories of data and then combined in a single number currently, but I would like to be able to factorize the Hessian of the NLL to account for the variance in each of the data categories. I know I could carry it out in each category independently, but I would then lose sensitivity to the parameter's correlations between the individual categories of data.

I would be willing to try to carry out the implementation myself if you could provide some guidance on how to get started.

Thanks!

@pbrod
Copy link
Owner

pbrod commented Apr 28, 2021

Isn't that what the Hessian wrapper class do already? The Hessian wrapper computes the Hessian matrix of the scalar function f with respect to a vector constructed from all variables (data categories) found in f:

\begin{align*}
(\Hessian f)_{ij} &\equiv \frac{\partial^{2} f}{\partial x_{i} \partial x_{j} }
\end{align*}

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants