Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About how to use CDE in Variational Autoencoders? #43

Closed
Saltsmart opened this issue Apr 11, 2022 · 1 comment
Closed

About how to use CDE in Variational Autoencoders? #43

Saltsmart opened this issue Apr 11, 2022 · 1 comment

Comments

@Saltsmart
Copy link

Hello, Mr Kidger! This work gives me a lot insight!

I've create a repo Forecast (also mentioned in #39 ). It's not too hard to use CDE in Seq2Seq models, but how to use it in Variational Autoencoders?

Here is a qoutation about modeling uncertainty from your paper:

As presented here, Neural CDEs do not give any measure of uncertainty about their predictions. Such extensions are likely to be possible, given the close links between CDEs and SDEs, and existing work on Neural SDEs.

ODE_RNN arms GRU Cell which can model h_0 and h_0_std. The latter can be viewed as "uncertainty" and is crucial to VAE architecture. Are there related work for how to model uncertainty using CDE?

@patrick-kidger
Copy link
Owner

Have a read of Chapter 4 of On Neural Differential Equations.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants