Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Port FNet #1164

Merged
merged 3 commits into from
Jul 27, 2023
Merged

Port FNet #1164

merged 3 commits into from
Jul 27, 2023

Conversation

abheesht17
Copy link
Collaborator

@abheesht17 abheesht17 commented Jul 19, 2023

Resolves #1139

@mattdangerw mattdangerw self-requested a review July 20, 2023 17:37
Copy link
Member

@mattdangerw mattdangerw left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good! I think we will have to stop pinning the keras-core version before we can do this. At least one more bug to work through there.

x = tf.cast(input, tf.complex64)
mixing_output = tf.math.real(tf.signal.fft2d(x))
return tf.cast(mixing_output, input.dtype)
x = (input, ops.zeros_like(input))
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe make it clearer the real, imaginary split?

real_in, imaginary_in = (input, ops.zeros_like(input))
real_out, imaginary_out = ops.fft2((real_in, imaginary_in))
return real_out

@mattdangerw
Copy link
Member

I think we should be all clear to land this now. Trying it out.

@mattdangerw
Copy link
Member

/gcbrun

@mattdangerw
Copy link
Member

/gcbrun

@mattdangerw
Copy link
Member

/gcbrun

@mattdangerw
Copy link
Member

/gcbrun

@mattdangerw
Copy link
Member

I think we can ignore the tf GPU OOM, unrelated.

@mattdangerw mattdangerw merged commit 64b7d65 into keras-team:master Jul 27, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Port FNet to multi-backend Keras
2 participants