Skip to content
This repository has been archived by the owner on Jul 26, 2019. It is now read-only.

How to set up reading comprehension for BERT Keras #26

Open
Santosh-Gupta opened this issue Apr 20, 2019 · 0 comments
Open

How to set up reading comprehension for BERT Keras #26

Santosh-Gupta opened this issue Apr 20, 2019 · 0 comments

Comments

@Santosh-Gupta
Copy link

I am looking at section 4.2 of the BERT paper or how to set up BERT for reading comprehension. It looks like a module needs to be added to the end of BERT, S and E are new parameters, and a log softmax loss is calculated for the start and end positions.

This extension is included in the original tensorflow BERT in the 'run_squad.py' script in the repository.

Does does an extension exist for BERT Keras?

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant