Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

疑惑:没有看到哪里执行了 text 2 tokens 的过程 #119

Open
EdwardChan5000 opened this issue May 18, 2023 · 1 comment
Open

Comments

@EdwardChan5000
Copy link

  1. 看到 _create_multimodal_bert_features 是被 m3tl_preproc_fn.py 通过 @preprocessing_fn 调用 decorator
  2. 应该是 input_fn.py 中 write_tfrecord 调用 chain_processed_data 的时候触发?
  3. 还是哪里?可以 q 一下相应调用
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants