Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

how to load checkpoint? #27

Closed
susht3 opened this issue Nov 17, 2018 · 4 comments
Closed

how to load checkpoint? #27

susht3 opened this issue Nov 17, 2018 · 4 comments

Comments

@susht3
Copy link

susht3 commented Nov 17, 2018

i download the model from bert, it only has model.ckpt.data,model.ckpt.meta and model.ckpt.index, i donnot which to load, what is checkpoint file for convert.py?

@susht3
Copy link
Author

susht3 commented Nov 17, 2018

Converting TensorFlow checkpoint from ../dataset/bert/uncased_L-12_H-768_A-12/bert_model
Traceback (most recent call last):
File "convert_tf_checkpoint_to_pytorch.py", line 111, in
convert()
File "convert_tf_checkpoint_to_pytorch.py", line 60, in convert
init_vars = tf.train.list_variables(path)
File "/home/susht3/local/anaconda3/envs/susht/lib/python3.6/site-packages/tensorflow/python/training/checkpoint_utils.py", line 95, in list_variables
reader = load_checkpoint(ckpt_dir_or_file)
File "/home/susht3/local/anaconda3/envs/susht/lib/python3.6/site-packages/tensorflow/python/training/checkpoint_utils.py", line 64, in load_checkpoint
return pywrap_tensorflow.NewCheckpointReader(filename)
File "/home/susht3/local/anaconda3/envs/susht/lib/python3.6/site-packages/tensorflow/python/pywrap_tensorflow_internal.py", line 326, in NewCheckpointReader
return CheckpointReader(compat.as_bytes(filepattern), status)
File "/home/susht3/local/anaconda3/envs/susht/lib/python3.6/site-packages/tensorflow/python/framework/errors_impl.py", line 528, in exit
c_api.TF_GetCode(self.status.status))
tensorflow.python.framework.errors_impl.NotFoundError: Unsuccessful TensorSliceReader constructor: Failed to find any matching files for ../dataset/bert/uncased_L-12_H-768_A-12/bert_model

@susht3 susht3 closed this as completed Nov 17, 2018
stevezheng23 added a commit to stevezheng23/transformers that referenced this issue Mar 24, 2020
* update kd-quac runner to support ensemble evaluation

* update kd-quac runner to support ensemble evaluation (cont.)

* fix kd issues in kd-quac runner

* update codalab submission pipeline to support single model & ensemble

* update codalab submission pipeline to support single model & ensemble (cont.)

* update codalab submission pipeline to support single model & ensemble (cont.)

* update codalab submission pipeline to support single model & ensemble (cont.) (huggingface#27)

* update codalab submission pipeline to support single model & ensemble (cont.)
@danyaljj
Copy link
Contributor

@susht3 what was your fix?

@dan-hu-spring
Copy link

I encountered a similar issue and didn't find a solution with ALBERT. I tried using the export_checkpoint.py file in ALBERT and sent that into the convert_tf_checkpoint_to_pytorch command and there was no error. However the resulting pytorch.bin output was unusable :\

@LysandreJik
Copy link
Member

@dan-hu-spring do you mind opening a new issue with your issue, so that we may take a look?

jameshennessytempus pushed a commit to jameshennessytempus/transformers that referenced this issue Jun 1, 2023
ZYC-ModelCloud pushed a commit to ZYC-ModelCloud/transformers that referenced this issue Nov 14, 2024
ZYC-ModelCloud pushed a commit to ZYC-ModelCloud/transformers that referenced this issue Nov 14, 2024
* initial attempt to add phi 3 (may need unfuse)

* fix Phi3GPTQ base_modules

---------

Co-authored-by: David Xue <xuegdxw@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants