Doesn't continue training from checkpoint.

[ailgun]

Hello,

I'm having a minor issue when trying to continue an interrupted training.

It is creating these files in /tmp/ as it's supposed to:

And these under model/NewPokemon in my working directory:

On other code I worked on, I would import the saved weights and biases with something like;

saver = tf.train.import_meta_graph('model.meta')
saver.restore(sess, tf.train.latest_checkpoint('./'))

On this code I just couldn't make it continue from where it is left off. It starts from 0 back again when I run PokeGAN.py even though I'm running inside the directory and the folder structure seems correct.

I haven't modified the code except the fact that, mine saves the model every epoch instead of every 500 - just changed the modulo i%500 to i%1.

Any help would be much appreciated.

Thanks very much!

[b3nh]

@ailgun did you ever resolve this problem and get training to continue after interruption? I'm facing similar issue

[ailgun]

@arklabco Nope, sorry! I've decided to learn more by following a few tutorials online and creating a simple GAN but using NVIDIAs code for actual training :-)

[schlonja]

Have encountered the same problem. Has anyone solved it?