Problem of inference part using GPU

[652994331]

Hi, nice job. I already used it and it's a good project. However, I'd like to ask, this is a bert projects with faster transformer right? Bert uses cpu for inference as default, how could your code used GPU. I mean can you show me the way to inference with GPU(where is these code or how to modify the original bert code) thank you