You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
On executing phi3-qa.py using the latest commits on this script, execution of phi3.5-mini model fails.
I get the error:
$python3 phi3-qa.py -m cpu_and_mobile/cpu-int4-rtn=block-32-acc-level-4
Input: Hello, how are you?
Traceback (most recent call last):
File "/home/user/phi3-qa.py", line 92, in main(args)
File "/home/user/phi3-qa.py", line 42, in main
generator = og.Generator(model,params)
RuntimeError: input_ids not set in GeneratorParams
if i revert this change 'generator.append_tokens(input_tokens)' with params.input_ids = input_tokens and generator.compute_logits(), it works without any issues.
I am using Ubuntu 22.04 with ort v1.20.1 and gen-ai v0.5.2
The text was updated successfully, but these errors were encountered:
On executing phi3-qa.py using the latest commits on this script, execution of phi3.5-mini model fails.
I get the error:
if i revert this change 'generator.append_tokens(input_tokens)' with params.input_ids = input_tokens and generator.compute_logits(), it works without any issues.
I am using Ubuntu 22.04 with ort v1.20.1 and gen-ai v0.5.2
The text was updated successfully, but these errors were encountered: