You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the issue
When we do the evaluation, do we have some checker that checks the semantic consistency of the parameters instead of simply matching them from the candidate list?
It seems too harsh that some minor errors that lead to errors, such as San Diego and San Diego, CA are different in format, but the two are semantically consistent.
What's more, like this error "Invalid value for parameter 'items': ['pumpkin', 'egg']. Expected one of [['pumpkins', 'eggs'], ['pumpkin', 'dozen eggs']]."
Looking forward to your reply.
The text was updated successfully, but these errors were encountered:
Describe the issue
When we do the evaluation, do we have some checker that checks the semantic consistency of the parameters instead of simply matching them from the candidate list?
It seems too harsh that some minor errors that lead to errors, such as San Diego and San Diego, CA are different in format, but the two are semantically consistent.
What's more, like this error "Invalid value for parameter 'items': ['pumpkin', 'egg']. Expected one of [['pumpkins', 'eggs'], ['pumpkin', 'dozen eggs']]."
Looking forward to your reply.
The text was updated successfully, but these errors were encountered: