You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
And then we don't provide market's closing time into LLM.
So, the current implementation works fine, but it could skip some markets unnecessarily.
So if want to stick to the rules, we should:
Don't require event date in the question itself.
Feed market's closing date to agents.
It sounds like a straightforward and fast thing to do, but I'm worried it could have some accuracy/profitability consequences.
Because if question contains event date but we also provide closing date to the agent, it could be confused about it and predict the event according to the wrong date.
We could do some if/elsing and use the closing date only if the question doesn't contain it already, because otherwise, closing date is theoretically irrelevant.
Practically, if closing date is too much in the future, agent will have the funds locked in there.
The text was updated successfully, but these errors were encountered:
Note that the rules on the new default Arbitrator, 31 Jurors that was setup here, are different from the ones you referenced in your issue. So, if they're different (they're pretty similar but there might be differences?) those two need to be juggled simultaneously?
Good point, thanks! Yeah, it needs to be checked when this issue is implemented. Worst-case, we will need to accept the Arbitrator enum and make differences based on that.
From the rules:
Currently, we filter out questions without event date in them here https://github.com/gnosis/prediction-market-agent-tooling/blob/main/prediction_market_agent_tooling/tools/is_predictable.py#L16.
And then we don't provide market's closing time into LLM.
So, the current implementation works fine, but it could skip some markets unnecessarily.
So if want to stick to the rules, we should:
It sounds like a straightforward and fast thing to do, but I'm worried it could have some accuracy/profitability consequences.
Because if question contains event date but we also provide closing date to the agent, it could be confused about it and predict the event according to the wrong date.
We could do some if/elsing and use the closing date only if the question doesn't contain it already, because otherwise, closing date is theoretically irrelevant.
Practically, if closing date is too much in the future, agent will have the funds locked in there.
The text was updated successfully, but these errors were encountered: