This is a flow evaluates: entity match rate.
Tools used in this flow:
python
tool
Install promptflow sdk and other dependencies:
pip install -r requirements.txt
# test with default input value in flow.dag.yaml
pf flow test --flow .
pf run create --flow . --data ./data.jsonl --column-mapping ground_truth='${data.ground_truth}' entities='${data.entities}' --stream
You can also skip providing column-mapping
if provided data has same column name as the flow.
Reference here for default behavior when column-mapping
not provided in CLI.