Add ForEachItem
core task to split a file from internal storage and create a subflow execution for each item or a batch of items
#2131
Labels
enhancement
New feature or request
Feature description
Problem
Users often fetch data from a source system, e.g.:
iterable rows
iterable list of items
from the API payload, typically downloaded as JSON or a CSV fileThen, they want to execute a series of steps for each item, ideally by executing a subflow.
Current solution
The Split task allows to split an ION file into batches of rows. Then, the user may iterate over those in
EachParallel
task that triggers a subflow with theFlow
task.Problems with this approach:
Split
,EachParallel
,Flow
tasks)Possible implementation
Add a new
ForEachItem
task to the core library.This task will split an input file into one of the following:
items
or rows so that one subflow execution can be triggered per itemBatches of items
or rows so that one subflow execution can be triggered per batch of items (e.g. one execution for a batch of 1000 rows/items)Syntax proposal
UI changes
When it comes to technical implementation, we might leverage an internally generated
label
to filter executions created from a specific parent execution.related to #796
The text was updated successfully, but these errors were encountered: