reflow1.31.0

• Handle partial failures when resizing EBS volumes.
• Update Flatcar AMIs.
• Add m7a and m7i instance types.

reflow1.29.0

Highlights from this release:

• Making the starting disk space of a reflowlet a function of its instance size
• Doubling the default fast resize factor

reflow1.27.0

• Remove extern caching and deprecate the “nocacheextern” flag. Users may still specify the flag, but its value will be ignored. Reflow will continue to avoid redundant copy operations while ensuring that deleted or corrupted files are re-written when a program is re-run.
• Add support for new EC2 instance types: C6a, C6id, G5, i4i, M6a, M6id, R6a, R6i, R6id, Trn1, X2idn, X2iedn, X2iezn.
• Resolve issue that prevented users from running reflow without TaskDB.

reflow1.26.0

Fix file descriptor leak in ReflowRunner.

Reflow v1.25.0

Highlights from this release

• Reflow exec failures include error hints in error message
• Upgrade to go 1.18.4
• Better OOM detection for failed reflow executions.
• Reflowlet facing integrity issues removes itself from the cluster
• Added support for start and end options to the reflow logs command.

Reflow v1.22.0

Notable features:

• Performance improvements in certain reflow execs (primarily due to reduction in unnecessary CPU usage)
• Support for comprehensions on dir types in reflow, which provide better performance than converting to lists or maps and then doing list/map comprehensions. Details below.

Dir comprehensions yield (path, file) pairs. For example, after running:

d := dir("/home/notes")
result := [ strings.Join([path, "has", strings.FromInt(len(f)), "bytes"], " ") | (path, f) <- d, if strings.HasSuffix(path, ".txt") ]

result contains a list of strings based on the files in /home/notes with the ".txt" extension, such as:
["foo.txt has 725 bytes", "bar.txt has 89 bytes", "zoo.txt has 7061 bytes"]

For improved performance, please use dir comprehensions in places where a dir was previously converted to a list or map. For example, it is generally recommended to replace:
[ (name, f) | (name, f) < list(someDir)]
and
[ (name, f) | (name, f) < map(someDir)]
with
[ (name, f) | (name, f) < someDir]

Reflow 1.20.0

Highlights from this release:

• Added strings.Chunk and files.Create functions
• Reduced memory usage by optimizing digest computation
• Improved resilience of cloudwatch exec logging

reflow1.19.0

Highlights from this release:

• various under the hood improvements to reduce Reflow’s memory usage
  • if you’ve upgraded an adhoc in the past due to Reflow’s memory requirements, now would be a good time to re-evaluate
  • in particular, we strongly encourage users to update dir summation code to take advantage of these improvements

Change this:  dirs.Make(map([(fooPath, fooFile)] + list(otherDir)))
to this:      dirs.Make(map([(fooPath, fooFile)])) + otherDir

• reflow can now launch instances in multiple availability zones
• reflow info output now includes the error message for failed execs, see reflow info -help for more info
• various minor bug fixes and internal refactoring

reflow1.18.0

Highlights from this release:

• Credential management improvements to support running reflow in multiple regions
• Flags -gc and -sched are no longer used and have been removed
• Rollback the base flatcar AMI - new version resulted in unexpected memory usage spikes
• Various properties such as NVMe, intel_avx512, intel_turbo are now correctly reported for various EC2 instance types
• Improve resiliency of reflowlet startup (reupload reflow binary to the repository in rare cases when it gets cleaned up)
• Started internal refactoring of reflow runtime object hierarchy, should make it easier to integrate reflow as a library into other packages

reflow1.17.0

Highlights from this release:

• digests of resolved filesets of exec dependencies are now shown in log output
• minor fixes to taskdb setup
• replace execlog/syslog with a single run log
• improvements to reflow ec2instances tool, including an option to show spot placement scores by AZ
• expedite spot request failure upon low capacity
• upgraded aws-sdk-go to v1.42.0
• other minor changes related to AWS region configuration