Version 0.14.4

Highlights

• Stream manager protobuffer optimizations
• Throughput increase by 4-5x compared to previous versions of Heron
• Add more metrics for stream manager queues
• Bug fixes based on feedback and doc fixes

Release Notes

• Change location of local lock to be consistent depth with other state objects (#1472)
• Remove usage of NullFoo objects (#1469)
• Implement IScalable scheduler for the YARN scheduler (#1431)
• Using static imports for Mock and Assert in scheduler-core tests (#1470)
• Adding distributed locking support (#1463)
• Add back the "import StringIO" to javaobj.py (#1464)
• Add unit tests to verify yarn launcher config construction (#1460)
• Clean the java example topologies (#1461)
• Moved methods to packing utils (#1458)
• Deactivate topology before scaling (#1412)
• Added padding constraints during repack (#1441)
• Add support for SSH sock proxying to scheduler (#1456)
• Add driver memory config for yarn scheduler (#1454)
• Update the compiling doc web page. (#1444)
• Add missing storm api class IMetricsConsumer (#1445)
• Define tunnel to be an empty list in the init method of StateManager stop init from being a abstract method
• Fix wrong key type in LocalScheduler.addContainers (#1426)
• Stream manager performance improvement (#1421)
• Add info logging for failed connections, this is the normal state either when using a tunnel or a recoverable state if multiple Zk nodes are declared
• Turn off Javadoc Checks for tests/.* (#1434)
• Changing ZkStateManager and StateManager to accept a set of host, port pairs rather than a single host port
• Supports to submit a topology to the specific yarn queue. Added YarnContext, default config in conf/yarn/scheduler and doc.
• Must delete packing plan before updating it (#1432)
• './scripts/setup-intellji.sh' will check if 'scripts/compile/env_exec.sh' exists (#1429)
• Permit the ability to scale down (#1433)
• Merge pull request #1404 from vidit-bhatia/vibhatia/tshootjavatopo
• Use C++ auto keyword when possible (#1415)
• Add metrics for stream manager queue size (#1397)
• Ability to run just one test in local_test_runner (#1407)
• Adding exception handling to scheduler responses (#1406)
• Use an enum for the TMaster commands instead of a string (#1409)
• local state manager to check for path before trying to read file (#1408)
• Support for scale down (#1394)
• Persist scheduled container size in packing plan (#1398)
• Added the steps for debug java topologies
• Remove double quote. (#1403)
• Include heron-py-instance in heron-core/bin for CentOS 5 (#1402)
• Improve Python program metrics collector, add test. (#1392)
• Use container id provided by packing plan (#1395)
• Support more s3Uploader options
• Change executor to not assume contiguous container id set (#1387)
• Removing PackingPlan.getInstanceDistribution (#1386)
• Update YARN scheduler doc for the 0.14.3 version
• java.lang.Object cannot be formatted using %d, should cast to integer
• Replacing colon-delimited Instance.id with typed InstanceId object (#1382)
• Proper check of the existence of SSH tunnel attribute (#1380)
• Speed up local test runner and enhancements for scaling (#1381)
• Repacking to use globally unique task ids (#1377)
• Adding more debugging info to integration test topologies (#1378)
• AuroraSchedler implements IScalable (#1360)
• Add integration test for scaling up (#1375)
• Add ubuntu16.04-based docker containers
• Refactor local test runner (#1366)
• Update heron cli to support update command for scaling (#1363)
• Change python state manager home resolution (#1367)
• Repacking Implementation for the First Fit Decreasing algorithm (#1364)