Skip to content

Latest commit

 

History

History
176 lines (129 loc) · 12.9 KB

CHANGES.md

File metadata and controls

176 lines (129 loc) · 12.9 KB
Raw

bdg-utils Changelog

Version 1.0

Closed issues:

  • Update Spark dependency version to 3.2.1 #180

Merged and closed pull requests:

  • Update Spark dependency version to 3.2.1, guava to 31.1-jre #181 (heuermh)

Version 0.4.0

Closed issues:

  • Update Parquet dependency version to 1.12.1 #177
  • Update Spark dependency version to 3.2.0 #175
  • Migrate CI off Jenkins #171
  • Default build to Spark 3/Scala 2.12 #154

Merged and closed pull requests:

Version 0.3.0

Closed issues:

  • Update Spark dependency version to 3.0.0 #166
  • Update Spark dependency version to 2.4.6 #164
  • Add Spark 3 build configuration to Jenkins #161
  • Remove coveralls from build #159
  • Support Apache Spark 3.x in build #153
  • Remove utils-metrics module from build #152
  • Remove deprecated classes and methods #138
  • Add approximate LSH approach for MinHash #23

Merged and closed pull requests:

  • [UTILS-166] Update Spark dependency version to 3.0.0 #167 (heuermh)
  • [UTILS-164] Update Spark dependency version to 2.4.6 #165 (heuermh)
  • Bump slf4j dependency version to 1.7.30 #163 (heuermh)
  • Remove -print-metrics argument #162 (heuermh)
  • [UTILS-159] Remove coveralls from build #160 (heuermh)
  • [UTILS-138] Remove deprecated classes and methods #158 (heuermh)
  • [UTILS-152] Remove utils-metrics module from build #157 (heuermh)
  • Fix argument check #156 (heuermh)
  • [UTILS-153] Support Apache Spark 3.x in build #148 (heuermh)

Version 0.2.16

Closed issues:

  • Deprecate utils-metrics module #151
  • Initializing Metrics across project #117
  • Register your spark package #71

Merged and closed pull requests:

  • [UTILS-151] Deprecate utils-metrics for removal in version 0.3.0 #155 (heuermh)
  • Update Spark dependency version to 2.4.5 #150 (heuermh)
  • Replace deprecated AccumulatorParam with AccumulatorV2 #149 (heuermh)
  • Remove Jenkins badge #147 (heuermh)
  • Update Spark dependency version to 2.4.4 #146 (heuermh)

Version 0.2.15

Closed issues:

  • Update Scala 2.12 dependency version to 2.12.8 #144
  • Deprecate HadoopUtil, version 1.x is no longer supported #142
  • Update Spark dependency version to 2.4.3 #140
  • Deprecate and remove usage of Logging trait #131
  • Add github-changes-maven-plugin configuration to release script #130

Merged and closed pull requests:

  • [UTILS-144] Update Scala 2.12 dependency version to 2.12.8 #145 (heuermh)
  • [UTILS-142] Deprecate HadoopUtil, version 1.x is no longer supported #143 (heuermh)
  • [UTILS-140] Update Spark dependency version to 2.4.3 #141 (heuermh)
  • [UTILS-133] Update Spark dependency to 2.4.2, Parquet to 1.10.1 #136 (heuermh)
  • [UTILS-130] Adding github-changes-maven-plugin configuration to release script. #135 (heuermh)
  • Update dependency and plugin versions. #134 (heuermh)
  • [UTILS-131] Deprecate and remove usage of Logging trait. #132 (heuermh)

Version 0.2.14

Closed issues:

  • Support Scala 2.12 #124
  • Upgrade SparkFunSuite to return a SparkSession #120
  • Update args4j dependency version #118

Merged and closed pull requests:

  • Minor doc cleanup before release. #129 (heuermh)
  • [UTILS-124] Add support for Scala 2.12. #128 (heuermh)
  • [UTILS-118] Update args4j dependency version to 2.33 #127 (heuermh)
  • Update plugin and dependency versions. #126 (heuermh)
  • [UTILS-120] Set up SparkSession in SparkFunSuite #125 (heuermh)
  • Close InputStream opened in readByteStream #123 (bkempe)
  • Create SparkSession in SparkFunSuite #122 (fnothaft)
  • Add a method to create an empty temporary directory. #121 (heuermh)
  • Adding code of contact adapted from the Contributor Convenant, version 1.4. #119 (heuermh)

Version 0.2.8

  • ISSUE 75: Added IntervalRDD submodule and its interval tree dependency.

Version 0.2.6

  • ISSUE 72: Remove dependency on Spark internal Logging

Version 0.2.5

  • ISSUE 67: Modifying pom.xml files to move back to Scala 2.10 for development.

Version 0.2.4

  • ISSUE 64: Add exception for maven-javadoc-plugin in move_to_scala_2.11.sh
  • ISSUE 63: Remove extraneous git-commit-id-plugin configuration
  • ISSUE 62: Update spark, hadoop, and parquet dependency versions
  • ISSUE 60: Various small util fixes :

Version 0.2.3

  • ISSUE 51: Added "Driver Time" column to represent the total time in the driver
  • ISSUE 49: Adding method for hashing down a whole RDD.
  • ISSUE 48: Fix minor code style and doc errors and warnings
  • ISSUE 47: [utils-46] removing duplicate declaration of spark-core dependency
  • ISSUE 45: [utils-44] updating release tag name format to more closely match artifact name

Version 0.2.2

  • ISSUE 42: [utils-42] Upgrading to the org.apache.parquet release of Parquet.
  • ISSUE 39: Updated docs to add correct parameter for printing metrics

Version 0.2.1

  • ISSUE 38: kill job argument to BDGSparkCommand

Version 0.2.0

  • ISSUE 36: Clean up for release
  • ISSUE 35: Fix problem with nested RDD operations that causes negative durations
  • ISSUE 34: Cross compile to Scala 2.10 and 2.11.
  • ISSUE 31: Move normalization code from ADAM
  • ISSUE 33: [ADAM-634] Remove bdg-utils-parquet
  • ISSUE 32: Adding gzip codec.
  • ISSUE 30: Move CLI code from ADAM
  • ISSUE 14: [bdg-utils-13] Added code to implement a poisson mixture model.

Version 0.1.2

  • ISSUE 28: Instrumented some new RDD operations from Spark 1.2
  • ISSUE 26: [bdg-utils-25] Upgrade to Spark 1.2.0.
  • ISSUE 27: Added documentation for instrumentation to README.md
  • ISSUE 24: Remove Timers object from bdg-utils as it contains ADAM-specific timers

Version 0.1.1

  • ISSUE 22: Porting a fix to Parquet from ADAM.

Version 0.1.0

  • ISSUE 21: [bdg-utils-20] Port unit testing suite fixes over from ADAM.
  • ISSUE 19: Added more granular instrumentation to bdg-utils.

Version 0.0.1

  • ISSUE 15: [bdg-utils-9] Silence logging during unit tests.
  • ISSUE 10: [bdg-utils-3] Moving over the Parquet classes.
  • ISSUE 12: [bdg-utils-11] Adding testFile to SparkFunUtils
  • ISSUE 8: [bdg-utils-6] Migrates metrics code from ADAM
  • ISSUE 7: [bdg-utils-2] Migrates minhashing code from PacMin.
  • ISSUE 5: Initial setup