Skip to content

Commit

Permalink
Release 1.3.3 (#365)
Browse files Browse the repository at this point in the history
* fix: to lower case
* pin numpy
  • Loading branch information
ralphrass authored Jun 20, 2024
1 parent e787452 commit f1d4626
Show file tree
Hide file tree
Showing 8 changed files with 51 additions and 16 deletions.
6 changes: 6 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,12 @@ Preferably use **Added**, **Changed**, **Removed** and **Fixed** topics in each

## [Unreleased]

## [1.3.3](https://github.com/quintoandar/butterfree/releases/tag/1.3.3)
* Fix Cassandra Config and Numpy version ([#364](https://github.com/quintoandar/butterfree/pull/364))

## [1.3.2](https://github.com/quintoandar/butterfree/releases/tag/1.3.2)
* Fix publish script ([#362](https://github.com/quintoandar/butterfree/pull/362))

## [1.3.2](https://github.com/quintoandar/butterfree/releases/tag/1.3.2)
* Fix publish script ([#360](https://github.com/quintoandar/butterfree/pull/362))

Expand Down
30 changes: 16 additions & 14 deletions butterfree/configs/db/cassandra_config.py
Original file line number Diff line number Diff line change
Expand Up @@ -228,26 +228,28 @@ def translate(self, schema: List[Dict[str, Any]]) -> List[Dict[str, Any]]:
"""
cassandra_mapping = {
"TimestampType": "timestamp",
"BinaryType": "boolean",
"BooleanType": "boolean",
"DateType": "timestamp",
"DecimalType": "decimal",
"DoubleType": "double",
"FloatType": "float",
"IntegerType": "int",
"LongType": "bigint",
"StringType": "text",
"ArrayType(LongType,true)": "frozen<list<bigint>>",
"ArrayType(StringType,true)": "frozen<list<text>>",
"ArrayType(FloatType,true)": "frozen<list<float>>",
"timestamptype": "timestamp",
"binarytype": "boolean",
"booleantype": "boolean",
"datetype": "timestamp",
"decimaltype": "decimal",
"doubletype": "double",
"floattype": "float",
"integertype": "int",
"longtype": "bigint",
"stringtype": "text",
"arraytype(longtype,true)": "frozen<list<bigint>>",
"arraytype(stringtype,true)": "frozen<list<text>>",
"arraytype(floattype,true)": "frozen<list<float>>",
}
cassandra_schema = []
for features in schema:
cassandra_schema.append(
{
"column_name": features["column_name"],
"type": cassandra_mapping[str(features["type"]).replace("()", "")],
"type": cassandra_mapping[
str(features["type"]).replace("()", "").lower()
],
"primary_key": features["primary_key"],
}
)
Expand Down
5 changes: 5 additions & 0 deletions docs/source/butterfree.configs.rst
Original file line number Diff line number Diff line change
Expand Up @@ -33,6 +33,11 @@ butterfree.configs.logger module
:undoc-members:
:show-inheritance:

.. automodule:: butterfree.configs.logger
:members:
:undoc-members:
:show-inheritance:

Module contents
---------------

Expand Down
11 changes: 11 additions & 0 deletions docs/source/butterfree.constants.rst
Original file line number Diff line number Diff line change
Expand Up @@ -37,6 +37,12 @@ butterfree.constants.spark\_constants module
:show-inheritance:


.. automodule:: butterfree.constants.migrations
:members:
:undoc-members:
:show-inheritance:


.. automodule:: butterfree.constants.spark_constants
:members:
:undoc-members:
Expand All @@ -55,6 +61,11 @@ butterfree.constants.window\_definitions module
:undoc-members:
:show-inheritance:

.. automodule:: butterfree.constants.window_definitions
:members:
:undoc-members:
:show-inheritance:

Module contents
---------------

Expand Down
11 changes: 11 additions & 0 deletions docs/source/butterfree.dataframe_service.rst
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,17 @@ butterfree.dataframe\_service.repartition module
:undoc-members:
:show-inheritance:

.. automodule:: butterfree.dataframe_service.partitioning
:members:
:undoc-members:
:show-inheritance:


.. automodule:: butterfree.dataframe_service.repartition
:members:
:undoc-members:
:show-inheritance:

Module contents
---------------

Expand Down
1 change: 0 additions & 1 deletion docs/source/butterfree.migrations.database_migration.rst
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,6 @@ butterfree.migrations.database\_migration package
Submodules
----------

butterfree.migrations.database\_migration.cassandra\_migration module
---------------------------------------------------------------------

.. automodule:: butterfree.migrations.database_migration.cassandra_migration
Expand Down
1 change: 1 addition & 0 deletions requirements.txt
Original file line number Diff line number Diff line change
Expand Up @@ -6,3 +6,4 @@ pyspark==3.5.1
typer==0.4.2
typing-extensions>3.7.4,<5
boto3==1.17.*
numpy==1.26.4
2 changes: 1 addition & 1 deletion setup.py
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
from setuptools import find_packages, setup

__package_name__ = "butterfree"
__version__ = "1.3.2"
__version__ = "1.3.3"
__repository_url__ = "https://github.com/quintoandar/butterfree"

with open("requirements.txt") as f:
Expand Down

0 comments on commit f1d4626

Please sign in to comment.