New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

add new feature: ignored fields - now you can choose what column will be transit to kinesis #215

Open

slmzig wants to merge 2 commits into awslabs:master from dataengi:ignored-columns

slmzig commented Nov 3, 2020

Issue #, if available:
#214
Description of changes:
now in agent.json in dataProcessingOptions section we can add ignored fields

      "dataProcessingOptions": [
        {
          "optionName": "CSVTOJSON",
          "ignoredFieldNames": [
            "column1",
            "column2",
            "column3"
          ],
          "customFieldNames": [
            "column1",
            "column2",
            "column3",
            "column4",
            "column5",
...

from the example above columns : column1, column2,column3, will not be sent to kinesis

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

slava added 2 commits

November 3, 2020 16:49


          add new feature: ignored fields - now you can choose what column will…

6a98f36

… be transit to kinesis


          add static fields - add new test

14f69a1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet