Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Task]: add samples for all transforms to the samples project #2237

Open
bamaer opened this issue Feb 5, 2023 · 1 comment
Open

[Task]: add samples for all transforms to the samples project #2237

bamaer opened this issue Feb 5, 2023 · 1 comment

Comments

@bamaer
Copy link
Contributor

bamaer commented Feb 5, 2023

What needs to happen?

there are no samples for the following transforms:

  • Add constants
  • Add value fields changing sequence
  • Add XML
  • Apache Tika
  • Avro Decode
  • Avro Encode
  • Avro File Input
  • Avro File Output
  • Azure Event Hubs Listener
  • Azure Event Hubs Writer
  • Beam Bigtable Input
  • Beam Bigtable Output
  • Beam BigQuery Input
  • Beam BigQuery Output
  • Beam GCP Pub/Sub : Publish
  • Beam GCP Pub/Sub : Subscribe
  • Beam Input
  • Beam Kafka Consume
  • Beam Kafka Produce
  • Beam Kinesis Consume
  • Beam Kinesis Produce
  • Beam Output
  • Beam Timestamp
  • Beam Window
  • Cassandra Input
  • Cassandra Output
  • Cassandra SSTable Output
  • Call DB procedure
  • Change file encoding
  • Check if file is locked
  • Check if webservice is available
  • Combination lookup/update
  • Concat Fields
  • Copy rows to result
  • Credit card validator
  • Data Grid
  • Delete
  • De-Serialize From File
  • Detect Empty Stream
  • Doris Bulk Loader
  • Drools Rule Accumulator
  • Drools Rule Executor
  • Dummy (do nothing)
  • Dynamic SQL row
  • Edi to XML
  • Email Messages Input
  • Enhanced JSON Output
  • Excel input
  • Excel writer
  • Execute a process
  • Execute row SQL script
  • Execute SQL script
  • Execute Unit Tests
  • File exists
  • File Metadata
  • Files from result
  • Files to result
  • Generate Random Value
  • Get Data From XML
  • Get files rowcount
  • Get records from stream
  • Get Rows from Result
  • Get SubFolder names
  • Get table names
  • Get variables
  • HTTP client
  • HTTP Post
  • Injector
  • Join Rows
  • JSON Input
  • LDAP Input
  • LDAP Output
  • Load file content in memory
  • Mail
  • Mapping Input
  • Mapping Output
  • Memory Group By
  • Merge rows (diff)
  • Metadata Input
  • Metadata structure of stream
  • Microsoft Access Output
  • MonetDB Bulk Loader
  • MongoDB Input
  • MongoDB Output
  • Multiway Merge Join
  • (Neo4j -> check for completeness)
  • Oracle Bulk Loader
  • Parquet File Input
  • Parquet File Output
  • Pipeline Data Probe
  • PGP decrypt stream
  • PGP encrypt stream
  • Pipeline Executor
  • PostgreSQL Bulk Loader
  • Process files
  • Properties file Input
  • Properties file Output
  • Regex Evaluation
  • Replace in String
  • Reservoir Sampling
  • REST Client
  • Row Denormaliser
  • Row Flattener
  • Row Generator
  • Row Normaliser
  • Run SSH commands
  • Salesforce Delete
  • Salesforce Input
  • Salesforce Insert
  • Salesforce Update
  • Salesforce Upsert
  • Sample Rows
  • SAS Input
  • Serialize To File
  • Server Status
  • Set field value to a constant
  • Set field Value to a field
  • Set Variables
  • Snowflake Bulk Loader
  • Split fields to rows
  • Splunk Input
  • SQL File Output
  • Stream Schema Merge
  • String cut
  • Synchronize after merge
  • Table Compare
  • Table Exists
  • Teradata Bulk Loader
  • Token Replacement
  • Unique Rows (HashSet)
  • Update
  • User Defined Java Expression
  • Web services lookup
  • Workflow Executor
  • Write to log
  • XML Input Stream (StAX)
  • XML Join
  • XML Output
  • XSD Validator
  • XSL Transformation
  • Yaml Input

Issue Priority

Priority: 3

Issue Component

Component: Samples

@github-actions github-actions bot added P3 Nice to have Samples labels Feb 5, 2023
bamaer added a commit to bamaer/hop that referenced this issue Feb 5, 2023
bamaer added a commit to bamaer/hop that referenced this issue Feb 5, 2023
bamaer added a commit to bamaer/hop that referenced this issue Feb 6, 2023
bamaer added a commit to bamaer/hop that referenced this issue Feb 7, 2023
bamaer added a commit to bamaer/hop that referenced this issue Feb 7, 2023
bamaer added a commit to bamaer/hop that referenced this issue Feb 7, 2023
bamaer added a commit to bamaer/hop that referenced this issue Feb 7, 2023
…ck if file is locked, check if webservice is available apache#2237
bamaer added a commit to bamaer/hop that referenced this issue Feb 9, 2023
bamaer added a commit to bamaer/hop that referenced this issue Feb 9, 2023
bamaer added a commit to bamaer/hop that referenced this issue Feb 9, 2023
bamaer added a commit to bamaer/hop that referenced this issue Feb 9, 2023
…ck if file is locked, check if webservice is available apache#2237
bamaer added a commit to bamaer/hop that referenced this issue Feb 19, 2023
bamaer added a commit to bamaer/hop that referenced this issue Feb 22, 2023
@campen
Copy link
Contributor

campen commented Apr 17, 2023

MongoDB Input/output samples (zipped up)
mongodb.zip
Also I used this docker-compose file to spin up a mongo container:
version: '3.1'
services:
mongo:
image: mongo:latest
ports:
- 27017:27017
environment:
MONGO_INITDB_ROOT_USERNAME: root
MONGO_INITDB_ROOT_PASSWORD: password

bamaer added a commit to bamaer/hop that referenced this issue Apr 24, 2023
bamaer added a commit to bamaer/hop that referenced this issue Apr 29, 2023
hansva added a commit that referenced this issue Apr 29, 2023
special characters in graph properties, exclude child hpl/hwf from samples IT #2812 #2237
bamaer added a commit to bamaer/hop that referenced this issue Aug 31, 2023
bamaer added a commit to bamaer/hop that referenced this issue Sep 1, 2023
bamaer added a commit to bamaer/hop that referenced this issue Sep 1, 2023
hansva added a commit that referenced this issue Sep 1, 2023
JSON input samples and updated docs #2237
hansva added a commit that referenced this issue Sep 11, 2023
additional samples for the json input and javascript transforms. #2237
bamaer added a commit to bamaer/hop that referenced this issue May 16, 2024
bamaer added a commit to bamaer/hop that referenced this issue May 16, 2024
hansva pushed a commit that referenced this issue May 16, 2024
* ignore .swp files

* additional metadata injection sample. #2237

* added missing apache header. #2237
bamaer added a commit to bamaer/hop that referenced this issue May 17, 2024
bamaer added a commit to bamaer/hop that referenced this issue May 17, 2024
hansva pushed a commit that referenced this issue May 17, 2024
* exclude MDI template from samples IT. #2237

* re-apply ASF header. #2237
bamaer added a commit to bamaer/hop that referenced this issue May 17, 2024
bamaer added a commit to bamaer/hop that referenced this issue May 17, 2024
hansva pushed a commit that referenced this issue May 19, 2024
* exclude MDI template from samples IT. #2237

* re-apply ASF header. #2237

* updated system properties/variables information. fixes #3943
bamaer added a commit to bamaer/hop that referenced this issue May 22, 2024
bamaer added a commit to bamaer/hop that referenced this issue May 22, 2024
hansva pushed a commit that referenced this issue May 24, 2024
* exclude MDI template from samples IT. #2237

* re-apply ASF header. #2237

* Beam version upgrades. #3291
bamaer added a commit to bamaer/hop that referenced this issue May 25, 2024
bamaer added a commit to bamaer/hop that referenced this issue May 25, 2024
bamaer added a commit to bamaer/hop that referenced this issue May 26, 2024
bamaer added a commit to bamaer/hop that referenced this issue May 26, 2024
bamaer added a commit to bamaer/hop that referenced this issue Jun 7, 2024
bamaer added a commit to bamaer/hop that referenced this issue Jun 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants