Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for input from sources other than files #11

Open
maxwellhaydn opened this issue Mar 25, 2019 · 1 comment
Open

Support for input from sources other than files #11

maxwellhaydn opened this issue Mar 25, 2019 · 1 comment

Comments

@maxwellhaydn
Copy link

It would be great if this project supported input from sources other than files. For example, we use the JDBC and JDBC static plugins to load data from relational databases into Elasticsearch. We want to write tests that check all aspects of our pipeline config, including:

  • Did the configured SQL query/queries select the expected data from the raw data set?
  • Did it connect to the right database with the right credentials and connection options?
  • Did it filter and transform the raw data correctly before loading it into Elasticsearch?
@agolomoodysaada
Copy link
Contributor

That sounds awesome. This can probably be handled with stdin. We already pass the input logs via stdin here https://github.com/agolo/logstash-test-runner/blob/master/test.sh#L73

PRs are welcome to allow configurable input streams

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants