Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

s3.fileName does not support folders #294

Open
greg-anetac opened this issue Jan 31, 2025 · 0 comments
Open

s3.fileName does not support folders #294

greg-anetac opened this issue Jan 31, 2025 · 0 comments

Comments

@greg-anetac
Copy link

greg-anetac commented Jan 31, 2025

Whenever I try submitting a job with a path in "s3.fileName", I get an error like this

{"error":"Bad parameters","status":400,"object":["248 : File name has bad format"]}

Here is sample query request with redacted details:

{
  "query": "[redacted]",
  "from": "5m",
  "to": "now",
  "mode": {
    "type": "json/simple"
  },
  "destination": {
    "type": "s3",
    "params": {
      "aws.bucket": "[redacted]",
      "aws.region": "us-east-2",
      "aws.accesskey": "[redacted]",
      "aws.secretkey": "[redacted]",
      "format": "gzip",
      "s3.fileName":"datadrop/devo_20250131004128"
    }
  }
}

I would expect that forward slashes in S3 file name should be accepted in order to be able to put files into specific folders. Without this, Devo always writes to the root of the bucket, which is a problem.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant