[SPARK-6514][SPARK-5960][SPARK-6656] Ability to specify DynamoDB region ... #5882
Conversation
…on separate from Kinesis region (or use the same), ability to pass in AWS credentials and not rely on EC2 IAM roles and other environment settings that may be difficult to set otherwise, ability to override appName for environments that provide you an existing SparkContext/SparkConf where the appName is already set (ie. Spark Shell)
|
Can one of the admins verify this patch? |
|
This is ok to test |
|
ok to test |
There was a problem hiding this comment.
"Instances of this class will be shipped to the executors"
|
ok to test. |
|
Jenkins, this is ok to test. |
There was a problem hiding this comment.
Are you sure this is in the 100 character limit?
|
Merged build triggered. |
|
Merged build started. |
There was a problem hiding this comment.
Why not let the awsAccessKey be printed, and not the secret key?
|
Test build #32051 has started for PR 5882 at commit |
There was a problem hiding this comment.
All this formatting seems messed up. This PR requires a huge formatting overhaul.
There was a problem hiding this comment.
Naah correction, it may not be. My screen resolution was messed up which made all the lines wrap and look messed up.
|
Test build #32051 has finished for PR 5882 at commit
|
|
Merged build finished. Test FAILed. |
|
Test FAILed. |
There was a problem hiding this comment.
Why the extra indent in these comment lines
|
Can one of the admins verify this patch? |
|
@cfregly Mind if I take over this PR? :) |
There was a problem hiding this comment.
Why did you delete this file??
|
@cfregly Thanks for all the work for this PR. I merge the fixed up version of this. Mind closing this PR. |
4 participants
...separate from Kinesis region (or use the same), ability to pass in AWS credentials and not rely on EC2 IAM roles and other environment settings that may be difficult to set otherwise, ability to override appName for environments that provide you an existing SparkContext/SparkConf where the appName is already set (ie. Spark Shell)
@tdas (and others): please review. thanks!