Skip to content

Conversation

@zsxwing
Copy link

@zsxwing zsxwing commented Jan 26, 2016

This PR adds more file format support for FileStreamSource. Because it reuses HadoopFsRelationProvider, all file formats in SQL will be supported. Also add a unit test to read from json files.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Moved this before start to avoid missing any exception.

@zsxwing
Copy link
Author

zsxwing commented Jan 26, 2016

cc @marmbrus @tdas

@AmplabJenkins
Copy link

Can one of the admins verify this patch?

@tdas
Copy link
Collaborator

tdas commented Jan 26, 2016

jenkins ok to test.

@AmplabJenkins
Copy link

Merged build finished. Test FAILed.

@AmplabJenkins
Copy link

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/spark-streaming-df-test/52/
Test FAILed.

@zsxwing
Copy link
Author

zsxwing commented Jan 26, 2016

Looks merging master (#29) was not sucessful

@zsxwing zsxwing closed this Feb 2, 2016
@zsxwing zsxwing deleted the file-format branch November 23, 2016 01:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants