Commit 2761a19
[SPARK-42951][SS][CONNECT] DataStreamReader APIs
### What changes were proposed in this pull request?
This PR adds the `orc`, `parquet`, and `text` APIs in connect's DataStreamReader
### Why are the changes needed?
Part of Streaming Connect project.
### Does this PR introduce _any_ user-facing change?
Yes, now the three APIs are enabled. But everything is pretty much still under developed so far.
### How was this patch tested?
Manually tested, unit tests will be added in SPARK-43031 as a follow-up PR #40691.
Closes #40689 from WweiL/SPARK-42951-reader-apis.
Authored-by: Wei Liu <wei.liu@databricks.com>
Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>1 parent ab90ccc commit 2761a19
1 file changed
+70
-4
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
168 | 168 | | |
169 | 169 | | |
170 | 170 | | |
171 | | - | |
172 | | - | |
173 | | - | |
| 171 | + | |
| 172 | + | |
| 173 | + | |
| 174 | + | |
| 175 | + | |
| 176 | + | |
| 177 | + | |
| 178 | + | |
| 179 | + | |
| 180 | + | |
| 181 | + | |
| 182 | + | |
| 183 | + | |
| 184 | + | |
| 185 | + | |
| 186 | + | |
| 187 | + | |
| 188 | + | |
| 189 | + | |
| 190 | + | |
| 191 | + | |
| 192 | + | |
| 193 | + | |
| 194 | + | |
| 195 | + | |
| 196 | + | |
| 197 | + | |
| 198 | + | |
| 199 | + | |
| 200 | + | |
| 201 | + | |
| 202 | + | |
| 203 | + | |
| 204 | + | |
| 205 | + | |
| 206 | + | |
| 207 | + | |
| 208 | + | |
| 209 | + | |
| 210 | + | |
| 211 | + | |
| 212 | + | |
| 213 | + | |
| 214 | + | |
| 215 | + | |
| 216 | + | |
| 217 | + | |
| 218 | + | |
| 219 | + | |
| 220 | + | |
| 221 | + | |
| 222 | + | |
| 223 | + | |
| 224 | + | |
| 225 | + | |
| 226 | + | |
| 227 | + | |
| 228 | + | |
| 229 | + | |
| 230 | + | |
| 231 | + | |
| 232 | + | |
| 233 | + | |
| 234 | + | |
| 235 | + | |
| 236 | + | |
| 237 | + | |
| 238 | + | |
| 239 | + | |
174 | 240 | | |
175 | 241 | | |
176 | 242 | | |
| |||
245 | 311 | | |
246 | 312 | | |
247 | 313 | | |
248 | | - | |
| 314 | + | |
249 | 315 | | |
250 | 316 | | |
251 | 317 | | |
| |||
0 commit comments