Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix 13970: Fix Consecutive Array issue in Athena #14852

Merged
merged 1 commit into from
Jan 25, 2024
Merged

Conversation

ayush-shah
Copy link
Member

Describe your changes:

Fixes #13970

The issue described was being caused because Array(Array) failed as the it needs item_type as argument and it was sent empty. As we don't cater to nested arrays for their children and their types, dataType will be Array, arrayDataType will be Array, dataTypeDisplay would be array<array<.....>>

Type of change:

  • Bug fix
  • Improvement
  • New feature
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • Documentation

Checklist:

  • I have read the CONTRIBUTING document.
  • My PR title is Fixes <issue-number>: <short explanation>
  • I have commented on my code, particularly in hard-to-understand areas.
  • For JSON Schema changes: I updated the migration scripts or explained why it is not needed.

@ayush-shah ayush-shah requested a review from a team as a code owner January 24, 2024 17:18
@github-actions github-actions bot added Ingestion safe to test Add this label to run secure Github workflows on PRs labels Jan 24, 2024
Copy link

Quality Gate Passed Quality Gate passed for 'open-metadata-ingestion'

Kudos, no new issues were introduced!

0 New issues
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarCloud

}
if name in ["decimal"]:
col_type = types.DECIMAL
if name in ["decimal", "char", "varchar"]:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No need to change it, but you can use a set here for a more efficient lookup.

@ayush-shah ayush-shah merged commit e30ffd7 into main Jan 25, 2024
12 checks passed
@ayush-shah ayush-shah deleted the issue-13970 branch January 25, 2024 05:08
Abhishek332 pushed a commit to Abhishek332/OpenMetadata that referenced this pull request Jan 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Ingestion safe to test Add this label to run secure Github workflows on PRs
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Metadata ingestion failed for nested arrays column in Athena
2 participants