Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

An error occurred in the ‘ftk_LoadData’ query. DataFormat.Error: We couldn't parse the input provided as a Date value. #512

Closed
elvismangarae opened this issue Dec 21, 2023 · 7 comments
Assignees
Labels
Status: ✅ Released Issue has been included in a release Tool: FinOps hubs Data pipeline solution Type: Bug 🐛 Something isn't working
Milestone

Comments

@elvismangarae
Copy link

🐛 Problem

When trying to connect via the FinOps hubs data source in CostSummary report, unable to load the data with below error:
An error occurred in the ‘ftk_LoadData’ query. DataFormat.Error: We couldn't parse the input provided as a Date value.

👣 Repro steps

  1. Create export at subscription scope
  2. name export amortizesubscription and run
  3. Update CostSummary report with correct storage Url: https://storageexamplename.dfs.core.windows.net/ingestion
  4. Apply

🤔 Expected

No error, data loads

🙋‍♀️ Ask for the community

We could use your help:

  1. Please vote this issue up (👍) to prioritize it.
  2. Leave comments to help us solidify the vision.
@elvismangarae elvismangarae added Needs: Triage 🔍 Untriaged issue needs to be reviewed Type: Bug 🐛 Something isn't working labels Dec 21, 2023
@erincon01
Copy link

erincon01 commented Jan 9, 2024

Hello.

I had the same issue. I am not good at Power Query, so I commented the section with errors.
The issue is in the ftk_LoadData function in Power Query.
Scroll to the section where applies the filter and remove it.
I just hardcoded as you see below:

                // Only pull from the predefined date range (if specified)

               tbl = RemovedContent,
                // ERINCON@VERNEIT.COM --> remove filter because it failed
                FilterRowsByDate = tbl
                // FilterRowsByDate = 
                //     if start = null and end = null then tbl
                //     else Table.SelectRows(tbl, each 
                //         (start = null or (if Table.HasColumns(tbl, "Date") then Date.From([Date]) else Date.From([date])) >= Date.From(start)) 
                //         and (end = null or (if Table.HasColumns(tbl, "Date") then Date.From([Date]) else Date.From([date])) < Date.From(end))
                //     )

@erincon01
Copy link

erincon01 commented Jan 11, 2024

If you change the Date column name to date (in lowercase), you will fix the issue. There are 4 occurrences. There is no need to comment the code, just change that section.

@flanakin flanakin added this to the 0.2 milestone Jan 18, 2024
@flanakin flanakin added the Tool: FinOps hubs Data pipeline solution label Jan 19, 2024
@flanakin
Copy link
Collaborator

Thanks for sharing, @erincon01! This has been fixed in 0.2. Stand by for the next release.

@flanakin flanakin added Status: 📦 Pending release Issue will be included in the next release and removed Needs: Triage 🔍 Untriaged issue needs to be reviewed labels Jan 19, 2024
Copy link
Contributor

@flanakin

I've put up a pull request to add @elvismangarae! 🎉

@flanakin
Copy link
Collaborator

@allcontributors please add @erincon01 for question

Copy link
Contributor

@flanakin

I've put up a pull request to add @erincon01! 🎉

@flanakin
Copy link
Collaborator

This error has been fixed in the 0.2 release. Thanks again for reporting. Please let us know if you run into anything else!

https://aka.ms/ftk/latest

@flanakin flanakin added Status: ✅ Released Issue has been included in a release and removed Status: 📦 Pending release Issue will be included in the next release labels Jan 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Status: ✅ Released Issue has been included in a release Tool: FinOps hubs Data pipeline solution Type: Bug 🐛 Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants