✨ [REQUEST] Firefly iii Data Importer - upload Json config file for auto import #712
Comments
MaoZ1993
added
enhancement
|
You can do that by using the config/addons/fidi/impor_files folder for the data importer. you place there the files and you have the cron timing as an add-on setting. The tricky part is to get authentication stable for unattended import, which seems to clash with subdomains if you have them. |
Sorry I'm a beginer, Yes I have read the add-on document but still not sure where I can type in the below command after config json file is ready. |
|
Addon is programemd to run such query automatically, pointing the 'import' folder to the one mentioned before. |
|
Thanks, I have put the json files into the dir /config/addons_config/fireflyiii_data_importer/import_files but still not importing. My config.yaml is remain default, is there any step I was missing? Addon Logs: |
|
You need to wait. Please share updates after the hour as per your configuration: [16:57:07] INFO: hourly updates |
|
Is there a way I can trace the previous log? It was flood by the health check message,, |
The only way I can think of is installing portainer and checking through that the container's logs. To be honest, i'm having difficulties with the auto-import as well. It used to work fine for me, but FiDi is limited as soon as your subdomains don't match firefly-iii/firefly-iii#5998 |
|
It's confusing, the auto import seems works, but still , the webpage is crashed, "500 Server Error" |
|
I've seen similar behaviour too. I think is because there' some sort of authentication bundled with the IPs/hostnames of the connections. Can't tell much than that, I think is an original firefly issue rather than the HA addon implementation. You (we?) might be more lucky if opening an issue ticket directly to the original repository of FiDi. |
|
Hi, have you made it work? I'm setting up firefly iii (which can help with support!) and currently puzzled with auto import behavior |
|
Sure, Mind in above that I use a personal access token so you do NOT need to fill anything about FF3_Client_id, nor generate an OAuth. i only use that for multi-account setups which is more advanced to setup (https://github.com/orgs/firefly-iii/discussions/5998#discussioncomment-5629623) and then in the config.yaml file in the addons folder: |
|
Thanks very much I'll test and update the documentation. Currently I'm stuck as it seems the app expects a config ".json" file matching the .csv file, so I'll have to investigate a bit further |
That's correct. On your first run you need to proceed manually, follow the guided UI steps to setup your 'configuration' file. https://docs.firefly-iii.org/how-to/data-importer/import/json/ After that, and assuming you manually run the import and confirm it runs fine and the settings are as expected (things like file columns to firefly3 fields link, or date format). You can just add the .json file to the import folder of the addon, and add an updated csv in the same folder, and the addon will autoimport it for you. Filename should be the same, just different file extension. |
|
Thanks very much! It's working quite fine now I thought I could throw a bunch of csv files and it would just import everything, thanks for your explanations. In the end, it's more logic also - once in routine mode (with all history uploaded, my bank only allowed a 1y range max) then there should be much less files to automatically import. Perhaps I'll take the opportunity to update the addon to use the new /config folder as per current Homeassistant guidelines instead of the current /config/addons_config/fireflyiii_data_importer folder but I'll post here when I'll do that so that everyone is aware of the change |
|
If your bank is supported by old Nordigen (no gocardless) I recommend setting it up so that you won't need to download anything, it would automagically connect every time, read latest X days of data, and autoimport it. So then you jus tneed to log in too FF3 and check the latest Tag for your imported data and correct as needed or setup automated-rules to post-process them. I only use CSV for banks without API (such as Edenred which isn't officially 'a bank', or AmericanExpress credit cards balances). PD: Updating the addonn for the new way-of-working of Ha would definitely be interesting to ensure it remains "future proof". |
|
Thanks very much! Indeed my bank looks supported I'll try that! Regarding the different databases types it is normally an option to the addon, although I have never tried another one... It should even support sqlite which would therefore be embedded in the addon. As I have a postgres addon it should be a possible option. Usually I use a weekly update based on a Google Drive addon https://github.com/sabeechen/hassio-google-drive-backup that allows customization of schedules - and therefore to be very quickly up in case of issues! I guess if there is less than a week of data lost the Nordigen link would allow to quickly recover it ? EDIT : strangely Nordigen supports my main account but not savings - anyway it is already super helpful |
|
I've pushed a new version with the new /config folder (can be customized in the options), all files should be transferred automatically |
|
hi @alexbelgium - this latest update seems to have broken the import config folder for me - am I doing something wrong? I had my json files saved in /homeassistant/addons_config/fireflyiii_data_importer/ before and now, after the update, firefly importer can't see any files (I did download them just in case beforehand - phew) any pointers? |
|
Hi, all files have migrated to the new place according to Homeassistant new way of workings! You can access it at the folder /addon_configs/xxx-firelyiii_data_updater and you should find all your previous files there too! |
|
oh my god actually you're right there is a bug that deletes all configuration files instead of copying them!!! I'll pull ASAP the version and put a new one |
|
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. |
|
Hi, is everything working as it should I can close it ? |
|
Hi @alexbelgium. Yeah, I rolled back to the old version, restored the config files and upgraded again - all files copied over this time - thanks!! |
|
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. |
Hi there
Is there a way to upload a pre-config Jason file for automation purposes?
https://docs.firefly-iii.org/data-importer/usage/command_line/
The official document requires a particular mounted folder for docker installation, but in HASS we have no option here...
Thanks, if any additional info is required, I'm happy to help.
The text was updated successfully, but these errors were encountered: