Importer no longer work after update from 6.1.25 to 6.2.5 and importer from 1.5.7 to 1.6.0, failing with Cannot handle Nordigen step "conversion"

[binick]

Support guidelines

• I've read the support guidelines

I've found a bug and checked that ...

• ... the documentation does not mention anything about my problem
• ... there are no open or closed issues that are related to my problem
• ... it's definitely a Firefly III issue, not me

Description

Hi,
after update the import process with GoCardless integration failing with Cannot handle Nordigen step "conversion".

I haven't touched any configuration values, neither at the application level nor at the environmental level.

Debug information

Truncated from this point <----|sion-jQdR5rQ7rBXH)  
[2025-02-11 09:42:00] production.DEBUG: Conversion status is "conv_done"  
[2025-02-11 09:42:01] production.DEBUG: Now at App\Http\Controllers\Import\ConversionController::status(conversion-jQdR5rQ7rBXH)  
[2025-02-11 09:42:01] production.DEBUG: Now in startOrFindConversion(conversion-jQdR5rQ7rBXH)  
[2025-02-11 09:42:01] production.DEBUG: Conversion status is "conv_done"  
[2025-02-11 09:42:03] production.DEBUG: Now at App\Http\Controllers\IndexController::flush  
[2025-02-11 09:42:05] production.DEBUG: redirectToCorrectNordigenStep("submit")  
[2025-02-11 09:42:05] production.DEBUG: Return redirect to "https://localhost/import/convert"  
[2025-02-11 09:42:06] production.DEBUG: redirectToCorrectNordigenStep("submit")  
[2025-02-11 09:42:06] production.DEBUG: Return redirect to "https://localhost/import/convert"  
[2025-02-11 09:42:07] production.DEBUG: redirectToCorrectNordigenStep("conversion")  
[2025-02-11 09:42:07] production.ERROR: redirectToCorrectNordigenStep: Cannot handle Nordigen step "conversion" [1] {"exception":"[object] (App\\Exceptions\\ImporterErrorException(code: 0): redirectToCorrectNordigenStep: Cannot handle Nordigen step \"conversion\" [1] at /var/www/html/app/Http/Middleware/IsReadyForStep.php:496)
[stacktrace]
#0 /var/www/html/app/Http/Middleware/IsReadyForStep.php(370): App\\Http\\Middleware\\ConversionControllerMiddleware->redirectToCorrectNordigenStep()
#1 /var/www/html/app/Http/Middleware/IsReadyForStep.php(47): App\\Http\\Middleware\\ConversionControllerMiddleware->redirectToCorrectStep()
#2 /var/www/html/vendor/laravel/framework/src/Illuminate/Pipeline/Pipeline.php(209): App\\Http\\Middleware\\ConversionControllerMiddleware->handle()
#3 /var/www/html/vendor/laravel/framework/src/Illuminate/Routing/Middleware/SubstituteBindings.php(51): Illuminate\\Pipeline\\Pipeline->{closure:{closure:Illuminate\\Pipeline\\Pipeline::carry():184}:185}()
#4 /var/www/html/vendor/laravel/framework/src/Illuminate/Pipeline/Pipeline.php(209): Illuminate\\Routing\\Middleware\\SubstituteBindings->handle()
#5 /var/www/html/vendor/laravel/framework/src/Illuminate/Foundation/Http/Middleware/VerifyCsrfToken.php(88): Illuminate\\Pipeline\\Pipeline->{closure:{closure:Illuminate\\Pipeline\\Pipeline::carry():184}:185}()
#6 /var/www/html/vendor/laravel/framework/src/Illuminate/Pipeline/Pipeline.php(209): Illuminate\\Foundation\\Http\\Middleware\\VerifyCsrfToken->handle()
#7 /var/www/html/vendor/laravel/framework/src/Illuminate/View/Middleware/ShareErrorsFromSession.php(49): Illuminate\\Pipeline\\Pipeline->{closure:{closure:Illuminate\\Pipeline\\Pipeline::carry():184}:185}()
#8 /var/www/html/vendor/laravel/framework/src/Illuminate/Pipeline/Pipeline.php(209): Illuminate\\View\\Middleware\\ShareErrorsFromSession->handle()
#9 /var/www/html/vendor/laravel/framework/src/Illuminate/Session/Middleware/StartSession.php(121): Illuminate\\Pipeline\\Pipeline->{closure:{closure:Illuminate\\Pipeline\\Pipeline::carry():184}:185}()
#10 /var/www/html/vendor/laravel/framework/src/Illuminate/Session/Middleware/StartSession.php(64): Illuminate\\Session\\Middleware\\StartSession->handleStatefulRequest()
#11 /var/www/html/vendor/laravel/framework/src/Illuminate/Pipeline/Pipeline.php(209): Illuminate\\Session\\Middleware\\StartSession->handle()
#12 /var/www/html/vendor/laravel/framework/src/Illuminate/Cookie/Middleware/AddQueuedCookiesToResponse.php(37): Illuminate\\Pipeline\\Pipeline->{closure:{closure:Illuminate\\Pipeline\\Pipeline::carry():184}:185}()
#13 /var/www/html/vendor/laravel/framework/src/Illuminate/Pipeline/Pipeline.php(209): Illuminate\\Cookie\\Middleware\\AddQueuedCookiesToResponse->handle()
#14 /var/www/html/vendor/laravel/framework/src/Illuminate/Cookie/Middleware/EncryptCookies.php(75): Illuminate\\Pipeline\\Pipeline->{closure:{closure:Illuminate\\Pipeline\\Pipeline::carry():184}:185}()
#15 /var/www/html/vendor/laravel/framework/src/Illuminate/Pipeline/Pipeline.php(209): Illuminate\\Cookie\\Middleware\\EncryptCookies->handle()
#16 /var/www/html/vendor/laravel/framework/src/Illuminate/Pipeline/Pipeline.php(127): Illuminate\\Pipeline\\Pipeline->{closure:{closure:Illuminate\\Pipeline\\Pipeline::carry():184}:185}()
#17 /var/www/html/vendor/laravel/framework/src/Illuminate/Routing/Router.php(807): Illuminate\\Pipeline\\Pipeline->then()
#18 /var/www/html/vendor/laravel/framework/src/Illuminate/Routing/Router.php(786): Illuminate\\Routing\\Router->runRouteWithinStack()
#19 /var/www/html/vendor/laravel/framework/src/Illuminate/Routing/Router.php(750): Illuminate\\Routing\\Router->runRoute()
#20 /var/www/html/vendor/laravel/framework/src/Illuminate/Routing/Router.php(739): Illuminate\\Routing\\Router->dispatchToRoute()
#21 /var/www/html/vendor/laravel/framework/src/Illuminate/Foundation/Http/Kernel.php(201): Illuminate\\Routing\\Router->dispatch()
#22 /var/www/html/vendor/laravel/framework/src/Illuminate/Pipeline/Pipeline.php(170): Illuminate\\Foundation\\Http\\Kernel->{closure:Illuminate\\Foundation\\Http\\Kernel::dispatchToRouter():198}()
#23 /var/www/html/vendor/laravel/framework/src/Illuminate/Foundation/Http/Middleware/TransformsRequest.php(21): Illuminate\\Pipeline\\Pipeline->{closure:Illuminate\\Pipeline\\Pipeline::prepareDestination():168}()
#24 /var/www/html/vendor/laravel/framework/src/Illuminate/Foundation/Http/Middleware/ConvertEmptyStringsToNull.php(31): Illuminate\\Foundation\\Http\\Middleware\\TransformsRequest->handle()
#25 /var/www/html/vendor/laravel/framework/src/Illuminate/Pipeline/Pipeline.php(209): Illuminate\\Foundation\\Http\\Middleware\\ConvertEmptyStringsToNull->handle()
#26 /var/www/html/vendor/laravel/framework/src/Illuminate/Foundation/Http/Middleware/TransformsRequest.php(21): Illuminate\\Pipeline\\Pipeline->{closure:{closure:Illuminate\\Pipeline\\Pipeline::carry():184}:185}()
#27 /var/www/html/vendor/laravel/framework/src/Illuminate/Foundation/Http/Middleware/TrimStrings.php(51): Illuminate\\Foundation\\Http\\Middleware\\TransformsRequest->handle()
#28 /var/www/html/vendor/laravel/framework/src/Illuminate/Pipeline/Pipeline.php(209): Illuminate\\Foundation\\Http\\Middleware\\TrimStrings->handle()
#29 /var/www/html/vendor/laravel/framework/src/Illuminate/Http/Middleware/ValidatePostSize.php(27): Illuminate\\Pipeline\\Pipeline->{closure:{closure:Illuminate\\Pipeline\\Pipeline::carry():184}:185}()
#30 /var/www/html/vendor/laravel/framework/src/Illuminate/Pipeline/Pipeline.php(209): Illuminate\\Http\\Middleware\\ValidatePostSize->handle()
#31 /var/www/html/vendor/laravel/framework/src/Illuminate/Foundation/Http/Middleware/PreventRequestsDuringMaintenance.php(110): Illuminate\\Pipeline\\Pipeline->{closure:{closure:Illuminate\\Pipeline\\Pipeline::carry():184}:185}()
#32 /var/www/html/vendor/laravel/framework/src/Illuminate/Pipeline/Pipeline.php(209): Illuminate\\Foundation\\Http\\Middleware\\PreventRequestsDuringMaintenance->handle()
#33 /var/www/html/vendor/laravel/framework/src/Illuminate/Http/Middleware/HandleCors.php(49): Illuminate\\Pipeline\\Pipeline->{closure:{closure:Illuminate\\Pipeline\\Pipeline::carry():184}:185}()
#34 /var/www/html/vendor/laravel/framework/src/Illuminate/Pipeline/Pipeline.php(209): Illuminate\\Http\\Middleware\\HandleCors->handle()
#35 /var/www/html/vendor/laravel/framework/src/Illuminate/Http/Middleware/TrustProxies.php(58): Illuminate\\Pipeline\\Pipeline->{closure:{closure:Illuminate\\Pipeline\\Pipeline::carry():184}:185}()
#36 /var/www/html/vendor/laravel/framework/src/Illuminate/Pipeline/Pipeline.php(209): Illuminate\\Http\\Middleware\\TrustProxies->handle()
#37 /var/www/html/vendor/laravel/framework/src/Illuminate/Pipeline/Pipeline.php(127): Illuminate\\Pipeline\\Pipeline->{closure:{closure:Illuminate\\Pipeline\\Pipeline::carry():184}:185}()
#38 /var/www/html/vendor/laravel/framework/src/Illuminate/Foundation/Http/Kernel.php(176): Illuminate\\Pipeline\\Pipeline->then()
#39 /var/www/html/vendor/laravel/framework/src/Illuminate/Foundation/Http/Kernel.php(145): Illuminate\\Foundation\\Http\\Kernel->sendRequestThroughRouter()
#40 /var/www/html/public/index.php(76): Illuminate\\Foundation\\Http\\Kernel->handle()
#41 {main}
"} 

Expected behaviour

No response

Steps to reproduce

No response

Additional info

I am using pre-existing configurations. If needed, I can clean them up of sensible data and upload them.

If needed, I can also upload the values of the configurations needed for resolution.

[JC5]

Alright, could you start testing by browsing to /flush in the data importer, or press "start over"?

[binick]

Sorry for the delay in responding. I have reproduced the problem.
I have rechecked that the problem persists.
I also tried another account also configured with GoCardless to rule out that the problem was bank-related.

Inspecting the browser window debugger I saw the call to /import/submit following the last state request call /import/convert/status?identifier=conversion-{id} fails.

[JC5]

Could you tell me what error you see in the logs or the console when it fails?

[binick]

No errors are reported in the browser console but as you can see all submit calls go to error.

I will also leave you the part of the log where no errors are shown but it seems that the server responds with a 499. Which according to what wikipedia says List of HTTP status codes corresponds to a closing of the connection by the client.
This would explain the lack of content in the response, see image.

However I know neither PHP nor how the process works so take this information as my assumption and not advice in your search for a solution.

Finally I can tell you that transactions are imported.

2025-02-12T19:57:06.176264127Z 127.0.0.1 - - [12/Feb/2025:20:57:06 +0100] "GET /import/submit HTTP/1.1" 499 0 "https://localhost/import/convert" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/133.0.0.0 Safari/537.36 Edg/133.0.0.0" "93.38.48.217:25574"
2025-02-12T19:57:06.215721896Z 127.0.0.1 - - [12/Feb/2025:20:57:06 +0100] "GET /import/convert/status?identifier=conversion-i6mcln0i4HQY HTTP/1.1" 200 95 "https://localhost/import/convert" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/133.0.0.0 Safari/537.36 Edg/133.0.0.0" "93.38.48.217:24630"
2025-02-12T19:57:06.238312779Z [2025-02-12 20:57:06] production.DEBUG: Now at App\Http\Controllers\Import\ConversionController::status(conversion-i6mcln0i4HQY)  
2025-02-12T19:57:06.246143012Z [2025-02-12 20:57:06] production.DEBUG: Now in startOrFindConversion(conversion-i6mcln0i4HQY)  
2025-02-12T19:57:06.418137528Z [2025-02-12 20:57:06] production.DEBUG: Conversion status is "conv_done"  
2025-02-12T19:57:06.438242269Z 127.0.0.1 - - [12/Feb/2025:20:57:06 +0100] "GET /import/submit HTTP/1.1" 499 0 "https://localhost/import/convert" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/133.0.0.0 Safari/537.36 Edg/133.0.0.0" "93.38.48.217:24682"
2025-02-12T19:57:06.509048569Z 127.0.0.1 - - [12/Feb/2025:20:57:06 +0100] "GET /import/convert/status?identifier=conversion-i6mcln0i4HQY HTTP/1.1" 200 95 "https://localhost/import/convert" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/133.0.0.0 Safari/537.36 Edg/133.0.0.0" "93.38.48.217:24586"

2025-02-12T19:57:07.112135196Z 127.0.0.1 - - [12/Feb/2025:20:57:07 +0100] "GET /import/submit HTTP/1.1" 499 0 "https://localhost/import/convert" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/133.0.0.0 Safari/537.36 Edg/133.0.0.0" "93.38.48.217:24685"
2025-02-12T19:57:07.494822084Z [2025-02-12 20:57:07] production.DEBUG: Now at App\Http\Controllers\Import\ConversionController::status(conversion-i6mcln0i4HQY)  
2025-02-12T19:57:07.495763000Z [2025-02-12 20:57:07] production.DEBUG: Now in startOrFindConversion(conversion-i6mcln0i4HQY)  
2025-02-12T19:57:07.644761827Z [2025-02-12 20:57:07] production.DEBUG: Conversion status is "conv_done"  
2025-02-12T19:57:08.007069570Z [2025-02-12 20:57:07] production.DEBUG: Now at App\Http\Controllers\Import\ConversionController::status(conversion-i6mcln0i4HQY)  
2025-02-12T19:57:08.077455764Z [2025-02-12 20:57:08] production.DEBUG: Now in startOrFindConversion(conversion-i6mcln0i4HQY)  
2025-02-12T19:57:08.209863009Z [2025-02-12 20:57:08] production.DEBUG: Now at App\Http\Controllers\Import\ConversionController::status(conversion-i6mcln0i4HQY)  
2025-02-12T19:57:08.209886909Z [2025-02-12 20:57:08] production.DEBUG: Now in startOrFindConversion(conversion-i6mcln0i4HQY)

[JC5]

OK, thanks.

With no more information there is not much for me to go on. you can follow these instructions to see if you can discover why the original call fails.

https://docs.firefly-iii.org/how-to/general/debug/