Exception with chatbot, inbox and pgr-services

[nsrivastava2]

We're setting up "m_pgr" and "m_fsm" in AWS. Most pods seem fine, but I'm having issues with the chatbot, inbox, and pgr-services. Here's the exception I'm seeing:

chatbot:

Error starting ApplicationContext. To display the conditions report re-run your application with 'debug' enabled.
2023-10-12 19:45:19.370 ERROR 7 --- [           main] o.s.boot.SpringApplication               : Application run failed

org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'localizationService': Invocation of init method failed; nested exception is org.springframework.web.client.HttpClientErrorException$NotFound: 404 : [{"timestamp":1697139919284,"status":404,"error":"Not Found","message":"No message available","path":"/localization/messages/v1/_search"}]
        at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:160) ~[spring-beans-5.2.5.RELEASE.jar!/:5.2.5.RELEASE]
        at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyBeanPostProcessorsBeforeInitialization(AbstractAutowireCapableBeanFactory.java:416) ~[spring-beans-5.2.5.RELEASE.jar!/:5.2.5.RELEASE]
        at org.springframework.beans.factory.support.Abs

inbox:

Error starting ApplicationContext. To display the conditions report re-run your application with 'debug' enabled.
2023-10-12 19:46:40.346+0000 ERROR --- [      main] o.s.boot.SpringApplication               --  : Application run failed

org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'inboxController': Unsatisfied dependency expressed through field 'inboxService'; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'inboxService' defined in URL [jar:file:/opt/egov/inbox-1.0.0-SNAPSHOT.jar!/BOOT-INF/classes!/org/egov/inbox/service/InboxService.class]: Unsatisfied dependency expressed through constructor parameter 0; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'inboxConfiguration': Unsatisfied dependency expressed through field 'serviceSearchMapping'; nested exception is org.springframework.beans.factory.BeanExpressionException: Expression parsing failed; nested exception is org.springframework.expression.ParseException: Expression [#{}] @0: No expression defined within delimiter '#{}' at character 0

pgr-services:

Error starting ApplicationContext. To display the auto-configuration report re-run your application with 'debug' enabled.
2023-10-12 19:46:14.978+0000 ERROR --- [      main] o.s.boot.SpringApplication               --  : Application startup failed

org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'migrationController': Unsatisfied dependency expressed through field 'migrationService'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'migrationService': Invocation of init method failed; nested exception is org.egov.tracer.model.CustomException: The businessService PGR is not found
        at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(AutowiredAnnotationBeanPostProcessor.java:588)

Please let me know if you need further information.

[support-upyog]

Hi,
Please share following details:

a) list of services which have already been deployed successfully.

b) How these services are being built and deployed ? If this is manual build & deployment then please share Docker image IDs being used by these deployments

[kumarnarendra701]

@support-upyog

a) list of services which have already been deployed successfully.

Response -

Here are the outputs of running pods.

root@upyog-n:~# kubectl get po --all-namespaces
NAMESPACE           NAME                                                    READY   STATUS             RESTARTS          AGE
backbone            redis-86d4cc47d8-68flf                                  1/1     Running            0                 11h
egov                billing-service-7d5ff6cc47-2lsfj                        1/1     Running            1 (6h9m ago)      11h
egov                cert-manager-b84d7bc46-rl4l2                            1/1     Running            0                 11h
egov                cert-manager-cainjector-d66578f89-tdqdn                 1/1     Running            0                 11h
egov                cert-manager-startupapicheck-cjnhc                      0/1     Completed          0                 11h
egov                cert-manager-webhook-85dc5f9bf6-6kncp                   1/1     Running            0                 11h
egov                chatbot-8c754b57b-8jbmz                                 0/1     CrashLoopBackOff   130 (4m52s ago)   11h
egov                citizen-5f86799685-mx9sr                                1/1     Running            0                 11h
egov                collection-services-6f95499675-9dps2                    1/1     Running            2 (57m ago)       11h
egov                digit-ui-847c88b6f9-shg96                               1/1     Running            0                 11h
egov                egf-instrument-5dbf4984b7-9dvg9                         1/1     Running            0                 11h
egov                egf-master-677c4bffb4-g295p                             1/1     Running            0                 11h
egov                egov-accesscontrol-58b587b8f9-szlsk                     1/1     Running            0                 11h
egov                egov-apportion-service-6c86557855-rjbrz                 1/1     Running            0                 11h
egov                egov-enc-service-786ddf68c8-wztfq                       1/1     Running            1 (11h ago)       11h
egov                egov-filestore-5bbb757b4d-bv2wl                         1/1     Running            23 (67m ago)      11h
egov                egov-hrms-7fcc65c69c-mgv92                              1/1     Running            0                 11h
egov                egov-idgen-64c57f545-rx9lm                              1/1     Running            0                 11h
egov                egov-indexer-86bdc84c-28kgf                             1/1     Running            0                 11h
egov                egov-localization-695b86d6b8-zv5tg                      1/1     Running            1 (11h ago)       11h
egov                egov-location-646776b58d-tqfq5                          1/1     Running            0                 11h
egov                egov-mdms-service-7cb6f9bd56-8hmsj                      1/1     Running            1 (98m ago)       11h
egov                egov-notification-mail-5cfb4c48c9-mbql2                 1/1     Running            0                 11h
egov                egov-notification-sms-64778bfdbb-dmj5h                  1/1     Running            0                 11h
egov                egov-otp-56c8fdc57d-6fmpf                               1/1     Running            0                 11h
egov                egov-persister-5754f4966-r47ms                          1/1     Running            0                 11h
egov                egov-pg-service-dc489f887-fc6s6                         1/1     Running            1 (11h ago)       11h
egov                egov-searcher-788875589f-wzgzv                          1/1     Running            0                 11h
egov                egov-url-shortening-6d5d46bd44-4c5wn                    1/1     Running            0                 11h
egov                egov-user-7999f8c8f6-cfw6h                              1/1     Running            1 (11h ago)       11h
egov                egov-user-chatbot-5b9c947995-bnsbk                      1/1     Running            2 (11h ago)       11h
egov                egov-workflow-v2-56d5687887-8shlr                       1/1     Running            1 (11h ago)       11h
egov                employee-5d64ff559c-fr94z                               1/1     Running            0                 11h
egov                finance-collections-voucher-consumer-765f8448c5-c8hf8   1/1     Running            0                 11h
egov                fsm-6469c8479b-bwwcs                                    1/1     Running            0                 10h
egov                fsm-calculator-56b95cf98c-s94dr                         1/1     Running            0                 11h
egov                inbox-59d9b7dd74-9g9x5                                  0/1     CrashLoopBackOff   127 (2m56s ago)   10h
egov                inbox-88889b7d-sbrpk                                    0/1     CrashLoopBackOff   127 (4m39s ago)   10h
egov                nginx-ingress-controller-b4db894c5-nqb6w                1/1     Running            0                 11h
egov                nlp-engine-594f4fbd8d-rbsn9                             1/1     Running            1 (11h ago)       11h
egov                pdf-service-688dbfc895-49qgz                            1/1     Running            0                 11h
egov                pgr-services-856c46b9-9cx9h                             0/1     CrashLoopBackOff   128 (3m18s ago)   11h
egov                rainmaker-pgr-86bcfc79c7-xmsjs                          1/1     Running            1 (87m ago)       11h
egov                report-5d75979bf7-8k7vt                                 1/1     Running            0                 11h
egov                user-otp-6bd44fb56-9bjrj                                1/1     Running            0                 11h
egov                vehicle-85b4d94bfb-wvjcd                                1/1     Running            0                 11h
egov                vendor-578f895d95-cwckr                                 1/1     Running            1 (91m ago)       11h
egov                xstate-chatbot-f5668b4b6-rp5db                          1/1     Running            0                 11h
egov                zuul-559577f967-lqfb4                                   1/1     Running            0                 11h
es-cluster          elasticsearch-data-v1-0                                 1/1     Running            0                 11h
es-cluster          elasticsearch-data-v1-1                                 1/1     Running            0                 11h
es-cluster          elasticsearch-data-v1-2                                 1/1     Running            0                 11h
es-cluster          elasticsearch-master-v1-0                               2/2     Running            0                 11h
es-cluster          elasticsearch-master-v1-1                               2/2     Running            0                 11h
es-cluster          elasticsearch-master-v1-2                               2/2     Running            0                 11h
es-cluster          kibana-v1-759f88b748-nz4s5                              1/1     Running            1 (11h ago)       11h
kafka-cluster       kafka-connect-77f8c5b5d5-mrbkx                          1/1     Running            1 (11h ago)       11h
kafka-cluster       kafka-v2-0                                              1/1     Running            0                 11h
kafka-cluster       kafka-v2-1                                              1/1     Running            0                 11h
kafka-cluster       kafka-v2-2                                              1/1     Running            1 (11h ago)       11h
kube-system         aws-node-8j5hm                                          1/1     Running            0                 11h
kube-system         aws-node-lqcxj                                          1/1     Running            0                 11h
kube-system         aws-node-w4cvv                                          1/1     Running            0                 11h
kube-system         coredns-7f5645b76-fdct7                                 1/1     Running            0                 11h
kube-system         coredns-7f5645b76-rw9v8                                 1/1     Running            0                 11h
kube-system         kube-proxy-45jrj                                        1/1     Running            0                 11h
kube-system         kube-proxy-589nd                                        1/1     Running            0                 11h
kube-system         kube-proxy-8kxbt                                        1/1     Running            0                 11h
playground          playground-6557bf8f75-rjdtm                             1/1     Running            0                 11h
zookeeper-cluster   zookeeper-v2-0                                          1/1     Running            0                 11h
zookeeper-cluster   zookeeper-v2-1                                          1/1     Running            0                 11h
zookeeper-cluster   zookeeper-v2-2                                          1/1     Running            0                 11h

b) How these services are being built and deployed ? If this is manual build & deployment then please share Docker image IDs being used by these deployments

Response -

1. Followed GitHub repo: "https://github.com/upyog/UPYOG-DevOps/tree/UPYOG-Bootcamp" with "UPYOG-Bootcamp" branch.
2. Create two new files named "egov-demo-secrets.yaml" and "egov-demo.yaml" by duplicating existing files in the "environments" folder.
3. Executed the command: "go run egov_demo_installer.go" to start the installation process.
4. During setup selected "m_pgr" and "m_fsm" service

Installation doc ref - https://upyog-docs.gitbook.io/upyog-v-1.0/upyog-1/platform/setup-upyog/full-installation-guide/on-aws/5.-deploy-upyog

Docker Images -
Chatbot - egovio/chatbot:v1.1.5-196178f4-9
Inbox - egovio/inbox:fsm-395-913aa399-1
PGR-services - egovio/pgr-services:v1.1.3-e3052c649-13

[support-upyog]

Please join todays Technical call at 4PM.

[support-upyog]

The above said issue has been resolved.