Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Not able to see the exact status of ETL enable /disable #1125

Closed
AchalaBelokar opened this issue Feb 7, 2024 · 2 comments
Closed

Not able to see the exact status of ETL enable /disable #1125

AchalaBelokar opened this issue Feb 7, 2024 · 2 comments
Assignees
Labels
bug Something isn't working

Comments

@AchalaBelokar
Copy link

AchalaBelokar commented Feb 7, 2024

Describe the bug
when I am login with admin user and check Active analytics data sync for org it not showing anything and also when I open show it is not showing it.

To Reproduce
Steps to reproduce the behavior:

  1. login as admin user
  2. go to the organisation’s tab
  3. see the analytic table
  4. See error

Expected behavior
Able to see the clear status of analytic

analytic example users, environment detail, username against which this issue is happening.

Analysis:

The issue seems to be that ETL is not running in prerelease-integration machine. Looks like it has stopped running from the time 5th Feb on which prerelease setup for bugbash was done. On trying to restart ETL service it failed:

ubuntu@ip-172-1-2-108:/var/log/avni-etl-service$ sudo systemctl status avni-etl-service_appserver.service
× avni-etl-service_appserver.service - Avni ETL server
     Loaded: loaded (/lib/systemd/system/avni-etl-service_appserver.service; enabled; vendor preset: enabled)
     Active: failed (Result: exit-code) since Wed 2024-02-07 11:39:13 UTC; 52s ago
    Process: 1054879 ExecStart=/opt/avni-etl-service/start.sh (code=exited, status=1/FAILURE)
   Main PID: 1054879 (code=exited, status=1/FAILURE)
        CPU: 11.187s

Feb 07 11:39:13 ip-172-1-2-108 start.sh[1054880]:         at org.hibernate.engine.jdbc.dialect.internal.DialectFactoryImpl.determineDialect(DialectFa>
Feb 07 11:39:13 ip-172-1-2-108 start.sh[1054880]:         at org.hibernate.engine.jdbc.dialect.internal.DialectFactoryImpl.buildDialect(DialectFactor>
Feb 07 11:39:13 ip-172-1-2-108 start.sh[1054880]:         at org.hibernate.engine.jdbc.env.internal.JdbcEnvironmentInitiator.initiateService(JdbcEnvi>
Feb 07 11:39:13 ip-172-1-2-108 start.sh[1054880]:         at org.hibernate.engine.jdbc.env.internal.JdbcEnvironmentInitiator.initiateService(JdbcEnvi>
Feb 07 11:39:13 ip-172-1-2-108 start.sh[1054880]:         at org.hibernate.boot.registry.internal.StandardServiceRegistryImpl.initiateService(Standar>
Feb 07 11:39:13 ip-172-1-2-108 start.sh[1054880]:         at org.hibernate.service.internal.AbstractServiceRegistryImpl.createService(AbstractService>
Feb 07 11:39:13 ip-172-1-2-108 start.sh[1054880]:         ... 39 common frames omitted
Feb 07 11:39:13 ip-172-1-2-108 systemd[1]: avni-etl-service_appserver.service: Main process exited, code=exited, status=1/FAILURE
Feb 07 11:39:13 ip-172-1-2-108 systemd[1]: avni-etl-service_appserver.service: Failed with result 'exit-code'.
Feb 07 11:39:13 ip-172-1-2-108 systemd[1]: avni-etl-service_appserver.service: Consumed 11.187s CPU time.

Acceptance criteria:

  • ETL on prerelease need to be fixed to carry out release-sign off testing
  • Make sure the appropriate branch of ETL is deployed on prerelease
  • Update readme here if needed to prevent such issue happening again
  • Make sure 'Active analytics data sync' column value displays after the fix.
@AchalaBelokar AchalaBelokar added the bug Something isn't working label Feb 7, 2024
@github-project-automation github-project-automation bot moved this to New Issues in Avni Product Feb 7, 2024
@mahalakshme mahalakshme moved this from New Issues to Ready in Avni Product Feb 7, 2024
@1t5j0y 1t5j0y moved this from Ready to In Progress in Avni Product Feb 7, 2024
@1t5j0y 1t5j0y self-assigned this Feb 7, 2024
1t5j0y added a commit to avniproject/avni-infra that referenced this issue Feb 7, 2024
@1t5j0y 1t5j0y moved this from In Progress to QA Ready in Avni Product Feb 7, 2024
@AchalaBelokar AchalaBelokar moved this from QA Ready to In QA in Avni Product Feb 8, 2024
@AchalaBelokar
Copy link
Author

  • it is reflected but I am changing the active analytics enable disable it is showing me 500 error code.

Image

@AchalaBelokar AchalaBelokar moved this from In QA to In Progress in Avni Product Feb 8, 2024
@AchalaBelokar AchalaBelokar moved this from In Progress to Ready in Avni Product Feb 8, 2024
@AchalaBelokar AchalaBelokar moved this from Ready to QA Failed in Avni Product Feb 8, 2024
@1t5j0y 1t5j0y moved this from QA Failed to In Progress in Avni Product Feb 8, 2024
@1t5j0y
Copy link
Contributor

1t5j0y commented Feb 8, 2024

Issue seems to be due to DB slowness - the 500 was due to ETL already being enabled for the org.
Working fine after @himeshr upgraded prerelease db instance class. No other fix applied.

@mahalakshme / @vinayvenu noticed one thing that we might want to fix - the ETL POST /job/status API (called on the list of orgs webapp screen) checks for the existence of job for orgs while the GET /job/<orguuid> (called on the org specific screen) looks at whether there are any scheduled job run records for the org. This discrepancy shows a different status for an org on the list of all orgs (status: enabled) and the org specific screen (status: disabled) and the user ends up in a state where they are trying to enable ETL for an org which already has ETL enabled (but has not run yet).

@1t5j0y 1t5j0y moved this from In Progress to QA Ready in Avni Product Feb 8, 2024
@AchalaBelokar AchalaBelokar moved this from QA Ready to In QA in Avni Product Feb 9, 2024
@AchalaBelokar AchalaBelokar moved this from In QA to Done in Avni Product Feb 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
Archived in project
Development

No branches or pull requests

3 participants