Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix description not available and optimize sastjob with aiohttp and asyncio for faster execution #56

Open
wants to merge 4 commits into
base: main
Choose a base branch
from

Conversation

pishone-accuknox
Copy link

@pishone-accuknox pishone-accuknox commented Jan 27, 2025

This PR provides a fix for Description not Available (CNAPP-17258) as well as optimizations for faster executions.

  1. In SQ API v9.5, the field 'htmlDesc' has been deprecated. This fix will fetch description from 'descriptionSections' and put it as an array of objects.

  2. Provides optimization for sastjob with concurrent API calls using aiohttp.
    Execution time of 'ask-ada' before optimization: 1h, 32m, 29s
    image

After optimization: 43s
image

There's no notable difference in memory usage either:
image

@pishone-accuknox pishone-accuknox changed the title feat: optimize sastjob with aiohttp and asyncio for faster execution fix description not available and optimize sastjob with aiohttp and asyncio for faster execution Jan 29, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants