v0.3.2

What's Changed

• [Bug Fix] Slack Message History Not Being Passed Introduced by Another Hotfix During 0.3.1 by @davidgxue in #319
• Updated Weaviate Docker image url (auto PR by bot) by @weaviate-git-bot in #320
• Change Firestore Metric Field Name to Load into Snowflake by @davidgxue in #321
• [Bug Fix] Add client = slack even when there's no thread by @jlaneve in #322
• Regex update to avoid over-redaction of GitHub issues by @bismuthsalamander in #325
• LLM & Reranker Model Upgrades, Minor Improvements + DAG Fixes Due to Change in Data Source Format by @davidgxue in #326

Full Changelog: v0.3.1...v0.3.2

v0.3.1

What's Changed

Bug Fixes

• [Hotfix] Fix Example Requests Cards Not Showing on UI After 0.3.0 release #310
• [Hotfix] Address URL Formatting Issue Not Resolved During 0.3.0 release #312

Misc

• Upgrade gpt-4-32k to GPT-4-Turbo (128K context length) for cost reduction and performance improvement #313

Full Changelog: v0.3.0...v0.3.1

v0.3.0

What's Changed

Improvements

• Add the ingestion of Astronomer's Cosmos documentation. #290
• Vastly improve the HTML chunking logic, content fetching logic for URLs, and the ingestion of Astronomer documentation from Astronomer's website. #293
• Vastly improve the Python & Markdown chunking logic, enforce strict token limit per chunk globally, improve multiple extract and scraping processes. #307
• Upgrade the Weaviate schema to utilize the new OpenAI embedding modeltext-embedding-3-small. #297
• Implement preprocessing steps for request prompts to handle invalid cases and parse invalid symbols. #279
• Add a backend message and a frontend banner to notify users of service maintenance. #294
• Update system prompts to discourage discussions on unwanted topics and to caution users about potential hallucinations. #308

Bug Fixes

• Resolve inconsistent output parsing and formatting in the MultiQueryRetriever prompt rewording. #276
• Fix typing errors in the Airflow documentation ingestion task introduced in 0.2.0 release. #283
• Introduce a delay between web scraping requests to prevent rate limiting issues. #269
• Address issues with the rate limiter by adding sveltekit-rate-limiter with automated exponential backoff and retry. #280
• Fix invalid parameter parsing bugs and improve the semi-automated quality evaluation DAG. #303
• Fix incorrect hyperlink formatting in website UI by amending the system prompt based on client type. #306
• Correct wrong default feedback scoring in Snowflake metrics ingestion DAG and track client type as an additional metric. #304

Misc

• Consolidate the Azure US East configuration and credentials. #288
• Modify the ingestion schedule interval to a weekly frequency. #284

Full Changelog: v0.2.0...v0.3.0

v0.2.0

What's Changed

Improvements

• Upgrade the weaviate provider to apache-airflow-providers-weaviate==1.3.0 and use all upstream operators and hook methods for ingestion in airflow DAGs. #246
• Change user prompt rewording, add hybrid search, Cohere Reranker and LLM Chain Filter to document retrieval. #247
• Add Astro CLI ingestion to the weaviate database. #200
• Extract all GH issues with the date and time filter for ingestion. #182, #229
• Ingest Astronomer-provider and Astro-SDK HTML documentation to weaviate database. Ingestion of Astro SDK documentation is disabled in production. #199
• Ingest Stackoverflow using their API. #181
• Ingest Astro forum documentation. #212
• Use sanic-limiter to throttle Ask-Astro API based on IP address. #235
• Use astronomer documentation from the webpage (https://docs.astronomer.io/) instead of from the Github repository. #238
• Send Slack alerts for DAG failures. #249
• Add metric tracking: track request-id, score, success and created_at metrics in Snowflake. 239
• Clean and consolidate the logic for the HTML extractor for the airflow ingestion DAGs. #237

Bug fixes

• Add retry logic for answering questions in Ask Astro. #180
• Refactor extract_astro_blogs to fetch all astronomer blogs. #176
• Fix h1 text alignment in Ask Astro UI. #219
• Return the source documents in the same order for the Slack bot as per the response in the UI. #256
• Update monitoring DAG to monitor all the ingestion DAGs. #225
• Improve the readability of answers in Ask Astro results which are in list format. #240
• Add retry in the feedback DAGs. #183

Documentation

• Improve the structure and readability of the documents. #162
• Add documentation to deploy airflow DAGs locally. #201
• Remove ingestion of data from Slack from README. #214

Misc

• Add test automation script for Ask-Astro to automate and ease testing and evaluation of the model responses. #210
• Setup ruff as part of pre-commit hooks. #175, #207
• Bump cryptography from 41.0.5 to 41.0.6. #218
• Bump vite from 4.4.9 to 4.4.12. #217
• Add sanic_limiter lock in poetry. #233

Full Changelog: v0.1.0...v0.2.0

v0.1.0

What's Changed

Improvements

• Integrate Ask-Astro Slack bot with Apache Airflow Slack, specifically in the #airflow-astronomer channel. Ask Astro is a Slack bot for questions about Apache Airflow and Astro. #42, #57, #48
• Integrate the Ask-Astro ingestion DAGs with the new apache-airflow-providers-weaviate provider, utilizing the task flow API for streamlined data ingestion. #132, #177
• Add monitoring capabilities for Ask-Astro infrastructure, including error tracking and detailed metrics for the Google Firebase app, Weaviate class, the UI of https://ask.astronomer.io, and Airflow DAGs for data ingestion and feedback. Also add observability for APIs and Slackbot, with metrics and details reported directly to designated Slack channels. #98, #60, #117
• Update Sanic framework to use overflow: auto instead of scroll, optimising interface responsiveness and user experience. #12
• Integrate CircleCI and add pre-commit hooks along unit tests, enhancing automation and code quality checks. #19, #15, #130
• Add a local development story script for Ask-Astro, enabling seamless local testing and running of frontend, backend, and Slackbot with comprehensive documentation. #18, #121
• Introduce Apache Airflow documentation as the source for data ingestion in Ask-Astro DAGs. #50, #132
• Implement unit tests for APIs, now integrated within the Continuous Integration pipeline, ensuring thorough testing for any new additions to the repository. #77, #103, #78
• Implement functionality to hide feedback requests in Ask-Astro when an error occurs, such as when the given prompt is empty. #102, #86
• Add a Contact Us link to AI-generated responses in Ask-Astro, facilitating easier user access to support and assistance. #75

Bug fixes

• Resolve message card rendering issues in the Ask-Astro Svelte UI, ensuring a smoother and more visually consistent user experience. #172
• Fix static check issues in Ask-Astro, enhancing code quality and reliability. #53
• Add missing langsmith environment variable for improved system observability. #74
• Modify the Ask-Astro Slackbot to respond in the same Slack thread for feedback, replacing its previous behaviour of responding privately to the user. #95

Documentation

• Add comprehensive CI/CD configuration documentation, enhancing understanding of deployment workflows. #46
• Introduce detailed documentation for Google Firestore setup, providing clear setup guidelines. #48
• Expand Slack documentation to include Interactivity & Shortcuts steps, enriching user interaction. #57
• Set up CircleCI deploy-docs job, streamlining the documentation deployment process. #130
• Consolidate Airflow DAGs documentation and corrected image paths for improved clarity. #131
• Implement Sphinx documentation, offering a structured and comprehensive documentation format. #79
• Add GitHub templates for issue reporting and bug tracking, facilitating better community contributions. #92
• Introduce monitoring documentation and guidelines, aiding in effective system oversight and observability. #123

Misc

• Refactor code to reduce complexity, perform code clean-up, add robust exception handling, integrate Sanic framework for configurations and update documentation with doc-strings and typing. #61
• Implement Segment Cookie Consent Manager for enhanced Web Traffic Analytics and Tag Management, ensuring compliant and effective user tracking. #10
• Reorganize tasks and add UI server-related tasks for improved management and accessibility. Now featuring an updated task list including API server initialization, running with Docker or Poetry, container management, Sphinx docs building, local doc serving, UI server initialization, and UI server running. Also, fix missing links in the documentation. #87, #96

Full Changelog: https://github.com/astronomer/ask-astro/commits/v0.1.0