Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Migrate to OpenAI v1.0 #3

Merged
merged 69 commits into from
Nov 22, 2023
Merged

Migrate to OpenAI v1.0 #3

merged 69 commits into from
Nov 22, 2023

Commits on Oct 4, 2023

  1. Remove empty evadb.db file.

    xzdandy committed Oct 4, 2023
    Configuration menu
    Copy the full SHA
    920219c View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    2b5ba6a View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    45af91e View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    9d2227e View commit details
    Browse the repository at this point in the history
  5. Fix doc links

    xzdandy committed Oct 4, 2023
    Configuration menu
    Copy the full SHA
    c322ada View commit details
    Browse the repository at this point in the history

Commits on Oct 19, 2023

  1. Bump Version to v0.3.9+dev (#1304)

    Bump Version to v0.3.9+dev
    
    ---------
    
    Co-authored-by: Jiashen Cao <caojiashen24@gmail.com>
    Co-authored-by: Gaurav Tarlok Kakkar <gaurav21776@gmail.com>
    3 people authored Oct 19, 2023
    Configuration menu
    Copy the full SHA
    89e4888 View commit details
    Browse the repository at this point in the history
  2. Fix current issues with forecasting (#1283)

    This PR aims to solve the following issues:
    
    - [x] Throwing error when non-numeric characters are in the data
    (partially fixes #1243)
    - [x] Math domain error with `statsforecast`.
    - [x] Fix GPU support for `neuralforecast`.
    - ~Neuralforecast support for directly using batched data.~
    - ~Auto frequency determination ( #1279).~
    
    Will create separate PRs for the last two points.
    
    ---------
    
    Co-authored-by: Andy Xu <xzdandy@gmail.com>
    americast and xzdandy authored Oct 19, 2023
    Configuration menu
    Copy the full SHA
    e19f13d View commit details
    Browse the repository at this point in the history
  3. Configuration Manager Redesign (#1272)

    1. Removed `config.yml` file. Users can directly use `SET` command. 
    2. Moved `OPENAI_KEY` to `OPENAI_API_KEY`
    
    ---------
    
    Co-authored-by: hershd23 <hershdhillon23@gmail.com>
    Co-authored-by: Andy Xu <xzdandy@gmail.com>
    3 people authored Oct 19, 2023
    Configuration menu
    Copy the full SHA
    4640d8f View commit details
    Browse the repository at this point in the history
  4. Fix: minor typo (#1307)

    gaurav274 authored Oct 19, 2023
    Configuration menu
    Copy the full SHA
    a6fdd6a View commit details
    Browse the repository at this point in the history

Commits on Oct 20, 2023

  1. SnowFlake Integration for EvaDB (#1289)

    Please suggest if this feature needs more test cases
    
    ---------
    
    Co-authored-by: Lohith K S <lohithks@Lohiths-MacBook-Pro-2.local>
    kslohith and Lohith K S authored Oct 20, 2023
    Configuration menu
    Copy the full SHA
    c637a71 View commit details
    Browse the repository at this point in the history

Commits on Oct 22, 2023

  1. add documentation

    Chitti-Ankith committed Oct 22, 2023
    Configuration menu
    Copy the full SHA
    0f2d1d4 View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2023

  1. Configuration menu
    Copy the full SHA
    e026460 View commit details
    Browse the repository at this point in the history
  2. Adding doc changes

    Jineet Desai committed Oct 23, 2023
    Configuration menu
    Copy the full SHA
    0ab5ff8 View commit details
    Browse the repository at this point in the history
  3. Added note

    Chitti-Ankith committed Oct 23, 2023
    Configuration menu
    Copy the full SHA
    3c25029 View commit details
    Browse the repository at this point in the history
  4. Minor Fix

    Chitti-Ankith committed Oct 23, 2023
    Configuration menu
    Copy the full SHA
    d25b228 View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2023

  1. Configuration menu
    Copy the full SHA
    ce64231 View commit details
    Browse the repository at this point in the history
  2. Make the config related changes

    Jineet Desai committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    81ab7a3 View commit details
    Browse the repository at this point in the history
  3. checkpoint

    jarulraj committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    d340548 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    c6970bd View commit details
    Browse the repository at this point in the history
  5. Linter

    xzdandy committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    d8f4a1b View commit details
    Browse the repository at this point in the history
  6. Fix typo

    xzdandy committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    3f0d829 View commit details
    Browse the repository at this point in the history
  7. Starting the changes for XGBoost classification integration. (#1305)

    We shall add XGBoost classification support in EVADB.
    
    ---------
    
    Co-authored-by: Jineet Desai <jdesai61@gatech.edu>
    Co-authored-by: Andy Xu <xzdandy@gmail.com>
    3 people authored Oct 24, 2023
    Configuration menu
    Copy the full SHA
    703dc94 View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2023

  1. Add roadmap page to toc

    xzdandy committed Oct 25, 2023
    Configuration menu
    Copy the full SHA
    6af77d2 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    482097e View commit details
    Browse the repository at this point in the history

Commits on Oct 26, 2023

  1. Convert nested join in Vector Queries to Pandas Merge. (#1298)

    Profiling on Vector Scan showed that we are spending a lot of time in
    the post-processing logic doing a Nested Join. This is an initial commit
    to change that into a Join using Pandas. Change showed ~50% improvement
    in Similarity Queries.
    Chitti-Ankith authored Oct 26, 2023
    Configuration menu
    Copy the full SHA
    f420faa View commit details
    Browse the repository at this point in the history
  2. checkpoint

    xzdandy committed Oct 26, 2023
    Configuration menu
    Copy the full SHA
    5857740 View commit details
    Browse the repository at this point in the history
  3. docs: added survey link

    jarulraj authored Oct 26, 2023
    Configuration menu
    Copy the full SHA
    3061552 View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2023

  1. refactor: code refactor (#1319)

    Moved Function Expression Binder to a separate file
    gaurav274 authored Oct 27, 2023
    Configuration menu
    Copy the full SHA
    af696d6 View commit details
    Browse the repository at this point in the history
  2. Add Milvus integration for vector create and search (#1269)

    Integrated Milvus vector store into EvaDB. Added a `MilvusVectorStore`
    class and Milvus type for query parsing and execution.
    Below are environment values for the use of the Milvus index:
    
    * `MILVUS_URI` is the URI of the Milvus instance (which would be
    http://localhost:19530 when running locally). **This value is required**
    * `MILVUS_USER` is the name of the user for the Milvus instance.
    * `MILVUS_PASSWORD` is the password of the user for the Milvus instance.
    * `MILVUS_DB_NAME` is the name of the database to be used. This will
    default to the `default` database if not provided.
    * `MILVUS_TOKEN` is the authorization token for the Milvus instance.
    
    ---------
    
    Co-authored-by: Andy Xu <xzdandy@gmail.com>
    RichardZhangRZ and xzdandy authored Oct 27, 2023
    Configuration menu
    Copy the full SHA
    71b9aca View commit details
    Browse the repository at this point in the history
  3. Adding colab notebook for XGBoost Regression and Classification (#1316)

    Example notebook added for XGBoost regression and classification.
    
    ---------
    
    Co-authored-by: Jineet Desai <jdesai61@gatech.edu>
    jineetd and Jineet Desai authored Oct 27, 2023
    Configuration menu
    Copy the full SHA
    7c44d98 View commit details
    Browse the repository at this point in the history
  4. Added docs for SET and SHOW CONFIG query (#1323)

    Resolved #1312 partially, limited to the SQL queries themselves
    hershd23 authored Oct 27, 2023
    Configuration menu
    Copy the full SHA
    60f4b68 View commit details
    Browse the repository at this point in the history

Commits on Oct 28, 2023

  1. Configuration menu
    Copy the full SHA
    9a206b8 View commit details
    Browse the repository at this point in the history
  2. String Helper functions in EvaDB (#1322)

    Added some string helper functions that were missing based on student
    feedback. This PR adds support for UPPER, LOWER and CONCAT.
    
    Queries of the form are now supported:
    
    `SELECT CONCAT(UPPER(col1), LOWER(col2), "SOME_SUFFIX") FROM TABLE1`
    Chitti-Ankith authored Oct 28, 2023
    Configuration menu
    Copy the full SHA
    fae7001 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    0513284 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    679b193 View commit details
    Browse the repository at this point in the history
  5. Add data sources to README

    xzdandy committed Oct 28, 2023
    Configuration menu
    Copy the full SHA
    dc77d65 View commit details
    Browse the repository at this point in the history
  6. Fix list

    xzdandy committed Oct 28, 2023
    Configuration menu
    Copy the full SHA
    51bc222 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    fd92bba View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    ed7809e View commit details
    Browse the repository at this point in the history
  9. Add all models supported

    xzdandy committed Oct 28, 2023
    Configuration menu
    Copy the full SHA
    40de531 View commit details
    Browse the repository at this point in the history
  10. Add etc

    xzdandy committed Oct 28, 2023
    Configuration menu
    Copy the full SHA
    f8c9c5f View commit details
    Browse the repository at this point in the history
  11. Add link

    xzdandy committed Oct 28, 2023
    Configuration menu
    Copy the full SHA
    339e7e0 View commit details
    Browse the repository at this point in the history
  12. Add details on optimization

    xzdandy committed Oct 28, 2023
    Configuration menu
    Copy the full SHA
    4ca964e View commit details
    Browse the repository at this point in the history
  13. Add automl framework

    xzdandy committed Oct 28, 2023
    Configuration menu
    Copy the full SHA
    c57e36e View commit details
    Browse the repository at this point in the history
  14. Move around links

    xzdandy committed Oct 28, 2023
    Configuration menu
    Copy the full SHA
    affa3cf View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2023

  1. Configuration menu
    Copy the full SHA
    919cd5b View commit details
    Browse the repository at this point in the history
  2. checkpoint

    jarulraj committed Oct 30, 2023
    Configuration menu
    Copy the full SHA
    8dc9283 View commit details
    Browse the repository at this point in the history
  3. checkpoint

    jarulraj committed Oct 30, 2023
    Configuration menu
    Copy the full SHA
    2ed8448 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    8eb9e6b View commit details
    Browse the repository at this point in the history
  5. docs: Update README.md

    jarulraj authored Oct 30, 2023
    Configuration menu
    Copy the full SHA
    1c58afe View commit details
    Browse the repository at this point in the history
  6. docs: Update README.md

    jarulraj authored Oct 30, 2023
    Configuration menu
    Copy the full SHA
    52ff444 View commit details
    Browse the repository at this point in the history

Commits on Nov 2, 2023

  1. Add the validation score and training time for create_function in XGB…

    …oost (#1327)
    
    Let us show the validation score and training time for the XGBoost
    AutoML model trained. This shall give us fair enough idea on how the
    model trained on the training data set.
    
    ---------
    
    Co-authored-by: Jineet Desai <jdesai61@gatech.edu>
    jineetd and Jineet Desai authored Nov 2, 2023
    Configuration menu
    Copy the full SHA
    f409057 View commit details
    Browse the repository at this point in the history

Commits on Nov 3, 2023

  1. Add test_eva_db to gitignore (#1336)

    The environment created in the setup instructions in the documentation
    calls the environment `test_eva_db`
    LordDarkula authored Nov 3, 2023
    Configuration menu
    Copy the full SHA
    21aee56 View commit details
    Browse the repository at this point in the history
  2. Fix #1333 dependency and CMD in DockerFile (#1335)

    Update the DockerFile in order to resolve dependency issues along with
    fixing the invalid CMD that was previously passed in.
    kumeagidi authored Nov 3, 2023
    Configuration menu
    Copy the full SHA
    f56ef82 View commit details
    Browse the repository at this point in the history
  3. CREATE INDEX IF NOT EXISTS is broken. (#1337)

    This PR fixes an issue in CREATE INDEX IF NOT EXISTS command wherein if
    'IF NOT EXISTS' is passed, we had an unreferenced variable issue. Added
    Unit Tests to check the correctness of both the cases.
    
    Also reverted the index changes while merging dataframes after vector
    scan, as it's failing for some cases where indexes can be undefined.
    Chitti-Ankith authored Nov 3, 2023
    Configuration menu
    Copy the full SHA
    c296318 View commit details
    Browse the repository at this point in the history

Commits on Nov 6, 2023

  1. Support semicolon and escaped strings in lark (#1339)

    Support semi-colons in string literals for queries of the form:
    ```
    """SELECT ChatGPT("Here's a; question", "This is the context") FROM TAIPAI;"""
    ```
    
    Also support string escape to run ChatGPT queries more easily:
    ```
    """SELECT ChatGPT('Here\\'s a question', 'This is the context') FROM TAIPAI;"""
    ```
    pchunduri6 authored Nov 6, 2023
    Configuration menu
    Copy the full SHA
    6929103 View commit details
    Browse the repository at this point in the history
  2. feat: third party app support in EVADB (#1033)

    This PR introduces a generic interface to support 3rd party apps in
    EVADB. As an example. the template for integrating slack has been added.
    In a subsequent PR the integration with slack will be completed.
    
    ---------
    
    Co-authored-by: Gaurav Tarlok Kakkar <gaurav21776@gmail.com>
    Co-authored-by: Joy Arulraj <jjamesaj@gmail.com>
    Co-authored-by: Joy Arulraj <arulraj@gatech.edu>
    Co-authored-by: Kaushik Ravichandran <kravicha3@ada-01.cc.gatech.edu>
    5 people authored Nov 6, 2023
    Configuration menu
    Copy the full SHA
    bd344ed View commit details
    Browse the repository at this point in the history
  3. [WIP] Improving error handling messages for Custom Functions (#1330)

    Added separate error handling for ModuleNotFoundError and
    FileNotFoundError
    	modified:   evadb/utils/generic_utils.py
    hershd23 authored Nov 6, 2023
    Configuration menu
    Copy the full SHA
    35b772b View commit details
    Browse the repository at this point in the history
  4. logging an error message for invalid files while loading (#1334)

    Issue - [721](#721)
    
    Currently, we abort the entire process when the load executor encounters
    a corrupted file.
    rohithmulumudy authored Nov 6, 2023
    Configuration menu
    Copy the full SHA
    64219f1 View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2023

  1. checkpoint

    jarulraj committed Nov 7, 2023
    Configuration menu
    Copy the full SHA
    bb45db4 View commit details
    Browse the repository at this point in the history
  2. Verified that issue #1067 is resolved and added documentation for loa…

    …d pdf functionality. (#1343)
    
    Issue #1067 about not being able to load pdf files, was verified to be
    working with evadb documentation pdf and a new page for loading pdf is
    added to the documentation.
    <img width="1310" alt="Screenshot 2023-11-07 at 1 33 01 AM"
    src="https://github.com/georgia-tech-db/evadb/assets/32676813/af2fa40b-c8c1-4f3d-b93f-98d0bf278a5b">
    
    Co-authored-by: Lohith K S <lohithks@Lohiths-MacBook-Pro-2.local>
    kslohith and Lohith K S authored Nov 7, 2023
    Configuration menu
    Copy the full SHA
    7a49bec View commit details
    Browse the repository at this point in the history

Commits on Nov 10, 2023

  1. Add train scores for ludwig in the create function handler. (#1342)

    In the previous commit, we added the changes for displaying the train
    scores and train times for XGBoost. We plan to add similar changes to
    Ludwig integration as well.
    
    ---------
    
    Co-authored-by: Jineet Desai <jdesai61@gatech.edu>
    Co-authored-by: Andy Xu <xzdandy@gmail.com>
    3 people authored Nov 10, 2023
    Configuration menu
    Copy the full SHA
    1c78b22 View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2023

  1. Make Logic Operators Case Insensitve (#1352)

    - Fix the following queries:
    
    ```
    SELECT * FROM postgres_data.home_rentals where neighborhood='downtown' and number_of_rooms=2;
    ```
    
    - Improve the error message: Instead of throwing arbitrary mask error,
    now we raise `Unsupported Logical Operator: ...`.
    xzdandy authored Nov 14, 2023
    Configuration menu
    Copy the full SHA
    995f7fe View commit details
    Browse the repository at this point in the history
  2. Job scheduler implementation (#1308)

    This PR adds support for creating and dropping jobs in evadb based on
    this [task](#1248).
    
    1.  Jobs can be created using the create job query:
    
       
    > CREATE JOB {job_name} AS {
    >             {job_queries; ...}
    >     }
    >     START {start_time}
    >     END {end_time}
    >     EVERY {repeat_period} {repeat_unit}
    
    2. Created jobs can be dropped using:
    
    > DROP JOB {job_name}
    
    3. The scheduled jobs will only be triggered if the job scheduler
    process is started explicitly using:
    
    > EvaDBConnection.start_jobs()
    
    4. The job scheduler process can be stopped using:
    
    > EvaDBConnection.stop_jobs()
    
    ---------
    
    Co-authored-by: Gaurav Tarlok Kakkar <gaurav21776@gmail.com>
    dungnmaster and gaurav274 authored Nov 14, 2023
    Configuration menu
    Copy the full SHA
    1fbb74f View commit details
    Browse the repository at this point in the history

Commits on Nov 16, 2023

  1. Configuration menu
    Copy the full SHA
    2575f4f View commit details
    Browse the repository at this point in the history
  2. Add feedback for forecasting (#1258)

    Provide feedback when `Forecasting` UDF is called in the following ways:
    
    - [x] Reporting confidence intervals
    - [x] Returning a metric for the forecasting performance.
    - [x] Providing suggestions in simple special cases, such as during Flat
    predictions.
    
    Eg:
    ```sql
    SELECT HomeForecast();
    ```
    
    ```
    SUGGESTION: Predictions are flat. Consider using LIBRARY 'neuralforecast' for more accrate predictions.
    ```
    
    Partially fixes #1257 and #1243.
    
    ---------
    
    Co-authored-by: Andy Xu <xzdandy@gmail.com>
    americast and xzdandy authored Nov 16, 2023
    Configuration menu
    Copy the full SHA
    69b39b8 View commit details
    Browse the repository at this point in the history

Commits on Nov 17, 2023

  1. Adding changes for Flaml Sklearn integration (#1361)

    Flaml provides support for Sklearn models like Random Forests, KNN,
    Extra Trees Regressor, and Logistic Regression with regularization. We
    plan to integrate these ML models into EVADB.
    Link for Flaml documentation:
    https://microsoft.github.io/FLAML/docs/Use-Cases/Task-Oriented-AutoML
    
    ---------
    
    Co-authored-by: Jineet Desai <jdesai61@gatech.edu>
    jineetd and Jineet Desai authored Nov 17, 2023
    Configuration menu
    Copy the full SHA
    0c25a44 View commit details
    Browse the repository at this point in the history
  2. Migrate ChatGPT function to openai v1.0 (#1368)

    Migrate ChatGPT function to openai v1.0.
    
    The test is skipped in circleCI because we must supply the
    `OPENAI_API_KEY`. The test passes on local machine.
    
    - [x] Upgrade ChatGPT function.
    - [x] Upgrade Dall-e function.
    - [x] Update unit test cases.
    - [x] Verify that notebooks work correctly.
    pchunduri6 authored Nov 17, 2023
    Configuration menu
    Copy the full SHA
    5aaa447 View commit details
    Browse the repository at this point in the history

Commits on Nov 19, 2023

  1. Configuration menu
    Copy the full SHA
    8a8fc46 View commit details
    Browse the repository at this point in the history