Code

New Feature: Vision Support for Khoj#889

Code

Merged

sabaimran merged 37 commits intokhoj-ai:masterkhoj-ai/khoj:masterfrom MythicalCow:vision-supportMythicalCow/khoj:vision-supportCopy head branch name to clipboardSep 9, 2024

+741-418

Commits

Commits on Aug 13, 2024

• vision ui and s3 image upload complete

  MythicalCow

  committed
  8ea0d8d

• gpt-4o vision support complete. chatml upgrades

  MythicalCow

  committed
  9cddfd8

Commits on Aug 14, 2024

• updated messages to use image_url instead of base64

  MythicalCow

  committed
  48ad012

• fixed bug where image continues to be rendered after message is sent

  MythicalCow

  committed
  93a680a

• removed image

  MythicalCow

  committed
  83740ee

• changed s3 bucket to env variable

  MythicalCow

  committed
  41535d2

• database change to have vision_enabled parameter for models

  MythicalCow

  committed
  737e9bd

• code clean up part 1

  MythicalCow

  committed
  cc0b716

• code clean up part 3

  MythicalCow

  committed
  0c59f59

• cleaned up user image upload post request

  MythicalCow

  committed
  f563c0f

• bug fix for vision issues during new conversation creation

  MythicalCow

  committed
  d73cf35

Commits on Aug 15, 2024

• share chat changes. testing required

  MythicalCow

  committed
  cee39bb

Commits on Aug 16, 2024

• PR changes

  MythicalCow

  committed
  6bf706c

• removing unnecessary dependencies

  MythicalCow

  committed
  d1815a9

• removing unnecessary dependency

  MythicalCow

  committed
  806ff60

• Merge branch 'khoj-ai:master' into vision-support

  MythicalCow

  authored
  8a6f6d8

• db migration

  MythicalCow

  committed
  33abce6

• tightening CSP

  MythicalCow

  committed
  4eeee0a

• migration

  MythicalCow

  committed
  bb6f78a

Commits on Sep 5, 2024

• Merge branch 'master' of github.com:khoj-ai/khoj into vision-support

  sabaimran

  committed
  f1dfdc6

• Update yarn.lock

  sabaimran

  committed
  ced1f35

• Handle case where image upload bucket is not configured

  sabaimran

  committed
  b483700

• Include image url if included in previous user messages and improve chatml construction

  sabaimran

  committed
  76351eb

• Add a merge migration to resolve with master

  sabaimran

  committed
  bd1f5a8

• Render previously uploaded images in the chat history, show uploaded images for pending msgs

  sabaimran

  committed
  294c068

• add list typing in merge migrations file

  sabaimran

  committed
  d2f9c3e

Commits on Sep 6, 2024

• Revert yarn.lock file to use yarnpkg.com

  sabaimran

  committed
  ed502e8

• Revert shadcn package version to 0.8.0

  sabaimran

  committed
  ff7adbb

Commits on Sep 7, 2024

• Pass the uploaded_image_url through to subqueries

  sabaimran

  committed
  d4ee1d3

• Allow image to render upon first message from the homepage

  sabaimran

  committed
  a52e958

• Add rendering support for images to shared chat as well

  sabaimran

  committed
  06682e0

• Fix some UI/functionality bugs in the share page

  sabaimran

  committed
  ccebf8b

• Remove unnecessary packages added in package.json

  sabaimran

  committed
  3e02cbf

Commits on Sep 9, 2024

• Convert user attached images for chat to webp format before upload

  Show description for 95b2adc
  debanjum

  committed
  95b2adc

• Use placeholder to attached image for data source, response mode actors

  Show description for d689ac8
  debanjum

  committed
  d689ac8

• Update all clients to call /api/chat as a POST instead of GET request

  Show description for b7d9da7
  debanjum

  committed
  b7d9da7

• Fix copying chat messages with images to clipboard

  Show description for 454e914
  debanjum

  committed
  454e914