Add LLM improvements #1144

RichDom2185 · 2024-08-04T04:44:13Z

Access control
Logging & auditing
Move prompt generation to BE to prevent bypass

Only contains some migrated data at the moment.

RichDom2185 · 2024-08-04T08:00:44Z

@yiwen101 the prompt builder is separated from SICP notes so that we can put AG logic inside the builder and retain the abstraction

lib/cadet_web/plug/rate_limiter.ex

* Rename query to context for clarity * Add missing alias and documentation

coveralls · 2024-08-04T08:21:45Z

coverage: 94.623% (-0.7%) from 95.295%
when pulling 1262af9 on llm-improvements
into 9cab952 on master.

* Set context size limit * Fix update issue * Fix write issue * Fix parse issue

…backend into llm-improvements

yiwen101

LGTM

RichDom2185 · 2024-08-11T09:05:00Z

Corresponding FE PR: source-academy/frontend#3010

RichDom2185 added 5 commits July 15, 2024 08:41

Create SICP notes module

fe86005

Only contains some migrated data at the moment.

Create prompt builder module

d215fce

Migrate more SICP notes from frontend

6a2042b

Migrate more SICP notes from frontend

92d07a9

Migrate remaining SICP notes from frontend

0f0e2da

RichDom2185 self-assigned this Aug 4, 2024

RichDom2185 added 2 commits August 4, 2024 12:44

Merge branch 'master' into llm-improvements

2c24748

Update controller request body

937cd3b

yiwen101 force-pushed the llm-improvements branch 2 times, most recently from 7d40dd7 to a961e38 Compare August 4, 2024 07:27

RichDom2185 commented Aug 4, 2024

View reviewed changes

lib/cadet_web/plug/rate_limiter.ex Outdated Show resolved Hide resolved

RichDom2185 force-pushed the llm-improvements branch from 1a1403f to 937cd3b Compare August 4, 2024 08:08

RichDom2185 added 8 commits August 4, 2024 16:10

Update gitignore

4fba342

Create conversation table and entity

ea4e438

Create conversation service

dfc8008

Create chat view for chatroom initialization

6de990a

Fix prompt builder errors

620d96d

* Rename query to context for clarity * Add missing alias and documentation

Create controller endpoint to create new chatroom

96ddc6e

Fix credo errors

2d3bdff

Fix typo

82dcb57

RichDom2185 added 8 commits August 4, 2024 16:41

Update return value from add_message

4d8c4e9

Add user check for conversation retrieval

f87ba4b

Update chat endpoint to call LLM conversation service

73a9cf7

Update router to introduce new endpoints

a378160

Set up response view

cc7a77a

Change PUT to POST

ce703c2

Fix bugs and set up mock response

2708caf

* Set context size limit * Fix update issue * Fix write issue * Fix parse issue

Fix wrong variable used in render template

69adffb

RichDom2185 and others added 6 commits August 5, 2024 01:22

Merge branch 'master' into llm-improvements

064095d

Update testcases [no ci]

5d8568c

Merge branch 'master' into llm-improvements

fa6e9e2

Update chat_controller_test.exs

1beab94

Merge branch 'llm-improvements' of https://github.com/source-academy/…

206f452

…backend into llm-improvements

Remove check on section's format

742f24e

yiwen101 force-pushed the llm-improvements branch from c341920 to 742f24e Compare August 10, 2024 18:01

Try fix failing type check

88ebede

yiwen101 marked this pull request as ready for review August 10, 2024 18:21

yiwen101 approved these changes Aug 10, 2024

View reviewed changes

RichDom2185 added 13 commits August 11, 2024 14:37

Prefer alias over qualified type

250ddd6

Update chat controller test names

0d20c6f

Use 404 for not found status code

b3667b6

Fix incorrect status code

215e34c

Create test conversation factory

784420b

Fix factory

f1598d7

Fix types and belongs to association

5018c90

Update test setup

9c0454f

Mock OpenAI response

4a7f4d4

Add and update tests to use mock response

361344b

Fix JSON parsing

b100152

Fix status code and update mock response

d9db15e

Fix tests

1262af9

RichDom2185 merged commit de659af into master Aug 11, 2024
1 check passed

RichDom2185 deleted the llm-improvements branch August 11, 2024 09:04

RichDom2185 mentioned this pull request Aug 11, 2024

Add LLM improvements source-academy/frontend#3010

Merged

7 tasks

This was referenced Aug 12, 2024

Improve LLM security and reliability #1113

Closed

Track LLM Usage #1112

Open

Limit LLM individual message payload size #1150

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add LLM improvements #1144

Add LLM improvements #1144

RichDom2185 commented Aug 4, 2024 •

edited by yiwen101

Loading

RichDom2185 commented Aug 4, 2024

coveralls commented Aug 4, 2024 •

edited

Loading

yiwen101 left a comment

RichDom2185 commented Aug 11, 2024

Add LLM improvements #1144

Add LLM improvements #1144

Conversation

RichDom2185 commented Aug 4, 2024 • edited by yiwen101 Loading

RichDom2185 commented Aug 4, 2024

coveralls commented Aug 4, 2024 • edited Loading

yiwen101 left a comment

Choose a reason for hiding this comment

RichDom2185 commented Aug 11, 2024

RichDom2185 commented Aug 4, 2024 •

edited by yiwen101

Loading

coveralls commented Aug 4, 2024 •

edited

Loading