Add model parameters to restrict max tokens #22

xdotli · 2024-09-05T22:11:02Z

No description provided.

node-zerox/src/openAI.ts

node-zerox/src/types.ts

node-zerox/src/index.ts

node-zerox/src/utils.ts

node-zerox/src/openAI.ts

node-zerox/src/utils.ts

annapo23 · 2024-09-10T20:29:56Z

node-zerox/src/index.ts

+  const invalidKeys = Object.keys(params).filter(
+    (key) => !validKeys.includes(key)
+  );
+


Maybe we should check if the value is correct type of number. Right now, it seems I can pass in i.e. topP: [], which causes OpenAI to throw an error. What are your thoughts?

If we want to validate the type of the value as well, then either manually validate (switch case) or Zod. Without Zod basically have to do type gymnastics manually.

…ntent-length-param

Add model parameters to restrict max tokens

Add model parameters to restrict max tokens

480ce33

tylermaran reviewed Sep 6, 2024

View reviewed changes

node-zerox/src/openAI.ts Outdated Show resolved Hide resolved

annapo23 reviewed Sep 7, 2024

View reviewed changes

node-zerox/src/types.ts Outdated Show resolved Hide resolved

annapo23 reviewed Sep 7, 2024

View reviewed changes

node-zerox/src/index.ts Outdated Show resolved Hide resolved

annapo23 reviewed Sep 7, 2024

View reviewed changes

node-zerox/src/index.ts Show resolved Hide resolved

xdotli added 3 commits September 9, 2024 14:05

Added type safe LLMParam object with coherant key naming

67c7b07

Python failing SSL debugging

71949be

Python llm param finish

d93f5e5

xdotli self-assigned this Sep 10, 2024