Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add acedata login #8

Merged
merged 956 commits into from
Nov 16, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
956 commits
Select commit Hold shift + click to select a range
e55589c
Help documentation URL correction (#9704)
AAEE86 Oct 23, 2024
7eef1b3
fix: revert ref usage in handleFormChange to fix IME input issues (#9…
kurokobo Oct 23, 2024
335ecd2
feat: added claude 3.5 sonnet v2 model to Google Cloud Vertex AI (#9688)
hellof20 Oct 23, 2024
5436390
nltk security issue and upgrade unstructured (#9558)
JohnJyong Oct 23, 2024
e945c88
build(deps): bump mermaid from 10.4.0 to 10.9.3 in /web (#9709)
dependabot[bot] Oct 23, 2024
ffdde38
feat(model_runtime): add new model 'claude-3-5-sonnet-20241022' (#9708)
laipz8200 Oct 23, 2024
c0ea6db
Feat: use file size limit from api (#9711)
JzoNgKVO Oct 23, 2024
02bf6ac
build(deps): bump next from 14.2.4 to 14.2.10 in /web (#9713)
dependabot[bot] Oct 23, 2024
344dc4f
feat: support user-defined configuration of log file size and retenti…
hwzhuhao Oct 23, 2024
48771f0
Revert "Feat: use file size limit from api" (#9714)
JzoNgKVO Oct 23, 2024
f525326
fix: refresh current page if url contains token (#9718)
douxc Oct 23, 2024
abdbaaa
chore: update version to 0.10.1 (#9689)
laipz8200 Oct 23, 2024
dbf9a61
Modify characters (#9707)
AAEE86 Oct 23, 2024
e9ce13e
remove ppt import (#9721)
JohnJyong Oct 23, 2024
bfa65d9
downgrade unstructured nltk version (#9726)
JohnJyong Oct 23, 2024
f2ddeb2
add vdb py test (#9706)
JohnJyong Oct 23, 2024
e0b29f4
fixed: variable reference error (#9722)
luckylhb90 Oct 23, 2024
99da29c
Update Code Generator to use the currently configured model. (#9740)
Kota-Yamaguchi Oct 24, 2024
b3b7b44
fix(api): handle missing upload_file_id for tool_file messages (#9756)
laipz8200 Oct 24, 2024
a425c9e
feat: regenerate history switch navigation (#8749)
xuzuodong Oct 24, 2024
5c5f2f9
feat:Add host volume env variables for postgres, redis and weaviate (…
jter Oct 24, 2024
102f0f1
fix: fe can not start (#9768)
iamjoel Oct 24, 2024
87bb378
Update README_CN.md (#9766)
sunner Oct 24, 2024
9e791ab
fix: chat log not showing correctly (#9777)
xuzuodong Oct 24, 2024
ab26ca2
refactor(file_factory): improve filename and mime type determination …
laipz8200 Oct 24, 2024
48f1d2c
fix(workflow): enhance prompt handling with vision support (#9790)
laipz8200 Oct 24, 2024
bf58f88
remove unstructured pdf extract (#9794)
JohnJyong Oct 24, 2024
3754bd5
fix: chart tool can't display chinese (#9686)
hjlarry Oct 24, 2024
5ce2611
chore(docker): correct package version for expat and perl in Dockerfi…
laipz8200 Oct 24, 2024
9d39fd5
openai compatiable api usage and id (#9800)
guogeer Oct 24, 2024
be5c778
chore(docker): add default for MAX_VARIABLE_SIZE in docker-compose (#…
laipz8200 Oct 24, 2024
a434c24
feat(parameters): standardize system parameter field types and values…
laipz8200 Oct 24, 2024
19b99a9
chore: abstract common function with local storage (#9811)
yaoice Oct 24, 2024
5b500f4
Added description for .ppt, specify the reason for unstructured.io (#…
Theysua Oct 24, 2024
32c58d7
chore: make doc extractor node also can extract text by file extensio…
hjlarry Oct 24, 2024
90e29f3
Feat: use file size limit from api (#9739)
JzoNgKVO Oct 24, 2024
11ae746
feat(api): add generic file size limit parameter (#9812)
laipz8200 Oct 25, 2024
77005f3
refactor: update load_stream method to directly yield file chunks (#9…
hwzhuhao Oct 25, 2024
1159d92
fix: duckduckgo image search not work (#9821)
hjlarry Oct 25, 2024
8c5f298
feat: create_empty_dataset api add the description parameter and upda…
rchlz Oct 25, 2024
5297842
fix: yuque book id should be string (#9819)
crazywoola Oct 25, 2024
8f5a04c
chore: add local storage test (#9827)
yaoice Oct 25, 2024
4dbf5e5
add tidb on qdrant type (#9831)
JohnJyong Oct 25, 2024
a956b15
fix: exclude failed answer when sending messages (#9835)
xuzuodong Oct 25, 2024
bca3791
fix: moonshot response_format raise error (#9847)
hjlarry Oct 25, 2024
6c548c8
chore: code generator button should only display in code node (#9842)
hjlarry Oct 25, 2024
8e3481c
Fix: add check for maximum chunk length (#9837)
JzoNgKVO Oct 25, 2024
c7a8c13
chore: update api docs (#9832)
JzoNgKVO Oct 25, 2024
d0f7dfa
chore: translate i18n files (#9853)
github-actions[bot] Oct 25, 2024
6d6dc57
Marking the last piece of data on each page is a duplicate issue, whi…
yuanboao Oct 25, 2024
1ccfe34
feat: allow answer node use chat_var and env_var (#9226)
hjlarry Oct 25, 2024
4b5f32d
fix: segement settings of documents raise error (#8971)
hjlarry Oct 25, 2024
a54be04
upgrade nltk, unstructured and starlette (#9860)
JohnJyong Oct 25, 2024
01f3dfa
chore: add default value for redis configuration (#9864)
hwzhuhao Oct 25, 2024
a89b40d
feat: support comfyui workflow tool image generate image (#9871)
hjlarry Oct 25, 2024
f1f4053
feat: support button in markdown (#9876)
crazywoola Oct 25, 2024
8b372d6
fix: wrong element object (#9868)
virgosoy Oct 25, 2024
07e7498
fix(workflow): Take back LLM streaming output after IF-ELSE (#9875)
laipz8200 Oct 25, 2024
f5fe742
fix users had already joined a workspace, but the system still first …
G81192 Oct 25, 2024
db0622b
docs: improve api documentation for advanced chat and workflow (#9882)
kurokobo Oct 26, 2024
b47470f
Update README.md (#9886)
leilei-jiang Oct 26, 2024
d932346
Update README.md (#9889)
leilei-jiang Oct 26, 2024
0386bd6
Update README.md (#9890)
leilei-jiang Oct 26, 2024
efd441b
Update README.md (#9891)
leilei-jiang Oct 26, 2024
8d9fd88
fix(api): add signature generation for image previews (#9893)
laipz8200 Oct 26, 2024
64b6de9
feat(workflow): Support JSON type in document extractor node (#9899)
Theysua Oct 26, 2024
cea1a57
chore: Extract common functions of the base model in Azure OpenAI Pro…
yaoice Oct 27, 2024
1c7bfc7
fix(tools): remove the undefined variable parameter_type (#9908)
hwzhuhao Oct 27, 2024
f9e8b68
feat: add stable-diffusion-3-5-large for the text-to-image tool with …
hwzhuhao Oct 27, 2024
14c924d
fix: enterprise create workspace (#9921)
ZhouhaoJiang Oct 28, 2024
76aa13b
add document lock for multi-thread (#9873)
JohnJyong Oct 28, 2024
b46bf70
Remove invalid languages error (#9928)
seikyo-cho-lvgs Oct 28, 2024
bf3ea67
fix: tool var type error (#9937)
iamjoel Oct 28, 2024
1027367
Modify and add jp translation (#9930)
HanqingZ Oct 28, 2024
4d957b6
feat: add models for gitee.ai (#9490)
fchange Oct 28, 2024
72e2c1b
feat: support Vectorizer can be used in workflow (#9932)
hjlarry Oct 28, 2024
b44783f
feat(tools): add Baidu translation tool (#9943)
XiaoLey Oct 28, 2024
9695011
feat(http-request-executor): enhance file handling in HTTP requests (…
laipz8200 Oct 28, 2024
23d8e49
fix: separator change add too many backslash (#9949)
iamjoel Oct 28, 2024
ddc5b02
Docs: fix docs url (#9954)
AllenWriter Oct 28, 2024
38f1762
Fix/external api update (#9955)
JohnJyong Oct 28, 2024
8f747c2
chore: update version to 0.10.2 in packaging and docker configuration…
laipz8200 Oct 28, 2024
4d7b1a0
fix: button rendering when using streaming (#9957)
crazywoola Oct 28, 2024
6fb76bd
add top_k for es full text search (#9963)
JohnJyong Oct 28, 2024
9e77ec2
fix: Fix page logout issue due to refresh-token (#9970)
WTW0313 Oct 29, 2024
d13a351
chore: Enable tencent cos test to run (#9971)
yaoice Oct 29, 2024
9c15337
fix: allow external knowledge api use simple host (#9966)
hjlarry Oct 29, 2024
56b4bf4
Feat/support form in conversation (#9980)
crazywoola Oct 29, 2024
1fa48ee
feat: couchbase integration (#6165)
roadgoat19 Oct 29, 2024
a80c322
fix: gemini model use some tools raise error (#9993)
hjlarry Oct 29, 2024
8014119
add tidb spend limit config (#9999)
JohnJyong Oct 29, 2024
f867631
Added OceanBase as an option for the vector store in Dify (#10010)
powerfooI Oct 29, 2024
9dabacf
chore: add tidb-on-qdrant configuration in env and docker-compose fil…
hwzhuhao Oct 29, 2024
d061be5
Fix content-type header case sensitivity (#9961)
fujita-h Oct 29, 2024
03e3cbf
fix(llm-node): handle NoneSegment variables properly (#9978)
laipz8200 Oct 30, 2024
052379c
fix: conversation variable may not change in the answer node (#10034)
hjlarry Oct 30, 2024
b16a178
Added: README_PT.md in Brazilian Portuguese (#10026)
lc-rezende Oct 30, 2024
dd014aa
Fix #10023 : error in docker-compose.yaml about TIDB_ON_QDRANT_CLIENT…
mabuchs Oct 30, 2024
c8a8c1d
chore: Add aliyun oss tests (#10031)
yaoice Oct 30, 2024
2b86d66
add rerank check when doing mutil-retrieval (#9998)
JohnJyong Oct 30, 2024
1412fa6
fix update_by_api batch field issue (#10001)
JohnJyong Oct 30, 2024
8db5ee4
chore: improve validation and handler of logging timezone with Timezo…
bowenliang123 Oct 30, 2024
6a2c6c8
add PROMPT_GENERATION_MAX_TOKENS and CODE_GENERATION_MAX_TOKENS in do…
XiaoLey Oct 30, 2024
618dd20
feat: add YAML type in document extractor node (#9997)
hwzhuhao Oct 30, 2024
24e7c95
feat: /conversations api response add 'update_at' field,and update …
rchlz Oct 30, 2024
1318018
chore: use dify_config.TIDB_SPEND_LIMIT instead of constant value (#1…
hwzhuhao Oct 30, 2024
97ab6d9
fix: resolve the incorrect model name of hunyuan-standard-256k (#10052)
hwzhuhao Oct 30, 2024
6066751
chore: mount config file of sandbox (#8576)
hjlarry Oct 30, 2024
eb46d3c
fix(workflow): refine variable type checks in LLMNode (#10051)
laipz8200 Oct 30, 2024
c403caf
fix: fix poetry install command in devcontainer (#9507)
22mSqRi Oct 30, 2024
5130824
fix: prevent onChange during IME composition (#10059)
Fog3211 Oct 30, 2024
41d99ef
chore: Set file size limits for video and audio uploads from docker e…
fujita-h Oct 30, 2024
4076300
Fixed the issue where recall the knowledge base in the iteration of t…
wangiii Oct 30, 2024
a9e6e24
fix the typos in the hit testing template (#10072)
sacryu Oct 30, 2024
68d4dc3
Revert "chore: improve validation and handler of logging timezone wit…
crazywoola Oct 30, 2024
7e7dc6f
fix azure chatgpt o1 parameter error (#10067)
charli117 Oct 30, 2024
c01135b
improve: significantly speed up the server launching time by async pr…
bowenliang123 Oct 30, 2024
8f2f901
chore: update type definition to resolve lint error in Base usage at …
Kota-Yamaguchi Oct 31, 2024
566dde9
build: update docker login action (#10050)
AkaraChen Oct 31, 2024
408f2fc
feat: enhance comfyui workflow (#10085)
hjlarry Oct 31, 2024
d21892f
chore: remove an unnecessary link (#10088)
hjlarry Oct 31, 2024
bb894d6
fix: view logs in prompt, no response when clicked (#10093)
beginnerZhang Oct 31, 2024
5704685
refactor(version): simplify version comparison logic (#10109)
laipz8200 Oct 31, 2024
145965f
chore: save uploaded file extension as lower case (#10111)
hjlarry Oct 31, 2024
1e05036
feat(app_dsl_service): enhance error handling and DSL version managem…
laipz8200 Oct 31, 2024
cb17ecf
fix: Version '1:1.3.dfsg+really1.3.1-1' for 'zlib1g' was not found (#…
ZuzooVn Oct 31, 2024
5a0968f
fix issue: update document segment setting failed (#10107)
JohnJyong Oct 31, 2024
ae03155
fix: log detail panel not showing any message when total count greate…
xuzuodong Oct 31, 2024
e60f0cb
fix(Dockerfile): conditionally install zlib1g based on architecture (…
laipz8200 Oct 31, 2024
007a800
fix: optimize unique document filtering with set (#10082)
y-omr Oct 31, 2024
fd62e5e
Feat/update knowledge api url (#10102)
JohnJyong Oct 31, 2024
13947b3
Fix/rerank validation issue (#10131)
zxhlyh Oct 31, 2024
c49dcb5
fix issue: query is none when doing retrieval (#10129)
JohnJyong Oct 31, 2024
9a93744
fix: bar chart issue with duplicate x-axis labels being incorrectly i…
llinvokerl Oct 31, 2024
12cf1a6
fix: avoid unexpected error when create knowledge base with baidu vec…
WayneCao Oct 31, 2024
c015c5f
add llm: ernie-4.0-turbo-128k of wenxin (#10135)
yaohongfenglove Oct 31, 2024
e7bc617
Refined README for better reading experience. (#10143)
Theysua Nov 1, 2024
b14f1cd
feat: synchronize input/output variables in the panel with generated …
Kota-Yamaguchi Nov 1, 2024
063e7b8
Add VESSL AI OpenAI API-compatible model provider and LLM model (#9474)
larcane97 Nov 1, 2024
ce37621
refactor(service): handle unsupported DSL version with warning (#10151)
laipz8200 Nov 1, 2024
af72873
clean un-allowed special charters when doing indexing estimate (#10153)
JohnJyong Nov 1, 2024
7f210c6
fix: upload remote image preview (#9952)
zxhlyh Nov 1, 2024
5124b80
Feat/add-remote-file-upload-api (#9906)
laipz8200 Nov 1, 2024
ba6b694
refactor(migration/model): update column types for workflow schema (#…
laipz8200 Nov 1, 2024
b67ada5
refactor(tools): Avoid warnings. (#10161)
laipz8200 Nov 1, 2024
2330768
feat: add gpustack model provider (#10158)
gitlawr Nov 1, 2024
2c3d35e
fix: Cannot find declaration to go to CLEAN_DAY_SETTING (#10157)
jiangbo721 Nov 1, 2024
2f1cba0
fix(workflow model): ensure consistent timestamp updating (#10172)
laipz8200 Nov 1, 2024
351b291
[fix] fix the bug that modify document name not effective (#10154)
ProseGuys Nov 1, 2024
4f4c9b9
fix(tools): suppress RuntimeWarnings in podcast audio generator (#10182)
laipz8200 Nov 1, 2024
847f250
feat(document_extractor): integrate unstructured API for PPTX extract…
laipz8200 Nov 1, 2024
eba167b
fix(api): replace current_user with end_user in file upload (#10194)
laipz8200 Nov 2, 2024
cc6ffeb
fix: webapp upload file (#10195)
zxhlyh Nov 2, 2024
aeda709
chore : code generator preview hint (#10188)
Kota-Yamaguchi Nov 2, 2024
1975bae
chore: enable vision support for models in OpenRouter that should hav…
XiaoLey Nov 2, 2024
65a168a
Feat : add LLM model indicator in prompt generator (#10187)
Kota-Yamaguchi Nov 2, 2024
f445b3c
fix(document_extractor): update base exception class (#10208)
laipz8200 Nov 3, 2024
5b66c86
chore(list_operator): refine exception handling for error specificity…
laipz8200 Nov 3, 2024
a4d51e4
refactor(validation): improve input validation logic (#10175)
laipz8200 Nov 3, 2024
605d0c3
Fix/10199 application error a client side exception has occurred see …
crazywoola Nov 3, 2024
a720dd4
Add Lindorm as a VDB choice (#10202)
AlwaysBluer Nov 4, 2024
a56e493
Modify translation (#10213)
HanqingZ Nov 4, 2024
7939b7d
fix the ssrf of docx file extractor external images (#10237)
JohnJyong Nov 4, 2024
6a5bd28
chore(llm_node): remove unnecessary type ignore for context assignmen…
laipz8200 Nov 4, 2024
a3705f1
refactor(workflow): introduce specific exceptions for code validation…
laipz8200 Nov 4, 2024
a57090a
refactor(http_request): add custom exception handling for HTTP reques…
laipz8200 Nov 4, 2024
4a7e51a
refactor(workflow): introduce specific error handling for LLM nodes (…
laipz8200 Nov 4, 2024
8283f89
refactor(list_operator): replace ValueError with InvalidKeyError (#10…
laipz8200 Nov 4, 2024
c270624
fix: missing working directory parameter in script (#10226)
shisaru292 Nov 4, 2024
12fb7e1
feat(workflow): add configurable workflow file upload limit (#10176)
laipz8200 Nov 4, 2024
b6b4919
Using a dedicated interface to obtain the token credential for the gi…
fchange Nov 4, 2024
508789a
chore(Dockerfile): upgrade zlib arm64 (#10244)
laipz8200 Nov 4, 2024
746d537
fix(validation): allow to use 0 in the inputs form (#10255)
laipz8200 Nov 4, 2024
5c9d571
fix: buitin tool aippt (#10234)
guogeer Nov 4, 2024
620988e
refactor(parameter_extractor): implement custom error classes (#10260)
laipz8200 Nov 5, 2024
450d1ae
feat: support Claude 3.5 Haiku on Amazon Bedrock (#10265)
mazyu36 Nov 5, 2024
b3816f1
feat(document_extractor): support tool file in document extractor (#1…
laipz8200 Nov 5, 2024
5c7eafa
fix(workflow): handle else condition branch addition error in if-els…
GeorgeCaoJ Nov 5, 2024
aa1c27c
feat: Iteration node support parallel mode (#9493)
Nov1c444 Nov 5, 2024
a77ac7e
Updates: Add mplfonts library for customizing matplotlib fonts and Va…
BenjaminX Nov 5, 2024
e7834fd
chore: translate i18n files (#10273)
github-actions[bot] Nov 5, 2024
a19d82e
refactor the logic of refreshing access_token (#10068)
douxc Nov 5, 2024
b402497
fix(node): correct file property name in function switch (#10284)
laipz8200 Nov 5, 2024
c863ee1
feat(model): add validation for custom disclaimer length (#10287)
laipz8200 Nov 5, 2024
767ac3b
fix(model_runtime): fix wrong max_tokens for Claude 3.5 Haiku on Amaz…
mazyu36 Nov 5, 2024
cc66955
feat(model_runtime): add new model 'claude-3-5-haiku-20241022' (#10285)
mazyu36 Nov 5, 2024
c766fc3
feat: add xAI model provider (#10272)
hjlarry Nov 5, 2024
9daaf1f
fix: borken faq url in CONTRIBUTING.md (#10275)
euxx Nov 5, 2024
9b37772
fix: handle KeyError when accessing rules in CleanProcessor.clean (#1…
pinsily Nov 5, 2024
d960cbe
fix typo: writeOpner to writeOpener (#10290)
mazyu36 Nov 5, 2024
4c25691
fix(http_request): improve parameter initialization and reorganize te…
laipz8200 Nov 5, 2024
8469bcd
fix: iteration none output error (#10295)
Nov1c444 Nov 5, 2024
77558d0
chore: update version to 0.11.0 across all relevant files (#10278)
laipz8200 Nov 5, 2024
aed03be
fix: special prompt not work for comfyUI tool (#10307)
hjlarry Nov 5, 2024
aa72063
docs: remove the TOC part (#10324)
laipz8200 Nov 5, 2024
e7d433e
feat(vannaai): add base_url configuration (#10294)
BenjaminX Nov 5, 2024
4dff9f1
feat: add support for anthropic/claude-3-5-haiku through OpenRouter (…
infinitnet Nov 6, 2024
a3b289e
feat: The SSRF request timeout configuration item is added (#10292)
gubinjie Nov 6, 2024
a97ecee
Gitee AI tools (#10314)
fchange Nov 6, 2024
92b5ca1
Update README.md (#10332)
guchenhe Nov 6, 2024
9333c6f
feat: support png, gif, webp (#7947)
ZuzooVn Nov 6, 2024
98cbe69
fix(api): remove fixed source attribute from FileApi (#10353)
laipz8200 Nov 6, 2024
76ebe90
chore(ci): separate vector store tests into new workflow (#10354)
laipz8200 Nov 6, 2024
b774e01
chore: update translation for 'account' from '계좌' to '계정' (#10350)
comfuture Nov 6, 2024
6d9ebfa
chore: lazy import sagemaker (#10342)
bowenliang123 Nov 6, 2024
768ee39
chore(ci): bring back poetry cache to speed up CI jobs (#10347)
bowenliang123 Nov 6, 2024
e75ef30
fix: remove unsupported vision in OpenRouter Haiku 3.5 (#10364)
infinitnet Nov 6, 2024
abfab84
fix(model_runtime): remove vision from features for Claude 3.5 Haiku …
mazyu36 Nov 6, 2024
ec7dfb4
fix: remove duplicated category “recommended” (#10375)
hjlarry Nov 6, 2024
4217d02
fix typo: mMaximum -> Maximum (#10389)
y-omr Nov 7, 2024
2ce1a51
Adjusted docker manifests and environment variables for OceanBase vec…
powerfooI Nov 7, 2024
d8e22a3
fixed: web api remote urls error (#10383)
luckylhb90 Nov 7, 2024
0ccdb5f
refactor(question_classifier): improve error handling with custom exc…
laipz8200 Nov 7, 2024
9a6da66
refactor(tool-node): introduce specific exceptions for tool node erro…
laipz8200 Nov 7, 2024
730a59f
refactor(knowledge-retrieval): improve error handling with custom exc…
laipz8200 Nov 7, 2024
99ad9de
refactor(iteration): introduce specific exceptions for iteration erro…
laipz8200 Nov 7, 2024
6cca785
fix(remote-files): fallback to get when remote server not support hea…
laipz8200 Nov 7, 2024
7602701
fix(conversation-service): return success response after conversation…
BenjaminX Nov 7, 2024
7ee3724
chore: improve custom tool's display (#10410)
hjlarry Nov 7, 2024
0f10dee
feat(Tools): add lark tools (#10117)
hgnulb Nov 7, 2024
c83c47f
fix typo: Retrieve Chunks API Docs (#10412)
huangyafei Nov 7, 2024
9e07dc2
chore: use posixpath to wrapper filepath (#9976)
yaoice Nov 7, 2024
db24f21
chore(lint): Use logging.exception instead of logging.error (#10415)
bowenliang123 Nov 7, 2024
101296b
Conversation delete issue (#10423)
BenjaminX Nov 7, 2024
66d6bbe
fix: simplify Enter key handling and remove unused ref (#10413)
SuzukiKatsuma Nov 7, 2024
2e67a3c
fix: config violations when running db migtration ci tests (#10428)
bowenliang123 Nov 8, 2024
b7953b7
fix(http_request): send form data (#10431)
laipz8200 Nov 8, 2024
99cdcc0
chore: use DEBUG in dify_config instead of parsing raw system environ…
bowenliang123 Nov 8, 2024
7065304
fix: (#10437 followup) fix conditions with DEBUG config (#10438)
bowenliang123 Nov 8, 2024
77af706
Feat/tools/gitlab (#10407)
wlrnet Nov 8, 2024
b78f3c6
feat: support LLM understand video (#9828)
hjlarry Nov 8, 2024
5403817
fix(ops_tracing): enhance error handle in celery tasks. (#10401)
ZhouhaoJiang Nov 8, 2024
a1d409f
fix: correct output order in parallel mode for iteration nodes (#10323)
Nov1c444 Nov 8, 2024
354aacd
chore: add MULTIMODAL_SEND_VIDEO_FORMAT to docker's env (#10458)
hjlarry Nov 8, 2024
52edc9c
feat: add cogVideo tool (#10456)
hjlarry Nov 8, 2024
99a32df
Fix conversation response issue (#10450)
BenjaminX Nov 8, 2024
a7c48b0
fix segment enable service api (#10445)
JohnJyong Nov 8, 2024
bc4573a
celery worker log format following LOG_FORMAT env#9404 (#10016)
liuhaoran1212 Nov 8, 2024
8f0fb9a
embedding model check when init the knowledge (#10463)
JohnJyong Nov 8, 2024
33518e8
feat: Add support for complete domain names in the new URL prefix. (#…
QuietlyChan Nov 8, 2024
72624e6
chore: make comfy workflow can generate image with a random seed (#10…
hjlarry Nov 8, 2024
2b5e551
chore(ci): avoid reinstall pipx and pin poetry version aligned with i…
bowenliang123 Nov 8, 2024
ad50d50
update document and segment word count (#10449)
JohnJyong Nov 8, 2024
6a1e068
fix(migrations): correct schema reference in service API history migr…
laipz8200 Nov 8, 2024
df75448
refactor(core): Remove extra_config from File. (#10203)
laipz8200 Nov 8, 2024
445a36c
add create tidb serverless job control (#10467)
JohnJyong Nov 8, 2024
28c721f
feat(workflow-nodes): handle missing variables without failure (#10471)
laipz8200 Nov 8, 2024
bdc474c
fix(api): replace Raw field with FilesContainedField in MessageListAp…
laipz8200 Nov 8, 2024
60c45d0
Fix/log tz (#10473)
crazywoola Nov 8, 2024
850880f
fix(file_upload): correct validation method and add unit tests (#10477)
laipz8200 Nov 8, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
The diff you're trying to view is too large. We only load the first 3000 changed files.
2 changes: 1 addition & 1 deletion .devcontainer/post_start_command.sh
Original file line number Diff line number Diff line change
@@ -1,3 +1,3 @@
#!/bin/bash

poetry install -C api
cd api && poetry install
36 changes: 36 additions & 0 deletions .github/actions/setup-poetry/action.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,36 @@
name: Setup Poetry and Python

inputs:
python-version:
description: Python version to use and the Poetry installed with
required: true
default: '3.10'
poetry-version:
description: Poetry version to set up
required: true
default: '1.8.4'
poetry-lockfile:
description: Path to the Poetry lockfile to restore cache from
required: true
default: ''

runs:
using: composite
steps:
- name: Set up Python ${{ inputs.python-version }}
uses: actions/setup-python@v5
with:
python-version: ${{ inputs.python-version }}
cache: pip

- name: Install Poetry
shell: bash
run: pip install poetry==${{ inputs.poetry-version }}

- name: Restore Poetry cache
if: ${{ inputs.poetry-lockfile != '' }}
uses: actions/setup-python@v5
with:
python-version: ${{ inputs.python-version }}
cache: poetry
cache-dependency-path: ${{ inputs.poetry-lockfile }}
38 changes: 9 additions & 29 deletions .github/workflows/api-tests.yml
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,7 @@ on:
paths:
- api/**
- docker/**
- .github/workflows/api-tests.yml

concurrency:
group: api-tests-${{ github.head_ref || github.run_id }}
Expand All @@ -27,26 +28,23 @@ jobs:
- name: Checkout code
uses: actions/checkout@v4

- name: Install Poetry
uses: abatilo/actions-poetry@v3

- name: Set up Python ${{ matrix.python-version }}
uses: actions/setup-python@v5
- name: Setup Poetry and Python ${{ matrix.python-version }}
uses: ./.github/actions/setup-poetry
with:
python-version: ${{ matrix.python-version }}
cache: 'poetry'
cache-dependency-path: |
api/pyproject.toml
api/poetry.lock
poetry-lockfile: api/poetry.lock

- name: Poetry check
- name: Check Poetry lockfile
run: |
poetry check -C api --lock
poetry show -C api

- name: Install dependencies
run: poetry install -C api --with dev

- name: Check dependencies in pyproject.toml
run: poetry run -C api bash dev/pytest/pytest_artifacts.sh

- name: Run Unit tests
run: poetry run -C api bash dev/pytest/pytest_unit_tests.sh

Expand All @@ -65,7 +63,7 @@ jobs:
run: sh .github/workflows/expose_service_ports.sh

- name: Set up Sandbox
uses: hoverkraft-tech/compose-action@v2.0.0
uses: hoverkraft-tech/compose-action@v2.0.2
with:
compose-file: |
docker/docker-compose.middleware.yaml
Expand All @@ -75,21 +73,3 @@ jobs:

- name: Run Workflow
run: poetry run -C api bash dev/pytest/pytest_workflow.sh

- name: Set up Vector Stores (Weaviate, Qdrant, PGVector, Milvus, PgVecto-RS, Chroma, MyScale, ElasticSearch)
uses: hoverkraft-tech/compose-action@v2.0.0
with:
compose-file: |
docker/docker-compose.yaml
services: |
weaviate
qdrant
etcd
minio
milvus-standalone
pgvecto-rs
pgvector
chroma
elasticsearch
- name: Test Vector Stores
run: poetry run -C api bash dev/pytest/pytest_vdb.sh
6 changes: 3 additions & 3 deletions .github/workflows/build-push.yml
Original file line number Diff line number Diff line change
Expand Up @@ -49,7 +49,7 @@ jobs:
echo "PLATFORM_PAIR=${platform//\//-}" >> $GITHUB_ENV

- name: Login to Docker Hub
uses: docker/login-action@v2
uses: docker/login-action@v3
with:
username: ${{ env.DOCKERHUB_USER }}
password: ${{ env.DOCKERHUB_TOKEN }}
Expand Down Expand Up @@ -114,7 +114,7 @@ jobs:
merge-multiple: true

- name: Login to Docker Hub
uses: docker/login-action@v2
uses: docker/login-action@v3
with:
username: ${{ env.DOCKERHUB_USER }}
password: ${{ env.DOCKERHUB_TOKEN }}
Expand All @@ -125,7 +125,7 @@ jobs:
with:
images: ${{ env[matrix.image_name_env] }}
tags: |
type=raw,value=latest,enable=${{ startsWith(github.ref, 'refs/tags/') }}
type=raw,value=latest,enable=${{ startsWith(github.ref, 'refs/tags/') && !contains(github.ref, '-') }}
type=ref,event=branch
type=sha,enable=true,priority=100,prefix=,suffix=,format=long
type=raw,value=${{ github.ref_name }},enable=${{ startsWith(github.ref, 'refs/tags/') }}
Expand Down
20 changes: 5 additions & 15 deletions .github/workflows/db-migration-test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,7 @@ on:
- main
paths:
- api/migrations/**
- .github/workflows/db-migration-test.yml

concurrency:
group: db-migration-test-${{ github.ref }}
Expand All @@ -14,26 +15,15 @@ concurrency:
jobs:
db-migration-test:
runs-on: ubuntu-latest
strategy:
matrix:
python-version:
- "3.10"

steps:
- name: Checkout code
uses: actions/checkout@v4

- name: Install Poetry
uses: abatilo/actions-poetry@v3

- name: Set up Python ${{ matrix.python-version }}
uses: actions/setup-python@v5
- name: Setup Poetry and Python
uses: ./.github/actions/setup-poetry
with:
python-version: ${{ matrix.python-version }}
cache: 'poetry'
cache-dependency-path: |
api/pyproject.toml
api/poetry.lock
poetry-lockfile: api/poetry.lock

- name: Install dependencies
run: poetry install -C api
Expand All @@ -44,7 +34,7 @@ jobs:
cp middleware.env.example middleware.env

- name: Set up Middlewares
uses: hoverkraft-tech/compose-action@v2.0.0
uses: hoverkraft-tech/compose-action@v2.0.2
with:
compose-file: |
docker/docker-compose.middleware.yaml
Expand Down
4 changes: 3 additions & 1 deletion .github/workflows/expose_service_ports.sh
Original file line number Diff line number Diff line change
Expand Up @@ -7,5 +7,7 @@ yq eval '.services["milvus-standalone"].ports += ["19530:19530"]' -i docker/dock
yq eval '.services.pgvector.ports += ["5433:5432"]' -i docker/docker-compose.yaml
yq eval '.services["pgvecto-rs"].ports += ["5431:5432"]' -i docker/docker-compose.yaml
yq eval '.services["elasticsearch"].ports += ["9200:9200"]' -i docker/docker-compose.yaml
yq eval '.services.couchbase-server.ports += ["8091-8096:8091-8096"]' -i docker/docker-compose.yaml
yq eval '.services.couchbase-server.ports += ["11210:11210"]' -i docker/docker-compose.yaml

echo "Ports exposed for sandbox, weaviate, qdrant, chroma, milvus, pgvector, pgvecto-rs, elasticsearch"
echo "Ports exposed for sandbox, weaviate, qdrant, chroma, milvus, pgvector, pgvecto-rs, elasticsearch, couchbase"
31 changes: 13 additions & 18 deletions .github/workflows/style.yml
Original file line number Diff line number Diff line change
Expand Up @@ -20,35 +20,30 @@ jobs:

- name: Check changed files
id: changed-files
uses: tj-actions/changed-files@v44
uses: tj-actions/changed-files@v45
with:
files: api/**

- name: Install Poetry
uses: abatilo/actions-poetry@v3
files: |
api/**
.github/workflows/style.yml

- name: Set up Python
uses: actions/setup-python@v5
- name: Setup Poetry and Python
if: steps.changed-files.outputs.any_changed == 'true'
with:
python-version: '3.10'
uses: ./.github/actions/setup-poetry

- name: Python dependencies
- name: Install dependencies
if: steps.changed-files.outputs.any_changed == 'true'
run: poetry install -C api --only lint

- name: Ruff check
if: steps.changed-files.outputs.any_changed == 'true'
run: poetry run -C api ruff check ./api
run: |
poetry run -C api ruff check ./api
poetry run -C api ruff format --check ./api

- name: Dotenv check
if: steps.changed-files.outputs.any_changed == 'true'
run: poetry run -C api dotenv-linter ./api/.env.example ./web/.env.example

- name: Ruff formatter check
if: steps.changed-files.outputs.any_changed == 'true'
run: poetry run -C api ruff format --check ./api

- name: Lint hints
if: failure()
run: echo "Please run 'dev/reformat' to fix the fixable linting errors."
Expand All @@ -66,7 +61,7 @@ jobs:

- name: Check changed files
id: changed-files
uses: tj-actions/changed-files@v44
uses: tj-actions/changed-files@v45
with:
files: web/**

Expand Down Expand Up @@ -97,7 +92,7 @@ jobs:

- name: Check changed files
id: changed-files
uses: tj-actions/changed-files@v44
uses: tj-actions/changed-files@v45
with:
files: |
**.sh
Expand All @@ -107,7 +102,7 @@ jobs:
dev/**

- name: Super-linter
uses: super-linter/super-linter/slim@v6
uses: super-linter/super-linter/slim@v7
if: steps.changed-files.outputs.any_changed == 'true'
env:
BASH_SEVERITY: warning
Expand Down
54 changes: 54 additions & 0 deletions .github/workflows/translate-i18n-base-on-english.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,54 @@
name: Check i18n Files and Create PR

on:
pull_request:
types: [closed]
branches: [main]

jobs:
check-and-update:
if: github.event.pull_request.merged == true
runs-on: ubuntu-latest
defaults:
run:
working-directory: web
steps:
- uses: actions/checkout@v4
with:
fetch-depth: 2 # last 2 commits

- name: Check for file changes in i18n/en-US
id: check_files
run: |
recent_commit_sha=$(git rev-parse HEAD)
second_recent_commit_sha=$(git rev-parse HEAD~1)
changed_files=$(git diff --name-only $recent_commit_sha $second_recent_commit_sha -- 'i18n/en-US/*.ts')
echo "Changed files: $changed_files"
if [ -n "$changed_files" ]; then
echo "FILES_CHANGED=true" >> $GITHUB_ENV
else
echo "FILES_CHANGED=false" >> $GITHUB_ENV
fi

- name: Set up Node.js
if: env.FILES_CHANGED == 'true'
uses: actions/setup-node@v2
with:
node-version: 'lts/*'

- name: Install dependencies
if: env.FILES_CHANGED == 'true'
run: yarn install --frozen-lockfile

- name: Run npm script
if: env.FILES_CHANGED == 'true'
run: npm run auto-gen-i18n

- name: Create Pull Request
if: env.FILES_CHANGED == 'true'
uses: peter-evans/create-pull-request@v6
with:
commit-message: Update i18n files based on en-US changes
title: 'chore: translate i18n files'
body: This PR was automatically created to update i18n files based on changes in en-US locale.
branch: chore/automated-i18n-updates
Loading
Loading