ROADMAP 2024 #162

writinwaters · 2024-03-28T06:52:32Z

ptdaxiake · 2024-04-07T03:39:29Z

                                                 INFO:werkzeug:WARNING: This is a development server. Do not use it in a production deployment. Use a production WSGI server instead.

Running on all addresses (0.0.0.0) [00:00<?, ?B/s]
Running on http://127.0.0.1:9380
Running on http://172.18.0.6:9380
INFO:werkzeug:Press CTRL+C to quit
tsr.onnx: 100%|██████████| 12.2M/12.2M [00:01<00:00, 11.3MB/s]
layout.manual.onnx: 100%|██████████| 12.2M/12.2M [00:01<00:00, 8.83MB/s]
layout.paper.onnx: 100%|██████████| 12.2M/12.2M [00:01<00:00, 11.6MB/s]]
layout.onnx: 100%|██████████| 12.2M/12.2M [00:01<00:00, 7.65MB/s]3MB/s]
Fetching 9 files: 100%|██████████| 9/9 [00:06<00:00, 1.42it/s]s]
Fetching 9 files: 100%|██████████| 9/9 [00:06<00:00, 1.39it/s]
INFO:werkzeug:172.18.0.1 - - [07/Apr/2024 11:35:22] "GET / HTTP/1.1" 200 -
INFO:werkzeug:172.18.0.1 - - [07/Apr/2024 11:35:22] "GET /favicon.ico HTTP/1.1" 200 -
WARNING:root:Realtime synonym is disabled, since no redis connection.

Umpire2018 · 2024-04-10T02:25:42Z

v0.1.0

URL support: Capable of web crawling and the corresponding content extration. @KevinHuSh

@KevinHuSh Hi, I wonder what's the current status? Maybe i can collaborate on it. My tech Stack is python backend and i think web crawling is essential for workflow of software development.

KevinHuSh · 2024-04-11T05:39:26Z

v0.1.0

URL support: Capable of web crawling and the corresponding content extration. @KevinHuSh

@KevinHuSh Hi, I wonder what's the current status? Maybe i can collaborate on it. My tech Stack is python backend and i think web crawling is essential for workflow of software development.

Crawling web page is big thing in my understanding. We do not have a clear picture for this. Here are two important points to note:
Crawling Task Dispaching
The way to execute JS on the page
Page classification which is related the structure of the data we store
The extraction of the main parts of the page

If you have any good solution to these points, please let me know....

Umpire2018 · 2024-04-11T06:48:33Z

Crawling web page is big thing in my understanding. We do not have a clear picture for this. Here are two important points to note: Crawling Task Dispaching The way to execute JS on the page Page classification which is related the structure of the data we store The extraction of the main parts of the page

If you have any good solution to these points, please let me know....

@KevinHuSh Please refer to #315

Maybe i can start with AWS Bedrock models to contribute to the project, then Support x-inference as model provider. Feel free to contact me via here or wx.

tvvignesh · 2024-04-13T12:35:40Z

@writinwaters @KevinHuSh Hi. Requesting to look at the issue I created: #345

Maybe fixing these issues would help us adopt ragflow better.

dashi6174 · 2024-05-10T02:34:05Z

Not supporting streaming really affects the user experience. I hope it can be supported soon, as the implementation is not complicated.

Miki-lin · 2024-05-10T12:50:15Z

v0.6.0

Print version or commit-id when RAGFlow is started. Or showing these information on UI. [Feature Request]: Print version or commit-id when RAGFlow is started. #643

APIs for knowledge base and file manager. [Feature Request]: File manager & API #345

Files in knowledge base should also be found in file manager. let file in knowledgebases visible in file manager #714

System components monitoring.

Supports simple document layout to speed up file parsing.

Supports user configured reranker.

Streaming conversation output. [Feature Request]: Support for conversational streaming #709

Whether it can provide users with accurate answers and quick answers, one is subject to accuracy and the other is subject to quick response

JinHai-CN · 2024-05-10T13:04:40Z

v0.6.0

Print version or commit-id when RAGFlow is started. Or showing these information on UI. [Feature Request]: Print version or commit-id when RAGFlow is started. #643

APIs for knowledge base and file manager. [Feature Request]: File manager & API #345

Files in knowledge base should also be found in file manager. let file in knowledgebases visible in file manager #714

System components monitoring.

Supports simple document layout to speed up file parsing.

Supports user configured reranker.

Streaming conversation output. [Feature Request]: Support for conversational streaming #709

Whether it can provide users with accurate answers and quick answers, one is subject to accuracy and the other is subject to quick response

You can file a new issue, so we can discuss in that issue.

xs818818 · 2024-05-11T03:20:58Z

Are there any plans to use big language models for knowledge graphs?

JinHai-CN · 2024-05-11T04:10:41Z

Are there any plans to use big language models for knowledge graphs?

We've been thinking about this for a while, but haven't figured out how to implement it in RAGFlow. If you have any good issues, feel free to create a new issue and we'll discuss it!

### What problem does this PR solve? Let file in knowledgebases visible in file manager. #162 ### Type of change - [x] New Feature (non-breaking change which adds functionality)

AAlexDing · 2024-05-11T11:35:30Z

Can it automatically continue when it says 'Due to length...' ? The current handling of length issues feels very rudimentary.

commit 8769619 Author: Jin Hai <haijin.chn@gmail.com> Date: Sun May 12 13:40:47 2024 +0800 Update readme (infiniflow#741) ### What problem does this PR solve? Update readme. ### Type of change - [x] Documentation Update Signed-off-by: Jin Hai <haijin.chn@gmail.com> commit ffe5737 Author: KevinHuSh <kevinhu.sh@gmail.com> Date: Sat May 11 19:47:53 2024 +0800 let index be batchly. (infiniflow#733) ### What problem does this PR solve? let index be batchly. ### Type of change - [x] Refactoring commit 04a9e95 Author: KevinHuSh <kevinhu.sh@gmail.com> Date: Sat May 11 16:04:28 2024 +0800 let file in knowledgebases visible in file manager (infiniflow#714) ### What problem does this PR solve? Let file in knowledgebases visible in file manager. infiniflow#162 ### Type of change - [x] New Feature (non-breaking change which adds functionality) commit 91b4a18 Author: balibabu <cike8899@users.noreply.github.com> Date: Sat May 11 16:03:07 2024 +0800 Make the app name configurable even after the project is built (infiniflow#731) ### What problem does this PR solve? Make the app name configurable even after the project is built infiniflow#730 ### Type of change - [x] New Feature (non-breaking change which adds functionality) commit 33eaf6f Author: Ikko Eltociear Ashimine <eltociear@gmail.com> Date: Fri May 10 12:22:40 2024 +0900 docs: update README_ja.md (infiniflow#707) ### What problem does this PR solve? _Briefly describe what this PR aims to solve. Include background context that will help reviewers understand the purpose of the PR._ ### Type of change - [x] Documentation Update commit d65ba3e Author: balibabu <cike8899@users.noreply.github.com> Date: Fri May 10 10:38:39 2024 +0800 feat: delete the added model infiniflow#503 and display an error message when the requested file fails to parse infiniflow#684 (infiniflow#708) ### What problem does this PR solve? feat: delete the added model infiniflow#503 feat: display an error message when the requested file fails to parse infiniflow#684 ### Type of change - [x] New Feature (non-breaking change which adds functionality) commit bef1bbd Author: CKLogic <chuanzyz@sina.com> Date: Fri May 10 09:48:50 2024 +0800 Update README with Detailed WebUI Service Launch Instructions (infiniflow#694) ### What problem does this PR solve? Improve README by detailing Launch Service from Source section This commit enhances the README document by adding comprehensive steps for running the WebUI service in the 'Launch Service from Source' section. It aims to provide clearer guidance for users attempting to start the service from the source code, making the setup process more accessible and understandable. Key changes include: - Detailed instructions for setting up and running the WebUI service. - Necessary prerequisites for launching the service from source. This update ensures that users have all the information they need to successfully launch the service, improving the overall usability of our project. ### Type of change - [x] Documentation Update commit 6b36f31 Author: writinwaters <93570324+writinwaters@users.noreply.github.com> Date: Fri May 10 09:48:24 2024 +0800 Minor editorial updates (infiniflow#700) ### What problem does this PR solve? Editorial updates only. ### Type of change - [x] Documentation Update commit 648a2ba Author: KevinHuSh <kevinhu.sh@gmail.com> Date: Thu May 9 15:32:24 2024 +0800 fix disabled doc is still retreivalable (infiniflow#695) ### What problem does this PR solve? Fix that disabled doc is still retreivalable ### Type of change - [x] Bug Fix (non-breaking change which fixes an issue) commit 9392b8b Author: writinwaters <93570324+writinwaters@users.noreply.github.com> Date: Thu May 9 12:37:45 2024 +0800 0509 faq (infiniflow#693) ### What problem does this PR solve? Editorial updates only. ### Type of change - [x] Documentation Update commit 4153a36 Author: KevinHuSh <kevinhu.sh@gmail.com> Date: Thu May 9 11:35:08 2024 +0800 truncate text to fitin embedding model (infiniflow#692) ### What problem does this PR solve? ### Type of change - [x] Refactoring commit bca63ad Author: GYH <43509927+chenshuizhong@users.noreply.github.com> Date: Thu May 9 11:32:36 2024 +0800 Update faq.md (infiniflow#685) ### What problem does this PR solve? Updated FAQ: How to upgrade RAGFlow ### Type of change - [x] Documentation Update commit 793e29f Author: balibabu <cike8899@users.noreply.github.com> Date: Thu May 9 11:30:15 2024 +0800 fix: fix uploaded file time error infiniflow#680 (infiniflow#690) ### What problem does this PR solve? fix: fix uploaded file time error infiniflow#680 feat: support preview of word and excel infiniflow#684 ### Type of change - [x] Bug Fix (non-breaking change which fixes an issue) commit 99be226 Author: KevinHuSh <kevinhu.sh@gmail.com> Date: Wed May 8 20:00:14 2024 +0800 fix coordinate error (infiniflow#686) ### What problem does this PR solve? infiniflow#683 ### Type of change - [x] Bug Fix (non-breaking change which fixes an issue) commit 7ddb2f1 Author: KevinHuSh <kevinhu.sh@gmail.com> Date: Wed May 8 15:20:45 2024 +0800 make sure to raise exception if redis is not there (infiniflow#674) ### What problem does this PR solve? ### Type of change - [x] Refactoring commit c28f7b5 Author: KevinHuSh <kevinhu.sh@gmail.com> Date: Wed May 8 13:58:41 2024 +0800 make sure the error will be recorded. (infiniflow#672) ### What problem does this PR solve? ### Type of change - [x] Refactoring

### What problem does this PR solve? Let file in knowledgebases visible in file manager. infiniflow#162 ### Type of change - [x] New Feature (non-breaking change which adds functionality)

JinHai-CN · 2024-05-20T11:49:47Z

Postpone feature request of reranker configuration to 0.7.0.

commit 673a28e Author: KevinHuSh <kevinhu.sh@gmail.com> Date: Fri May 17 20:03:00 2024 +0800 fix bug of chat without stream (infiniflow#830) ### What problem does this PR solve? ### Type of change - [x] Bug Fix (non-breaking change which fixes an issue) commit 2bfacd0 Author: KevinHuSh <kevinhu.sh@gmail.com> Date: Fri May 17 18:06:20 2024 +0800 refine doc about API: completion (infiniflow#829) ### What problem does this PR solve? infiniflow#808 ### Type of change - [x] Documentation Update commit b3c923d Author: KevinHuSh <kevinhu.sh@gmail.com> Date: Fri May 17 17:51:54 2024 +0800 add doc ids in API: completion (infiniflow#827) ### What problem does this PR solve? infiniflow#808 ### Type of change - [x] New Feature (non-breaking change which adds functionality) commit a1586e0 Author: KevinHuSh <kevinhu.sh@gmail.com> Date: Fri May 17 17:27:39 2024 +0800 correct mismatched kb doc number (infiniflow#826) ### What problem does this PR solve? infiniflow#620 ### Type of change - [x] Bug Fix (non-breaking change which fixes an issue) commit f6a5994 Author: KevinHuSh <kevinhu.sh@gmail.com> Date: Fri May 17 17:07:33 2024 +0800 fix zhipuAI stream issue (infiniflow#825) ### What problem does this PR solve? ### Type of change - [x] Bug Fix (non-breaking change which fixes an issue) commit 081f922 Author: GYH <43509927+guoyuhao2330@users.noreply.github.com> Date: Fri May 17 15:58:05 2024 +0800 0517 list chunks (infiniflow#821) ### What problem does this PR solve? infiniflow#717 ### Type of change - [x] New Feature (non-breaking change which adds functionality) commit 9f0f5b4 Author: balibabu <cike8899@users.noreply.github.com> Date: Fri May 17 15:38:28 2024 +0800 Default language will be given according to the browse setting and also can be configured infiniflow#801 (infiniflow#823) ### What problem does this PR solve? Default language will be given according to the browse setting and also can be configured infiniflow#801 ### Type of change - [x] New Feature (non-breaking change which adds functionality) commit a2a6a35 Author: KevinHuSh <kevinhu.sh@gmail.com> Date: Fri May 17 15:35:09 2024 +0800 fix doc number miss-match issue (infiniflow#822) ### What problem does this PR solve? infiniflow#620 ### Type of change - [x] Bug Fix (non-breaking change which fixes an issue) commit 9e5d501 Author: KevinHuSh <kevinhu.sh@gmail.com> Date: Fri May 17 14:33:19 2024 +0800 fix data init error (infiniflow#820) ### What problem does this PR solve? infiniflow#810 ### Type of change - [x] Bug Fix (non-breaking change which fixes an issue) commit 4ca176b Author: balibabu <cike8899@users.noreply.github.com> Date: Fri May 17 14:16:55 2024 +0800 fix: thumbnails are too large in the chat box infiniflow#818 (infiniflow#819) ### What problem does this PR solve? fix: thumbnails are too large in the chat box infiniflow#818 ### Type of change - [x] Bug Fix (non-breaking change which fixes an issue) commit c3bc72d Author: KevinHuSh <kevinhu.sh@gmail.com> Date: Fri May 17 14:04:21 2024 +0800 fix too large thumbnail issue (infiniflow#817) ### What problem does this PR solve? infiniflow#709 ### Type of change - [x] Bug Fix (non-breaking change which fixes an issue) commit 2dd705f Author: LiYongHui <46884881+yonghuili1@users.noreply.github.com> Date: Fri May 17 13:47:05 2024 +0800 feat: add feishu oauth (infiniflow#815) ### What problem does this PR solve? The back-end code adds Feishu oauth ### Type of change - [x] New Feature (non-breaking change which adds functionality) Co-authored-by: yonghui li <yonghui.li@bondex.com.cn> commit d161410 Author: KevinHuSh <kevinhu.sh@gmail.com> Date: Fri May 17 12:07:00 2024 +0800 fix stream chat for ollama (infiniflow#816) ### What problem does this PR solve? infiniflow#709 ### Type of change - [x] Bug Fix (non-breaking change which fixes an issue) commit 05fa3ae Author: KevinHuSh <kevinhu.sh@gmail.com> Date: Fri May 17 09:00:24 2024 +0800 use smaller docker images (infiniflow#813) ### What problem does this PR solve? ### Type of change - [x] New Feature (non-breaking change which adds functionality) commit e73ce39 Author: KevinHuSh <kevinhu.sh@gmail.com> Date: Fri May 17 08:51:29 2024 +0800 Add 2 embeding models from OpenAI (infiniflow#812) ### What problem does this PR solve? infiniflow#810 ### Type of change - [x] New Feature (non-breaking change which adds functionality) commit d54d137 Author: writinwaters <93570324+writinwaters@users.noreply.github.com> Date: Thu May 16 21:27:09 2024 +0800 Initial draft of configure knowledge base (infiniflow#794) ### What problem does this PR solve? _Briefly describe what this PR aims to solve. Include background context that will help reviewers understand the purpose of the PR._ ### Type of change - [x] Documentation Update commit c6c9dbd Author: balibabu <cike8899@users.noreply.github.com> Date: Thu May 16 20:15:02 2024 +0800 feat: Support for conversational streaming (infiniflow#809) ### What problem does this PR solve? feat: Support for conversational streaming infiniflow#709 ### Type of change - [x] New Feature (non-breaking change which adds functionality) commit 95f8091 Author: KevinHuSh <kevinhu.sh@gmail.com> Date: Thu May 16 20:14:53 2024 +0800 add stream chat (infiniflow#811) ### What problem does this PR solve? infiniflow#709 ### Type of change - [x] New Feature (non-breaking change which adds functionality) commit d6772f5 Author: KevinHuSh <kevinhu.sh@gmail.com> Date: Thu May 16 16:17:48 2024 +0800 add version (infiniflow#807) ### What problem does this PR solve? infiniflow#709 ### Type of change - [x] New Feature (non-breaking change which adds functionality) commit 63ca15c Author: lcjia_you <lcjia_you@126.com> Date: Thu May 16 10:49:41 2024 +0800 Fix a bug in 'assistant-setting.tsx' that causes the upload button to… (infiniflow#796) … incorrectly appear on the model settings page. ### What problem does this PR solve? This is an issue with the Upload component on the assistant-setting page. I use the show variable to explicitly control the button component within it. see: ![20240516000417](https://github.com/infiniflow/ragflow/assets/37476944/de88f911-6dbd-412d-a981-86cf60aa2257) ### Type of change - [x] Bug Fix (non-breaking change which fixes an issue) - [x] Other (please describe): Add the local models that DeepDoc depends on to the gitignore file in dev mode. Signed-off-by: liuchao <lcjia_you@126.com> commit 7b144cc Author: KevinHuSh <kevinhu.sh@gmail.com> Date: Thu May 16 09:10:29 2024 +0800 fix: can't capitalize file or folder name (infiniflow#798) ### What problem does this PR solve? infiniflow#792 ### Type of change - [x] Bug Fix (non-breaking change which fixes an issue) commit 1c4e92e Author: KevinHuSh <kevinhu.sh@gmail.com> Date: Thu May 16 09:00:12 2024 +0800 Knowledge base search is case sensitive (infiniflow#797) ### What problem does this PR solve? infiniflow#793 ### Type of change - [x] Bug Fix (non-breaking change which fixes an issue) commit 10e83f2 Author: writinwaters <93570324+writinwaters@users.noreply.github.com> Date: Wed May 15 20:02:41 2024 +0800 Added file management guide (infiniflow#788) ### What problem does this PR solve? Added guide with instructions on managing files in RAGFlow. ### Type of change - [x] Documentation Update commit 6ff63ee Author: dashi6174 <dashi6174@163.com> Date: Wed May 15 16:34:28 2024 +0800 Support for code files parse (infiniflow#789) ### What problem does this PR solve? _Briefly describe what this PR aims to solve. Include background context that will help reviewers understand the purpose of the PR._ ### Type of change - [x] New Feature (non-breaking change which adds functionality) commit 12b4c56 Author: GYH <43509927+chenshuizhong@users.noreply.github.com> Date: Wed May 15 16:33:28 2024 +0800 Updated conversation_api.md document/upload (infiniflow#787) ### What problem does this PR solve? Updated conversation_api.md document/upload parameter description ### Type of change - [x] Documentation Update commit baad35d Author: balibabu <cike8899@users.noreply.github.com> Date: Wed May 15 14:53:36 2024 +0800 fix: .knowledgebase folder can be deleted bug and change "Add file to knowledge base" to "Link file to knowledge base" bug (infiniflow#786) ### What problem does this PR solve? fix: .knowledgebase folder can be deleted bug fix: change "Add file to knowledge base" to "Link file to knowledge base" bug infiniflow#783 infiniflow#784 ### Type of change - [x] Bug Fix (non-breaking change which fixes an issue) commit 5effbfa Author: balibabu <cike8899@users.noreply.github.com> Date: Wed May 15 13:58:30 2024 +0800 fix: remove Top K in retrieval testing infiniflow#770 and if the document parsing fails, the error message returned by the backend is displayed (infiniflow#782) ### What problem does this PR solve? fix: remove Top K in retrieval testing infiniflow#770 fix: if the document parsing fails, the error message returned by the backend is displayed. ### Type of change - [x] Bug Fix (non-breaking change which fixes an issue) commit 4d47b2b Author: KevinHuSh <kevinhu.sh@gmail.com> Date: Wed May 15 13:02:31 2024 +0800 fix a string format error (infiniflow#781) ### What problem does this PR solve? ### Type of change - [x] Bug Fix (non-breaking change which fixes an issue) commit d8c080e Author: KevinHuSh <kevinhu.sh@gmail.com> Date: Wed May 15 12:51:57 2024 +0800 fix bugs in searching file using keywords (infiniflow#780) ### What problem does this PR solve? ### Type of change - [x] Bug Fix (non-breaking change which fixes an issue) commit 626ace8 Author: GYH <43509927+chenshuizhong@users.noreply.github.com> Date: Wed May 15 12:22:11 2024 +0800 Updated document upload method (infiniflow#777) ### What problem does this PR solve? api_app.py /document/upload add two non mandatory parameters parser_id: [naive,qaresume,manual,table,paper,book,laws,presentation,picture,one] run: 1 ### Type of change - [x] New Feature (non-breaking change which adds functionality) commit 1e923f1 Author: Jin Hai <haijin.chn@gmail.com> Date: Wed May 15 12:08:32 2024 +0800 Update README (infiniflow#779) ### What problem does this PR solve? infiniflow#771 ### Type of change - [x] Documentation Update --------- Signed-off-by: Jin Hai <haijin.chn@gmail.com> commit 234afb2 Author: balibabu <cike8899@users.noreply.github.com> Date: Wed May 15 11:34:57 2024 +0800 feat: support GPT-4o infiniflow#771 and hide the add button when the folder is a knowledge base (infiniflow#775) ### What problem does this PR solve? feat: support GPT-4o infiniflow#771 ### Type of change - [x] New Feature (non-breaking change which adds functionality) commit aa1c915 Author: KevinHuSh <kevinhu.sh@gmail.com> Date: Wed May 15 11:16:08 2024 +0800 support gpt-4o (infiniflow#773) ### What problem does this PR solve? infiniflow#771 ### Type of change - [x] New Feature (non-breaking change which adds functionality) commit 77b1520 Author: Jin Hai <haijin.chn@gmail.com> Date: Wed May 15 10:48:42 2024 +0800 Refactor message output format (infiniflow#772) ### What problem does this PR solve? _Briefly describe what this PR aims to solve. Include background context that will help reviewers understand the purpose of the PR._ ### Type of change - [x] Refactoring Signed-off-by: Jin Hai <haijin.chn@gmail.com> commit 6b06cce Author: writinwaters <93570324+writinwaters@users.noreply.github.com> Date: Tue May 14 18:46:39 2024 +0800 Miscellaneous updates (infiniflow#769) ### What problem does this PR solve? _Briefly describe what this PR aims to solve. Include background context that will help reviewers understand the purpose of the PR._ ### Type of change - [x] Documentation Update commit 282f085 Author: balibabu <cike8899@users.noreply.github.com> Date: Tue May 14 16:53:32 2024 +0800 fix: hide the add button when the folder is a knowledge base (infiniflow#765) ### What problem does this PR solve? infiniflow#764 fix: hide the add button when the folder is a knowledge base ### Type of change - [x] Bug Fix (non-breaking change which fixes an issue) commit d7744f5 Author: Jin Hai <haijin.chn@gmail.com> Date: Tue May 14 14:48:15 2024 +0800 Refactor method name (infiniflow#760) ### What problem does this PR solve? infiniflow#757 ### Type of change - [x] Refactoring Signed-off-by: Jin Hai <haijin.chn@gmail.com> commit 9b21b66 Author: writinwaters <93570324+writinwaters@users.noreply.github.com> Date: Tue May 14 12:22:33 2024 +0800 Create quickstart.md (infiniflow#743) ### What problem does this PR solve? Draft quickstart. ### Type of change - [x] Documentation Update commit aa03dfa Author: KevinHuSh <kevinhu.sh@gmail.com> Date: Mon May 13 14:02:38 2024 +0800 fix bug of get file (infiniflow#746) ### What problem does this PR solve? ### Type of change - [x] Bug Fix (non-breaking change which fixes an issue) commit 69b7c61 Author: Sawyer <35255629+shaoyie@users.noreply.github.com> Date: Mon May 13 09:25:45 2024 +0800 fix: typo in user_app.py (infiniflow#740) ### What problem does this PR solve? _Briefly describe what this PR aims to solve. Include background context that will help reviewers understand the purpose of the PR._ ### Type of change - [x] Bug Fix (non-breaking change - [x] Other (please describe): Fix typo commit 8769619 Author: Jin Hai <haijin.chn@gmail.com> Date: Sun May 12 13:40:47 2024 +0800 Update readme (infiniflow#741) ### What problem does this PR solve? Update readme. ### Type of change - [x] Documentation Update Signed-off-by: Jin Hai <haijin.chn@gmail.com> commit ffe5737 Author: KevinHuSh <kevinhu.sh@gmail.com> Date: Sat May 11 19:47:53 2024 +0800 let index be batchly. (infiniflow#733) ### What problem does this PR solve? let index be batchly. ### Type of change - [x] Refactoring commit 04a9e95 Author: KevinHuSh <kevinhu.sh@gmail.com> Date: Sat May 11 16:04:28 2024 +0800 let file in knowledgebases visible in file manager (infiniflow#714) ### What problem does this PR solve? Let file in knowledgebases visible in file manager. infiniflow#162 ### Type of change - [x] New Feature (non-breaking change which adds functionality) commit 91b4a18 Author: balibabu <cike8899@users.noreply.github.com> Date: Sat May 11 16:03:07 2024 +0800 Make the app name configurable even after the project is built (infiniflow#731) ### What problem does this PR solve? Make the app name configurable even after the project is built infiniflow#730 ### Type of change - [x] New Feature (non-breaking change which adds functionality) commit 33eaf6f Author: Ikko Eltociear Ashimine <eltociear@gmail.com> Date: Fri May 10 12:22:40 2024 +0900 docs: update README_ja.md (infiniflow#707) ### What problem does this PR solve? _Briefly describe what this PR aims to solve. Include background context that will help reviewers understand the purpose of the PR._ ### Type of change - [x] Documentation Update commit d65ba3e Author: balibabu <cike8899@users.noreply.github.com> Date: Fri May 10 10:38:39 2024 +0800 feat: delete the added model infiniflow#503 and display an error message when the requested file fails to parse infiniflow#684 (infiniflow#708) ### What problem does this PR solve? feat: delete the added model infiniflow#503 feat: display an error message when the requested file fails to parse infiniflow#684 ### Type of change - [x] New Feature (non-breaking change which adds functionality) commit bef1bbd Author: CKLogic <chuanzyz@sina.com> Date: Fri May 10 09:48:50 2024 +0800 Update README with Detailed WebUI Service Launch Instructions (infiniflow#694) ### What problem does this PR solve? Improve README by detailing Launch Service from Source section This commit enhances the README document by adding comprehensive steps for running the WebUI service in the 'Launch Service from Source' section. It aims to provide clearer guidance for users attempting to start the service from the source code, making the setup process more accessible and understandable. Key changes include: - Detailed instructions for setting up and running the WebUI service. - Necessary prerequisites for launching the service from source. This update ensures that users have all the information they need to successfully launch the service, improving the overall usability of our project. ### Type of change - [x] Documentation Update commit 6b36f31 Author: writinwaters <93570324+writinwaters@users.noreply.github.com> Date: Fri May 10 09:48:24 2024 +0800 Minor editorial updates (infiniflow#700) ### What problem does this PR solve? Editorial updates only. ### Type of change - [x] Documentation Update commit 648a2ba Author: KevinHuSh <kevinhu.sh@gmail.com> Date: Thu May 9 15:32:24 2024 +0800 fix disabled doc is still retreivalable (infiniflow#695) ### What problem does this PR solve? Fix that disabled doc is still retreivalable ### Type of change - [x] Bug Fix (non-breaking change which fixes an issue) commit 9392b8b Author: writinwaters <93570324+writinwaters@users.noreply.github.com> Date: Thu May 9 12:37:45 2024 +0800 0509 faq (infiniflow#693) ### What problem does this PR solve? Editorial updates only. ### Type of change - [x] Documentation Update commit 4153a36 Author: KevinHuSh <kevinhu.sh@gmail.com> Date: Thu May 9 11:35:08 2024 +0800 truncate text to fitin embedding model (infiniflow#692) ### What problem does this PR solve? ### Type of change - [x] Refactoring commit bca63ad Author: GYH <43509927+chenshuizhong@users.noreply.github.com> Date: Thu May 9 11:32:36 2024 +0800 Update faq.md (infiniflow#685) ### What problem does this PR solve? Updated FAQ: How to upgrade RAGFlow ### Type of change - [x] Documentation Update commit 793e29f Author: balibabu <cike8899@users.noreply.github.com> Date: Thu May 9 11:30:15 2024 +0800 fix: fix uploaded file time error infiniflow#680 (infiniflow#690) ### What problem does this PR solve? fix: fix uploaded file time error infiniflow#680 feat: support preview of word and excel infiniflow#684 ### Type of change - [x] Bug Fix (non-breaking change which fixes an issue) commit 99be226 Author: KevinHuSh <kevinhu.sh@gmail.com> Date: Wed May 8 20:00:14 2024 +0800 fix coordinate error (infiniflow#686) ### What problem does this PR solve? infiniflow#683 ### Type of change - [x] Bug Fix (non-breaking change which fixes an issue) commit 7ddb2f1 Author: KevinHuSh <kevinhu.sh@gmail.com> Date: Wed May 8 15:20:45 2024 +0800 make sure to raise exception if redis is not there (infiniflow#674) ### What problem does this PR solve? ### Type of change - [x] Refactoring commit c28f7b5 Author: KevinHuSh <kevinhu.sh@gmail.com> Date: Wed May 8 13:58:41 2024 +0800 make sure the error will be recorded. (infiniflow#672) ### What problem does this PR solve? ### Type of change - [x] Refactoring

### What problem does this PR solve? Vector similarity weight is displayed incorrectly #965 feat: add rerank models to the project #724 #162 ### Type of change - [x] Bug Fix (non-breaking change which fixes an issue)

### What problem does this PR solve? feat: add rerank models to the project #724 #162 ### Type of change - [x] New Feature (non-breaking change which adds functionality)

### What problem does this PR solve? #724 #162 ### Type of change - [x] Bug Fix (non-breaking change which fixes an issue) - [x] New Feature (non-breaking change which adds functionality)

### What problem does this PR solve? feat: Add ForceGraph feat: Classify nodes based on edge relationships #162 ### Type of change - [x] New Feature (non-breaking change which adds functionality)

### What problem does this PR solve? feat: Hide KnowledgeGraphModal #162 ### Type of change - [x] New Feature (non-breaking change which adds functionality)

### What problem does this PR solve? feat: Add IndentedTree #162 ### Type of change - [x] New Feature (non-breaking change which adds functionality)

…returned by the interface is empty infiniflow#162

…returned by the interface is empty #162 (#1795) …returned by the interface is empty #162 ### What problem does this PR solve? feat: Fixed the issue where the page reports an error when the graph returned by the interface is empty #162 ### Type of change - [x] New Feature (non-breaking change which adds functionality)

### What problem does this PR solve? feat: Translate ForceGraph #162 ### Type of change - [x] New Feature (non-breaking change which adds functionality)

wukimidaire · 2024-08-12T10:11:33Z

v0.1.0

URL support: Capable of web crawling and the corresponding content extration. @KevinHuSh

@KevinHuSh Hi, I wonder what's the current status? Maybe i can collaborate on it. My tech Stack is python backend and i think web crawling is essential for workflow of software development.

Crawling web page is big thing in my understanding. We do not have a clear picture for this. Here are two important points to note: Crawling Task Dispaching The way to execute JS on the page Page classification which is related the structure of the data we store The extraction of the main parts of the page

If you have any good solution to these points, please let me know....

There is already an existing service that does this job pretty well, could be interesting to look into this for crawling website content: https://www.firecrawl.dev/

JinHai-CN · 2024-08-12T11:06:17Z

v0.1.0

URL support: Capable of web crawling and the corresponding content extration. @KevinHuSh

@KevinHuSh Hi, I wonder what's the current status? Maybe i can collaborate on it. My tech Stack is python backend and i think web crawling is essential for workflow of software development.

Crawling web page is big thing in my understanding. We do not have a clear picture for this. Here are two important points to note: Crawling Task Dispaching The way to execute JS on the page Page classification which is related the structure of the data we store The extraction of the main parts of the page
If you have any good solution to these points, please let me know....

There is already an existing service that does this job pretty well, could be interesting to look into this for crawling website content: https://www.firecrawl.dev/

We will look into this website.

…niflow#1755) ### What problem does this PR solve? feat: Add ForceGraph feat: Classify nodes based on edge relationships infiniflow#162 ### Type of change - [x] New Feature (non-breaking change which adds functionality)

…1758) ### What problem does this PR solve? feat: Increase the distance between nodes infiniflow#162 ### Type of change - [x] New Feature (non-breaking change which adds functionality)

### What problem does this PR solve? feat: Add KnowledgeGraphModal infiniflow#162 ### Type of change - [x] New Feature (non-breaking change which adds functionality)

### What problem does this PR solve? feat: alter style of ForceGraph infiniflow#162 ### Type of change - [x] New Feature (non-breaking change which adds functionality)

### What problem does this PR solve? feat: Add EntityTypesForm infiniflow#162 ### Type of change - [x] New Feature (non-breaking change which adds functionality)

### What problem does this PR solve? feat: Hide KnowledgeGraphModal infiniflow#162 ### Type of change - [x] New Feature (non-breaking change which adds functionality)

### What problem does this PR solve? feat: Add IndentedTree infiniflow#162 ### Type of change - [x] New Feature (non-breaking change which adds functionality)

…returned by the interface is empty infiniflow#162 (infiniflow#1795) …returned by the interface is empty infiniflow#162 ### What problem does this PR solve? feat: Fixed the issue where the page reports an error when the graph returned by the interface is empty infiniflow#162 ### Type of change - [x] New Feature (non-breaking change which adds functionality)

### What problem does this PR solve? feat: Translate ForceGraph infiniflow#162 ### Type of change - [x] New Feature (non-breaking change which adds functionality)

…nfiniflow#966) ### What problem does this PR solve? Vector similarity weight is displayed incorrectly infiniflow#965 feat: add rerank models to the project infiniflow#724 infiniflow#162 ### Type of change - [x] Bug Fix (non-breaking change which fixes an issue)

### What problem does this PR solve? feat: add rerank models to the project infiniflow#724 infiniflow#162 ### Type of change - [x] New Feature (non-breaking change which adds functionality)

### What problem does this PR solve? infiniflow#724 infiniflow#162 ### Type of change - [x] Bug Fix (non-breaking change which fixes an issue) - [x] New Feature (non-breaking change which adds functionality)

writinwaters changed the title ~~ROADMAP~~ ROADMAP 2024 Mar 28, 2024

writinwaters assigned KevinHuSh Mar 28, 2024

yingfeng pinned this issue Mar 31, 2024

KevinHuSh mentioned this issue May 10, 2024

let file in knowledgebases visible in file manager #714

Merged

1 task

cike8899 added a commit to cike8899/ragflow that referenced this issue May 29, 2024

feat: add rerank models to the project infiniflow#724 infiniflow#162

b3fe598

cike8899 mentioned this issue May 29, 2024

feat: add rerank models to the project #724 #162 #966

Merged

1 task

KevinHuSh mentioned this issue May 29, 2024

add rerank model #969

Merged

1 task

KevinHuSh added a commit that referenced this issue May 29, 2024

add rerank model (#969)

614defe

### What problem does this PR solve? feat: add rerank models to the project #724 #162 ### Type of change - [x] New Feature (non-breaking change which adds functionality)

KevinHuSh mentioned this issue May 29, 2024

fix jina adding issure and term weight refinement #974

Merged

2 tasks

cike8899 mentioned this issue Jul 31, 2024

feat: Classify nodes based on edge relationships #162 #1755

Merged

1 task

cike8899 added a commit to cike8899/ragflow that referenced this issue Aug 2, 2024

feat: Hide KnowledgeGraphModal infiniflow#162

737eb51

cike8899 mentioned this issue Aug 2, 2024

feat: Hide KnowledgeGraphModal #162 #1783

Merged

1 task

KevinHuSh pushed a commit that referenced this issue Aug 2, 2024

feat: Hide KnowledgeGraphModal #162 (#1783)

3f21603

### What problem does this PR solve? feat: Hide KnowledgeGraphModal #162 ### Type of change - [x] New Feature (non-breaking change which adds functionality)

cike8899 added a commit to cike8899/ragflow that referenced this issue Aug 2, 2024

feat: Add IndentedTree infiniflow#162

9eedcd7

cike8899 mentioned this issue Aug 2, 2024

feat: Add IndentedTree #162 #1792

Merged

1 task

KevinHuSh pushed a commit that referenced this issue Aug 2, 2024

feat: Add IndentedTree #162 (#1792)

80032b1

### What problem does this PR solve? feat: Add IndentedTree #162 ### Type of change - [x] New Feature (non-breaking change which adds functionality)

cike8899 added a commit to cike8899/ragflow that referenced this issue Aug 2, 2024

feat: Fixed the issue where the page reports an error when the graph …

767b253

…returned by the interface is empty infiniflow#162

cike8899 mentioned this issue Aug 2, 2024

feat: Fixed the issue where the page reports an error when the graph returned by the interface is empty #162 #1795

Merged

1 task

cike8899 added a commit to cike8899/ragflow that referenced this issue Aug 5, 2024

feat: translate ForceGraph infiniflow#162

fdab6a9

cike8899 mentioned this issue Aug 5, 2024

feat: Translate ForceGraph #162 #1810

Merged

1 task

KevinHuSh pushed a commit that referenced this issue Aug 5, 2024

feat: Translate ForceGraph #162 (#1810)

9542f44

### What problem does this PR solve? feat: Translate ForceGraph #162 ### Type of change - [x] New Feature (non-breaking change which adds functionality)

infiniflow locked as too heated and limited conversation to collaborators Aug 6, 2024

infiniflow unlocked this conversation Aug 6, 2024

yingfeng closed this as completed Aug 6, 2024

yingfeng unpinned this issue Aug 6, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

ROADMAP 2024 #162

ROADMAP 2024 #162

writinwaters commented Mar 28, 2024 •

edited by KevinHuSh

Loading

ptdaxiake commented Apr 7, 2024

Umpire2018 commented Apr 10, 2024 •

edited by KevinHuSh

Loading

v0.1.0

KevinHuSh commented Apr 11, 2024 •

edited

Loading

v0.1.0

Umpire2018 commented Apr 11, 2024 •

edited

Loading

tvvignesh commented Apr 13, 2024

dashi6174 commented May 10, 2024

Miki-lin commented May 10, 2024

v0.6.0

JinHai-CN commented May 10, 2024 •

edited

Loading

v0.6.0

xs818818 commented May 11, 2024 •

edited by JinHai-CN

Loading

JinHai-CN commented May 11, 2024

AAlexDing commented May 11, 2024

JinHai-CN commented May 20, 2024 •

edited

Loading

wukimidaire commented Aug 12, 2024

v0.1.0

JinHai-CN commented Aug 12, 2024

v0.1.0

ROADMAP 2024 #162

ROADMAP 2024 #162

Comments

writinwaters commented Mar 28, 2024 • edited by KevinHuSh Loading

v0.10.0

v0.9.0

v0.8.0

v0.7.0

v0.6.0

Long-term plan

ptdaxiake commented Apr 7, 2024

Umpire2018 commented Apr 10, 2024 • edited by KevinHuSh Loading

v0.1.0

KevinHuSh commented Apr 11, 2024 • edited Loading

v0.1.0

Umpire2018 commented Apr 11, 2024 • edited Loading

tvvignesh commented Apr 13, 2024

dashi6174 commented May 10, 2024

Miki-lin commented May 10, 2024

v0.6.0

JinHai-CN commented May 10, 2024 • edited Loading

v0.6.0

xs818818 commented May 11, 2024 • edited by JinHai-CN Loading

JinHai-CN commented May 11, 2024

AAlexDing commented May 11, 2024

JinHai-CN commented May 20, 2024 • edited Loading

wukimidaire commented Aug 12, 2024

v0.1.0

JinHai-CN commented Aug 12, 2024

v0.1.0

writinwaters commented Mar 28, 2024 •

edited by KevinHuSh

Loading

Umpire2018 commented Apr 10, 2024 •

edited by KevinHuSh

Loading

KevinHuSh commented Apr 11, 2024 •

edited

Loading

Umpire2018 commented Apr 11, 2024 •

edited

Loading

JinHai-CN commented May 10, 2024 •

edited

Loading

xs818818 commented May 11, 2024 •

edited by JinHai-CN

Loading

JinHai-CN commented May 20, 2024 •

edited

Loading