fix: Correct parsing errors in ProcessorParseApsaraNative with large buffer input #1255
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
增加ProcessorParseApsaraNative、ProcessorParseDelimiterNative、ProcessorParseJsonNative三个插件的多行情况下的单测 |
|
修复ProcessorParseApsaraNative插件在多行情况下的异常 |
messixukejia
requested changes
Dec 4, 2023
messixukejia
requested changes
Dec 4, 2023
yyuuttaaoo
approved these changes
Dec 5, 2023
yyuuttaaoo
reviewed
Dec 5, 2023
yyuuttaaoo
requested changes
Dec 5, 2023
yyuuttaaoo
reviewed
Dec 6, 2023
yyuuttaaoo
reviewed
Dec 6, 2023
yyuuttaaoo
approved these changes
Dec 6, 2023
yyuuttaaoo
changed the title
messixukejia
approved these changes
Dec 7, 2023
yyuuttaaoo
pushed a commit
that referenced
this pull request
Dec 7, 2023
…buffer input (#1255) * fix 越界问题 * add comment
quzard
added a commit
to quzard/ilogtail
that referenced
this pull request
Dec 8, 2023
…buffer input (alibaba#1255) * fix 越界问题 * add comment (cherry picked from commit ff0d88d)
henryzhx8
pushed a commit
that referenced
this pull request
Dec 8, 2023
* fix: Correct parsing errors in ProcessorParseApsaraNative with large buffer input (#1255) --------- Co-authored-by: yitao <qiuwencheng.qwc@alibaba-inc.com>
yyuuttaaoo
pushed a commit
that referenced
this pull request
Dec 24, 2023
* complete pipeline definition (#1185) * add common param extractor * add input_file * add input_observer_network * add flusher_SLS * add global config module * improve pipeline def * polish code * polish code * add pipeline implementation * polish code * seperate params from input_file * polish code * polish code * add file server * polish code * polish code * polish code * fix bug * polish code * fix bug * polish code * refactor code * refactor event dispatcher * remove global filter * refactor app config * remove shennong and streamlog * fix bug * upgrade V1 config to V2 * fix bug * refactor pipeline management * add ut * add ut * fix e2e * polish code * for tmp use * for tmp use * polish code * for tmp use * for tmp use * fix * fix e2e * temporarily remove observer case * fix e2e * fix e2e * polish code * Yaml (#3) * ParseYamlConfig * polish code * fix e2e * remove old config * cleanup gflags * fix bug * polish code * polish code * polish code * fix bug * polish code * polish code * fix code * polish code * polish * fix code * fix * fix * polish code * fix * fix * fix * polish * polish * polish code * test * test * polish * fix observer * polish test * fix code * polish code * polish code * fix bug * Pipeline processor (#2) upgrade processor to v2 * polish code * polish * polish * polish code * polish code * In order to achieve a relatively unified interface for SPL and other plugins, the interface definition has been optimized. (#1254) * refine interface * refine code * refine code * refine code * fix comments * polish code * polish * polish * polish code * polish * fix code * fix * fix * polish code * add log * fix * fix bug * fix * fix bug * polish * fix * fix * fix * fix * fix * fix * Merge processor changes of main branches (#1259) * fix: Correct parsing errors in ProcessorParseApsaraNative with large buffer input (#1255) --------- Co-authored-by: yitao <qiuwencheng.qwc@alibaba-inc.com> * polish * add alarm * polish * polish * polish * polish code * polish * polish code * polish --------- Co-authored-by: quzard <1191890118@qq.com> Co-authored-by: linrunqi08 <90741255+linrunqi08@users.noreply.github.com> Co-authored-by: yitao <qiuwencheng.qwc@alibaba-inc.com> Co-authored-by: 笃敏 <zhanghaoxiang.zhx@alibaba-inc.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This commit addresses incorrect parsing outcomes in ProcessorParseApsaraNative when reading a large buffer that contains multiple log entries. New unit tests have been introduced for ProcessorParseApsaraNative, ProcessorParseDelimiterNative, and ProcessorParseJsonNative to verify accurate parsing of log data in scenarios involving large buffer inputs.