2.0.0

Agent

ISSUE	Summary
INLONG-10286	[Improve][Agent] Update the MQTT Source
INLONG-10287	[Improve][Agent] Update the Redis Source
INLONG-10288	[Improve][Agent] Update the Oracle Source
INLONG-10289	[Improve][Agent] Update the SQLServer Source
INLONG-10742	[Improve][Agent] Set the formatting of unix timestamp for SQLServerSource as optional
INLONG-10749	[Improve][Agent] Local DB instance records may leak
INLONG-10751	[Improve][Agent] Agent needs to report process status for backend problem analysis
INLONG-10756	[Improve][Agent] Report file metrics for backend problem analysis
INLONG-10761	[Improve][Agent] Delete reader related code
INLONG-10770	[Improve][Agent] Delete audit proxy configuration related code
INLONG-10889	[Improve][Agent] When detecting oom, it is recommended to exit the process
INLONG-11135	[Improve][Agent] Support filtering capability when supplementing data
INLONG-11145	[Improve][Agent] Data supplementation needs optimization
INLONG-11179	[Improve][Agent] Delete useless code
INLONG-11298	[Improve][Agent] Pulsar source needs to do some exception handling
INLONG-11306	[Improve][Agent] Modify the naming of variables in the redis source
INLONG-11327	[Improve][Agent] No longer retrieve extend class from task configuration
INLONG-11333	[Improve][Agent] Retrieve IP from configuration file during audit reporting
INLONG-11175	[Bug][Agent] The current MqttSource solution may cause message loss

Dashboard

ISSUE	Summary
INLONG-10632	[Feature][Dashboard] dashboard should support oceanbase
INLONG-10693	[Improve][Dashboard] Added custom ASCII code option for source data field separator
INLONG-10779	[Improve][Dashboard] Data synchronization adds offline synchronization configuration
INLONG-10783	[Improve][Dashboard] Add enableCreateResource field to all sinks
INLONG-10787	[Improve][Dashboard] Update missing i18n item
INLONG-10839	[Improve][Dashboard] Data preview style structure modification
INLONG-10844	[Improve][Dashboard] Resource details page sort information interface switch
INLONG-10846	[Improve][Dashboard] Add cluster name to data source information display
INLONG-10847	[Improve][Dashboard] Cluster node management adds heartbeat display page
INLONG-10910	[Improve][Dashboard] Sort info Modify some field names
INLONG-11178	[Improve][Dashboard] Added http sink and http node
INLONG-11183	[Improve][Dashboard] Module audit page indicator items are merged with other items
INLONG-11197	[Improve][Dashboard] Add delete button to cluster management and template management
INLONG-11204	[Improve][Dashboard] agent node hidden port number
INLONG-11210	[Improve][Dashboard] Version management removes related interface calls and adds default values
INLONG-10572	[Bug][Dashboard] The Approvals page appears "Something went wrong"
INLONG-10947	[Bug][Dashboard] Modify field description missing for English locale
INLONG-10973	[Bug][Dashboard] A wrong error occurs in data preview

Manager

ISSUE	Summary
INLONG-10703	[Feature][Manager] Manager should support oceanbase
INLONG-10723	[Improve][Manager] Update base64 encoder
INLONG-10758	[Improve][Manager] Support obtaining serialization configuration when wrapType is raw
INLONG-10834	[Improve][Manager] Standalone configuration supports Tube MQ
INLONG-10856	[Improve][Manager] Support agent installation logs
INLONG-10884	[Improve][Manager] Support configuring HTTP type sink
INLONG-10907	[Improve][Manager] Support reinstalling the installer
INLONG-10911	[Improve][Manager] Support pagination to query sort task details information
INLONG-10931	[Improve][Manager] Data preview supports data containing escape characters
INLONG-10954	[Improve][Manager] Support fields of timestamptz type
INLONG-10977	[Improve][Manager] Data preview supports escaping for KV data type
INLONG-10988	[Improve][Manager] Data preview filters data in tubes based on streamId
INLONG-11089	[Improve][Manager] Optimize Sort filter function
INLONG-11091	[Improve][Manager] Manager supports in filter function configuration
INLONG-11103	[Improve][Manager] Data add task supports filtering based on stream
INLONG-11157	[Improve][Manager] Asynchronous processing agent installation
INLONG-11195	[Improve][Manager] It is not allowed to modify group information when ordinary users are not responsible
INLONG-11313	[Improve][Manager] Dataproxy cluster increases maximum packet length configuration
INLONG-11323	[Improve][Manager] Modify the parameters of the data add tasks for file collection
INLONG-11335	[Improve][Manager] Move maxPacketLength to the DataProxyNodeResponse
INLONG-10730	[Bug][Manager] Auto-assign wrong Sortstandalone cluster when no cluster is under the tag
INLONG-10754	[Bug][Manager] Offline data sync may create too many scheduling instances at the start point
INLONG-10763	[Bug][Manager] Exception occurs when get or update offline sync group information
INLONG-10842	[Bug][Manager] Tube cluster address not obtained when obtaining consumer group information
INLONG-10918	[Bug][Manager] The correct command was not used when reinstalling the installer
INLONG-10921	[Bug][Manager] Task configuration not deleted when deleting streamSource
INLONG-10975	[Bug][Manager] When saving the group, only the existence of the groupid under the current tenant was verified
INLONG-10997	[Bug][Manager] Incorrect setting of transformSQL in dataflowconfig
INLONG-11071	[Bug][Manager] Failed to handle request on inlong_agent_system by admin
INLONG-11095	[Bug][Manager]Data preview field misalignment
INLONG-11142	[Bug][Manager] Data add task not scheduled for cleaning
INLONG-11150	[Bug][Manager] Incorrect setting of sorTaskName for sink
INLONG-11153	[Bug][Manager] HTTP sink does not automatically allocate sort cluster
INLONG-11163	[Bug][Manager] Adding dataaddtask failed
INLONG-11307	[Bug][Manager] Unable to obtain extparams from multiple data sources

SDK

ISSUE	Summary
INLONG-10119	[Feature][SDK] Supporting Data Sharding with GroupBy Semantics
INLONG-10128	[Feature][SDK] Support to parse Map node in JSON or PB protocol data
INLONG-10464	[Feat...

1.13.0

Agent

ISSUE	Summary
INLONG-10094	[Improve][Agent] The task record for data supplementation has not expired
INLONG-10107	[Improve][Agent] There is a bug in updating the module configuration
INLONG-10113	[Improve][Agent] Delete useless code
INLONG-10115	[Improve][Agent] Offset needs to be changed to save in string format because some data sources have non integer positions
INLONG-10187	[Improve][Agent] Need to handle situations where timeoffset is empty, default to no offset
INLONG-10189	[Improve][Agent] There is a risk of agent getting stuck after SDK initialization exception
INLONG-10191	[Improve][Agent] Delete useless code
INLONG-10210	[Improve][Agent] The installer needs to add a script for environment initialization
INLONG-10268	[Improve][Agent] Suggest not using task ID as the data version
INLONG-10281	[Improve][Agent] Real time collection of files with audit data errors
INLONG-10298	[Improve][Agent] The command related code is no longer useful, it is recommended to delete it
INLONG-10302	[Improve][Agent] The Task base class needs to add an interface that limits the number of instances obtained
INLONG-10318	[Feature][Agent] Add PostgreSQL data source for Agent
INLONG-10319	[Improve][Agent] Agent should get audit id from audit sdk
INLONG-10384	[Improve][Agent] Add functions to the Store interface to extend new storage plugins
INLONG-10399	[Improve][Agent] Add global configurations updater
INLONG-10410	[Improve][Agent] Add ZK plugin to save offset info
INLONG-10443	[Improve][Agent] Put Rocksdb into the plugins module
INLONG-10446	[Improve][Agent] Adjusting audit SDK address settings
INLONG-10476	[Improve][Agent] The audit address should only be obtained from the manager
INLONG-10535	[Improve][Agent] Support minute level tasks
INLONG-10542	[Improve][Agent] Remove the deleted watch directions
INLONG-10547	[Improve][Agent] Provide a clear prompt after the mq type is incorrect
INLONG-10564	[Improve][Agent] Request configuration with md5 included
INLONG-10598	[Improve][Agent] Delete excess unit tests
INLONG-10611	[Improve][Agent] Update configuration only when the version number is increased
INLONG-10633	[Improve][Agent] The initialization function of AuditUtils needs to pass in the configuration
INLONG-10645	[Improve][Agent] Installer needs to add process protection
INLONG-10650	[Improve][Agent] When the installer updates the configuration, it is necessary to first determine the version

Dashboard

ISSUE	Summary
INLONG-10179	[Bug][Dashboard] There are redundant All types in cluster management
INLONG-10226	[Bug][Dashboard] Audit items cannot be searched
INLONG-10256	[Improve][DashBoard] Modify the data source IP item of the file data source form in the data access module
INLONG-10314	[Improve][DashBoard] Add an operation time to the operation log table
INLONG-10347	[Improve][Dashboard] Add Agent IP field to PostgreSQL data source
INLONG-10350	[Bug][Dashboard] Audit item search failed
INLONG-10377	[Improve][DashBoard] add Source Data Field Template
INLONG-10394	[Improve][DashBoard] Agent page modifies the version and sets the default values for the commands
INLONG-10409	[Feature][Dashboard] Support installing agents by SSH key-based authentication
INLONG-10417	[Bug][Dashboard] There is an issue with the MODE display on the approval screen, and data synchronization is not displayed
INLONG-10419	[Feature][Dashboard] Automatically switch tenants when opening a page with groupId
INLONG-10449	[Bug][Dashboard] The field template for selecting a new data flow does not take effect
INLONG-10468	[Feature][Dashboard] Audit data showing totals and variances
INLONG-10500	[Improve][Dashboard] When you edit tenants in a template, you need to change the scope to hide them
INLONG-10501	[Improve][Dashboard] Modify component type to be more intuitive
INLONG-10504	[Improve][Dashboard] Added details button to tag management
INLONG-10584	[Improve][Dashboard] New cluster type adds sortkafka types
INLONG-10592	[Improve][Dashboard] When there are too many selections in the drop-down box, omit some of them
INLONG-10614	[Improve][Dashboard] The template list does not need to display Id
INLONG-10617	[Improve][Dashboard] The mq type should not exist on the data synchronization page
INLONG-10620	[Bug][Dashboard] Page error occurs wrong
INLONG-10640	[Improve][Dashboard] Approval page display item modification
INLONG-10651	[Improve][Dashboard] File Type data stream supports minute-level periods
INLONG-10681	[Bug][Dashboard] There is a nesting problem in moduleIdList
INLONG-10691	[Improve][Dashboard] Added monitoring and auditing page

Tube

ISSUE	Summary
INLONG-10126	[Bug][tubemq-server] Maven sleepycat je.version 7.3.7 can not found in maven repository

DataProxy

ISSUE	Summary
INLONG-10066	[Improve][DataProxy] Optimize the related configuration settings in the CommonConfigHolder.java file
INLONG-10067	[Improve][DataProxy] Simplify the configuration and acquisition of the Manager address
INLONG-10080	[Improve][DataProxy] DataProxy implementation optimization
INLONG-10081	[Improve][DataProxy] Modify the data format of metadata saved in the metadata.json file
INLONG-10102	[Improve][Dat...

1.12.0

Agent

ISSUE	Summary
INLONG-9801	[Umbrella][Agent] Add an agent installer module for agent installation
INLONG-9698	[Improve][Agent] Optimize file collection initialization logic toIO
INLONG-9700	[Improve][Agent] Optimize the message ack logic to reduce semaphore competition.
INLONG-9702	[Improve][Agent] Change the data transmission interval to depend on local file configuration
INLONG-9704	[Improve][Agent] Modify the default value of memory control semaphores to adapt to businesses with large amounts of data
INLONG-9710	[Improve][Agent] Improve the accuracy of instance heartbeat auditing
INLONG-9712	[Improve][Agent] Adjusting task configuration verification logic
INLONG-9714	[Improve][Agent] SQL injection in pgjdbc
INLONG-9716	[Improve][Agent] Delete useless code when storing tasks
INLONG-9721	[Improve][Agent] Add a common cycle parameter to the task configuration
INLONG-9736	[Improve][Agent] Make time zone a common parameter
INLONG-9772	[Improve][Agent] Increase auditing for sending exceptions and resending
INLONG-9798	[Improve][Agent] Add type for agent installer
INLONG-9802	[Improve][Agent] Add an agent installer module for agent installation
INLONG-9806	[Improve][Agent] Add installer configuration file
INLONG-9816	[Improve][Agent] Add config class for installer
INLONG-9829	[Improve][Agent] Add guardian scripts
INLONG-9831	[Improve][Agent] Increase configuration acquisition capability
INLONG-9833	[Improve][Agent] Add module state to distinguish whether the module has been downloaded or installed
INLONG-9844	[Improve][Agent] Add agent installer config request class
INLONG-9848	[Improve][Agent] Add the getAuthHeader function in the HttpManager class
INLONG-9850	[Improve][Agent] Add a function to retrieve HttpManager in the ModuleManager class
INLONG-9852	[Improve][Agent] Place the configuration item for the installation package storage path in the installation package configuration
INLONG-9858	[Improve][Agent] Increase local read and write capabilities for module config
INLONG-9859	[Improve][Agent] Increase installation package download capability and local MD5 computing power
INLONG-9863	[Improve][Agent] To avoid data loss caused by too many supplementary files
INLONG-9889	[Improve][Agent] Delete test code
INLONG-9906	[Improve][Agent] Add configuration comparison logic and processing of comparison results
INLONG-9909	[Improve][Agent] Add unit test for installer
INLONG-9910	[Improve][Agent] Increase daily verification for process monitoring, reinstallation, or re downloading
INLONG-9922	[Improve][Agent] Add a configuration copy script to copy the configuration from the installer to the agent
INLONG-9946	[Improve][Agent] Verify the return code, only proceed with the subsequent process if the return code is successful
INLONG-9948	[Improve][Agent] The instance class has many code similarities, abstract a common class
INLONG-9955	[Improve][Agent] Rename Job to Task
INLONG-9969	[Improve][Agent] Release the memory semaphore of the source only when the data is placed in the queue
INLONG-9982	[Improve][Agent] Adjusting the abstraction of source code to facilitate rapid addition of sources
INLONG-9983	[Improve][Agent] Renew the doc of adding sources
INLONG-9987	[Improve][Agent] Fix the issue of deleting the first digit whent0 ...

1.11.0

Agent

ISSUE	Summary
INLONG-9457	[Improve][Agent] Add task and instance heartbeat audit
INLONG-9481	[Improve][Agent] Add unit test of reading with offset
INLONG-9580	[Improve][Agent] Add unit testing to taskmanager to test their ability to recover tasks from DB
INLONG-9614	[Improve][Agent] Change folder name
INLONG-9467	[Improve][Agent] Improve code exception detection to ensure task and instance state transitions
INLONG-9454	[Improve][Agent] Increase exit conditions to prevent dead loops
INLONG-9556	[Improve][Agent] Prevent thread freeze caused by deleting data sources when the backend cannot send out
INLONG-9572	[Improve][Agent] Set data time of message cache by sink data time
INLONG-9548	[Improve][Agent] Supports HTTPS and can determine whether to enable it through configuration
INLONG-9600	[Improve][Agent]Adjust the sinks directory for code consistency

Dashboard

ISSUE	Summary
INLONG-9627	[Improve][Dashboard] Audit and transmission delay filtering query optimization
INLONG-9543	[Improve][Dashboard] Cls, Pulsar and es sink support saving sortTaskName and sortConsumerGroup
INLONG-9610	[Improve][Dashboard] Cluster creation type optimization
INLONG-9495	[Improve][Dashboard] Data synchronization basic information page optimization
INLONG-9663	[Improve][Dashboard] Data synchronization doris sink supports append Mode
INLONG-9530	[Improve][Dashboard] Dataproxy cluster nodes support adding the enabledOnline parameter
INLONG-9505	[Improve][Dashboard] Pulsar source parameter optimization
INLONG-9516	[Improve][Dashboard] Remove useless dependencies
INLONG-8393	[Improve][DataProxy] Optimize the HeartbeatManager class
INLONG-9657	[Feature][Dashboard] Support management of Doris data node
INLONG-9439	[Feature][Dashboard] Support module reconciliation function
INLONG-9550	[Feature][Dashboard] System operation and maintenance supports query and audit through Gorupid and Stream id
INLONG-9489	[Bug][Dashboard] Transform remove missing stream id

Manager

ISSUE	Summary
INLONG-9508	[Feature][Manager] Add Iceberg field type mapping strategy to improve usability
INLONG-9634	[Feature][Manager] Auto assgin sort task and consumer group of standalone export
INLONG-9056	[Feature][Manager] Configuration change detection
INLONG-9524	[Feature][Manager] Manager client support migrate group tenant
INLONG-9452	[Improve][Manager] Add audit items for file agent
INLONG-9484	[Improve][Manager] Improve logic of sortstandalone sink auto-assigned cluster
INLONG-9441	[Improve][Manager] MySQL data source supports both full and incremental modes
INLONG-8392	[Improve][Manager] Optimize the HeartbeatMsg class
INLONG-9586	[Improve][Manager] Provide installation agent framework
INLONG-9528	[Improve][Manager] Support configuring the switch to enable dataproxy nodes
INLONG-9591	[Improve][Manager] Support printing thread status before submitting tasks
INLONG-9523	[Improve][Manager] Support querying all audit information based on IP address
INLONG-9440	[Improve][Manager] Support querying audit information based on ip
INLONG-9518	[Improve][Manager] Support resetting the consumption location of the consumption group used by sort
INLONG-9475	[Improve][Manager] Support setting dataNode when configuring streamSource for MYSQL
INLONG-9533	[Improve][Manager] Support setting dataNode when configuring streamSource for Pulsar/Iceberg/PostgreSQL
INLONG-9510	[Improve][Manager] Supports doris database synchronization
INLONG-9503	[Improve][Manager] Unified Hashmap Dependency Package
INLONG-9577	[Bug][Manager] Datatime field type conversion error
INLONG-9204	[Bug][Manager] Failed to use PostgreSQL sink
INLONG-9470	[Bug][Manager] Failed to verify if the namespace exists
INLONG-9461	[Bug][Manager] Failure of GroupTaskListenerFactoryTest
INLONG-9618	[Bug][Manager] HttpUtils did not process 307 status code
[INLONG-9606](https://github.com/ap...

1.10.0

Agent

ISSUE	Summary
INLONG-9089	[Improve][Agent] Add enums for task and instance
INLONG-9091	[Improve][Agent] Add offset profile
INLONG-9094	[Umbrella][Agent] Reconfiguration of task management
INLONG-9102	[Improve][Agent] Add file utils
INLONG-9112	[Improve][Agent] Add task and instance profile
INLONG-9117	[Improve][Agent] Rewrite class RocksDbImp to enable it to be constructed with a child path
INLONG-9120	[Improve][Agent] Add offset db to store the offset data
INLONG-9122	[Improve][Agent] Add task and instance action
INLONG-9124	[Improve][Agent] Add task and instance db
INLONG-9125	[Improve][Agent] Add offset manager
INLONG-9132	[Improve][Agent] Add file used message cache
INLONG-9134	[Improve][Agent] Add file related utils
INLONG-9136	[Improve][Agent] Add instance manager
INLONG-9138	[Improve][Agent] Add task manager
INLONG-9143	[Improve][Agent] Add log file collect task
INLONG-9149	[Improve][Agent] Add sender manager for file collect
INLONG-9151	[Improve][Agent] Add log file source and source related modification
INLONG-9155	[Improve][Agent] Add file used proxy
INLONG-9159	[Improve][Agent] Add file instance
INLONG-9161	[Improve][Agent] Modify left sink
INLONG-9163	[Improve][Agent] Delete trigger related file
INLONG-9165	[Improve][Agent] Delete job related file
INLONG-9182	[Improve][Agent] Delete useless code
INLONG-9187	[Improve][Agent] Delete useless memory manager
INLONG-9190	[Bug][Agent] Log file source clear buffer queue does not take effect
INLONG-9194	[Bug][Agent] Calc time offset failed if the param is 0
INLONG-9200	[Bug][Agent] Duplicate file collect instance
INLONG-9207	[Bug][Agent] Task manager stuck
INLONG-9214	[Improve][Agent] Limit max file count to collect once
INLONG-9215	[Improve][Agent] Add predefine fields
INLONG-9233	[Bug][Agent] Fix bug: source, proxy, sender get stuck
INLONG-9237	[Improve][Agent] Move addictive fields to package attributes
INLONG-9241	[Improve][Agent] Print task and instance detail every ten seconds
INLONG-9244	[Bug][Agent] Fix bug: miss file from next data time
INLONG-9253	[Bug][Agent] Get byte position of file by line count offset failed
INLONG-9263	[Improve][Agent] Print the statistics of task and instance not detail
INLONG-9265	[Improve][Agent] Add audit of agent send success
INLONG-9267	[Bug][Agent] Data loss when there are many files to read once
INLONG-9284	[Improve][Agent] Report audit by data time not real time
INLONG-9286	[Improve][Agent] Adjust the time offset calculation function
INLONG-9289	[Improve][Agent] Improve the completion judgment logic of collecting instances
INLONG-9300	[Improve][Agent] Divide data time into source time and sink time
INLONG-9308	[Improve][Agent] The sink end of the file instance supports sending data with different streamIds
INLONG-9310	[Improve][Agent] Add extended handler in file source
INLONG-9312	[Improve][Agent] Add data content style
INLONG-9315	[Improve][Agent] Convert data time from source time zone to sink time zone.
INLONG-9317	[Improve][Agent] Print basic info of hearbeat
INLONG-9335	[Improve][Agent] Bring cycle parameters when creating an instance
INLONG-9338	[Improve][Agent] Real time file collection uses the current time as the data time
INLONG-9347	[Improve][Agent] Check task profile before save into db
INLONG-9364	[Improve][Agent] Remove expired instance from db
INLONG-9366	[Improve][Agent] Remove useless offset record
INLONG-9369	[Improve][Agent] Increase sending failure audit and real-time audit
INLONG-9375	[Improve][Agent] Modify the agent's real-time audit id to prevent duplication
INLONG-9390	[Improve][Agent] Collect supplementary data in chronological order
INLONG-9397	[Improve][Agent] Do not directly delete the instance records of the local db when stopping the instances

1.9.0

Agent

ISSUE	Summary
INLONG-8850	[Improve][Agent] Remove unregister of MetricRegister when taskmanager is initialized
INLONG-8655	[Bug][Agent] JobWrapper thread leaks when the job is stopped
INLONG-8652	[Improve][Agent] Delete the capacity of setting blacklist
INLONG-8649	[Bug][Agent] Thread leaks for ProxySink when the DataProxy SDK init failed
INLONG-8647	[Improve][Agent] Stop sending task snapshot to Manager module
INLONG-8645	[Improve][Agent] Delete the capacity of the loading trigger for local files
INLONG-8629	[Bug][Agent] Sending invalid data to DataProxy failed blocks normal data sending
INLONG-8524	[Improve][Agent] Update the JVM Options for Agent
INLONG-8520	[Bug][Agent] File agent sent data to dataproxy was all json formatted 1.9.x/bugfix
INLONG-8146	[Improve][Agent] Optimize agent-env.sh, and '-XX:NativeMemoryTracking'
INLONG-8799	[Bug][Manager][Agent][DataProxy] The "opentelemetry" related configs may affect the startup of services
INLONG-8611	[Feature][Manager][Agent][DataProxy] Support full link tracking to improve the observability of the project

Audit

ISSUE	Summary
INLONG-8836	[Improve][Audit] Add audit_tag information to distinguish data sources and data targets
INLONG-8753	[Improve][Audit] Separate commons-text from org.apache.flume
INLONG-8699	[Improve][Audit] Optimize the service log of audit-proxy
INLONG-8642	[Improve][Audit] Remove the audit commons-text dependency

Dashboard

ISSUE	Summary
INLONG-8882	[Feature][Dashboard] Support management of Pulsar data node
INLONG-8881	[Feature][Dashboard] Support management of Pulsar sink
INLONG-8843	[Improve][Dashboard] StarRocks sink field optimization
INLONG-8841	[Feature][Dashboard] Support management of Iceberg sources
INLONG-8810	[Improve][Dashboard] Approval management process ID link optimization
INLONG-8800	[Improve][Dashboard] Owners search component optimization
INLONG-8788	[Improve][Dashboard] Data synchronization page optimization
INLONG-8779	[Improve][Dashboard] Modify password verification optimization
INLONG-8760	[Bug][Dashboard] The transform button was not at the center
INLONG-8757	[Improve][Dashboard] Implement buttons using a link good first issue
INLONG-8755	[Improve][Dashboard] Data synchronization field mapping optimization
INLONG-8727	[Improve][Dashboard] Approval management Application details optimization
INLONG-8705	[Improve][Dashboard] Source and sink title optimization
INLONG-8693	[Feature][Dashboard] Data synchronization supports Audit
INLONG-8661	[Bug][DashBoard] DatabaseWhiteList is required which is inconsistent with tips
INLONG-8624	[Bug][Dashboard] Tenant Management Search Tenant Exceptions
INLONG-8621	[Feature][Dashboard] Approval management supports approval data synchronization
INLONG-8575	[Improve][Dashboard] Tenant management query optimization
INLONG-8560	[Bug][Dashboard] No username and password when configuring hive.
INLONG-8548	[Feature][Dashboard] Data access supports displaying transmission delay
INLONG-8546	[Bug][Dashboard] Inlong group resource details display error good first issue
INLONG-8512	[Bug][Dashboard] Create tube consumer failed when selecting topic 1.9.x/bugfix
INLONG-8502	[Bug][Dashboard] Query data preview interface exception
INLONG-8500	[Bug][Dashboard] Fix stream data preview url error
INLONG-8008	[Improve][Dashboard] Add default icon for different data nodes good first issue

DataProxy

ISSUE	Summary
INLONG-8914	[Improve][DataProxy] Optimize DataProxy event statistics ...

1.8.0

Release Notes

Agent

ISSUE	Summary
INLONG-8176	[Improve][Agent] Upgrade rocksdb version
INLONG-8180	[Improve][Agent] Improve the efficiency and safety of log file reading
INLONG-8183	[Improve][Agent] Optimize agent UT
INLONG-8244	[Bug][Agent] Thread leaks after the job is finished
INLONG-8251	[Improve][Agent] Add global memory limit for file collect
INLONG-8334	[Improve][Agent] Optimize the file collection UT
INLONG-8339	[Improve][DataProxy][Agent] Enable audit by default in DataProxy and Agent
INLONG-8347	[Improve][Agent] Optimize the agent UT of testTimeOffset
INLONG-8352	[Improve][Agent] Optimize the agent UT of testRestartTriggerJobRestore
INLONG-8376	[Improve][Agent] Optimize the agent UT of TestTriggerManager

DataProxy

ISSUE	Summary
INLONG-4961	[Feature][DataProxy] Golang SDK
INLONG-7194	[Improve][DataProxy] Migrate index log statistics for the new mq layer
INLONG-7766	[Bug][SDK] Adjusted frame length exceeds occurred when reporting data through the HTTP protocol
INLONG-7950	[Improve][DataProxy] Optimize the implementation logic of the Source
INLONG-8049	[Improve][DataProxy] Add CIDR configuration in the BlackList and WhiteList
INLONG-8073	[Improved][DataProxy]Add HTTP message processing logic in source2
INLONG-8106	[Improve][DataProxy] Optimize ConfigManager implementation ( part one )
INLONG-8132	[Improve][DataProxy] Fix Golang SDK typo errors in readme.md and options.go
INLONG-8161	[Improve][DataProxy] Optimize BatchPackProfile related classes implementation
INLONG-8163	[Improve][Manager][DataProxy] Make DataProxy config interface compatible with old versions
INLONG-8167	[Improve][DataProxy]Update Golang SDK dependent packages to fix dependabot alerts
INLONG-8192	[Bug][DataProxy] The topic name generated by dataproxy is incorrect
INLONG-8212	[Improve][DataProxy] Improve HTTP related message handling
INLONG-8228	[Improve][DataProxy] Optimize the implementation of the index output to files
INLONG-8252	[Improve][DataProxy] Adjust default Topic settings from Source to Sink
INLONG-8267	[Improve][DataProxy] Add the control of whether to retry and the count of retries for the failure message
INLONG-8284	[Improve][DataProxy] Unify the message encoding definition of DataProxy
INLONG-8294	[Improve][DataProxy] Optimize the log output in the Sink module
INLONG-8305	[Improve][DataProxy] Optimize HttpPost object creation
INLONG-8311	[Improve][DataProxy] Add event handling support for FlumeEvent type
INLONG-8318	[Improve][DataProxy] Change notification synchronization through condition variables and locks
INLONG-8323	[Improve][DataProxy] Add Topic detailed information output when Producer is null
INLONG-8332	[Improve][DataProxy] Return original content for MSG_ORIGINAL_RETURN type messages
INLONG-8339	[Improve][DataProxy][Agent] Enable audit by default in DataProxy and Agent
INLONG-8356	[Improve][DataProxy] Replace source2 to source
INLONG-8368	[Bug][DataProxy] Sink does not have audit data
INLONG-8385	[Improve][DataProxy] Add take method in BufferQueue class
INLONG-8459	[Improve][DataProxy] Fix code scanning alert - Implicit narrowing conversion in compound assignment

TubeMQ

ISSUE	Summary
INLONG-4968	[Feature][TubeMQ] Golang SDK for Producing Message
INLONG-8122	[Feature][TubeMQ] Add "Heartbeat" method for GO SDK
INLONG-8165	[Feature][TubeMQ] Add "SendMessage" method for GO SDK
INLONG-8286	[Improve][TubeMQ] Supports the return package type when querying messages
INLONG-8321	[Improve][TubeMQ] Improve the precision of tube consumer id

Manager

ISSUE	Summary
INLONG-7914	[Feature][Manager] Support multi-tenancy
INLONG-8024	[Improve][Manager] Add extended properties when getting the status of the sort task info
INLONG-8035	[Bug][Manager] Non-file tasks cannot be recovered from the heartbeat timeout state
INLONG-8039	[Improve][Manager] Optimize the transform interface
INLONG-8047	[Improve][Dashboard][Manager][Sort] Rename lightweight to DataSync
INLONG-8066	[Improve][Manager] Add sort extended properties when getting the status info of the InlongGroup
INLONG-8068	[Feature][Manager] Support repeatable read for http request
INLONG-8072	[Bug][Manager] NPE when sort_task_name of stream_sink table is empty or null
INLONG-8080	[Bug][Manager] The total parameter found on the page is different from the actual value
INLONG-8087	[Feature][Manager] Add definition of Inlong t...

1.7.0

Release Notes

Agent

ISSUE	Summary
INLONG-7847	[Bug][Agent] Failed to create MySQL reader
INLONG-7783	[Feature][Agent] Support sink data tor Kafka
INLONG-7752	[Bug][Agent] PulsarSink threadPool throw reject exception
INLONG-7976	[Bug][Agent] The data collected by the agent is incomplete
INLONG-8026	[Improve][Agent] Improve the Agent performance

DataProxy

ISSUE	Summary
INLONG-7931	[Improve][DataProxy] Optimize common.properties related control mechanism
INLONG-7898	[Improve][DataProxy] Clean up useless configuration files in the ConfigManager class
INLONG-7769	[Bug][DataProxy] NPE when request Inlong Manager failed
INLONG-7512	[Improve][DataProxy] Update the metrics log level to avoid the log file increasing quickly
INLONG-7766	[Bug][DataProxySDK] Adjusted frame length exceeds occurred when reporting data through the HTTP protocol
INLONG-7194	[Improve][DataProxy] Migrate index log statistics for the new mq layer

TubeMQ

ISSUE	Summary
INLONG-7926	[Feature][TubeMQ] Add ""Register2Master"" method for GO SDK "

Manager

ISSUE	Summary
INLONG-8021	[Improve][Manager] Periodically delete sources with inconsistent states
INLONG-8006	[Improve][Manager] Set displayname for the auto-registered cluster
INLONG-7999	[Improve][Manager] Support PostgreSQL data node
INLONG-7996	[Improve][Manager] Support issued kafka consumer group to sort
INLONG-7987	[Improve][Manager] Add a heartbeat timeout status to the source
INLONG-7981	[Bug][Manager] Failed to stop source correctly when suspend a group
INLONG-7948	[Improve][Manager] Add user authentication when operate inlong consume
INLONG-7946	[Improve][Manager] Add user authentication when bind clusterTag
INLONG-7941	[Improve][Manager][Dashborad] Query group to distinguish lightweight
INLONG-7940	[Bug][Manager][Sort] Use Pulsar subscriptions in Pulsar connector
INLONG-7938	[Bug][Manager] The consume list interface does not filter by request
INLONG-7936	[Improve][Manager] Support issued pulsar subscriptions to sort
INLONG-7934	[Improve][Manager] Optimize the serializationType to support debezium json
INLONG-7912	[Improve][Manager] Only response DataProxy nodes in normal status
INLONG-7895	[Feature][Manager] Support field description when parsing field by SQL
INLONG-7893	[Feature][Manager] Support field description when parsing field by JSON
INLONG-7890	[Improve][Manager] Add checks for unmodifiable data_node_name and cluster_name
INLONG-7888	[Bug][Manager] Failed to create lightweight task
INLONG-7883	[Improve][Manager] Invalidate user session when deleting user
INLONG-7867	[Feature][Manager] Support data validation when importing Excel file
INLONG-7844	[Improve][Manager] Support to set cluster when create table for clickhouse
INLONG-7843	[Feature][Manager] Creating the schema of StreamSource by importing an Excel file
INLONG-7841	[Feature][Manager] Support title style and font when exporting Excel file
INLONG-7839	[Improve][Manager] Bump version of apache-poi:poi to 5.2.3
INLONG-7837	[Bug][Manager] The Admin user cannot modify streamSource when it is not the responsible person
INLONG-7835	[Improve][Manager] The permission is removed when a user is deleted
INLONG-7823	[Improve][Manager] Supports creating clickhouse tables using the ReplicatedMergeTree engine
INLONG-7820	[Feature][Manager] Support style and font when exporting Excel file
INLONG-7816	[Feature][Manager] Support validation rules when exporting Excel file
INLONG-7810	[Bug][Manager] No token field in the return result of getAllConfig
INLONG-7804	[Improve][Manager] Limit the length of user password
INLONG-7800	[Bug][Manager] Update redis data node failed
INLONG-7798	[Improve][Manager] Add user authentication when operate workflow
INLONG-7792	[Feature][Manager] Support export Excel template file of StreamSource
INLONG-7778	[Feature][Manager] Optimize the create command for ease of use
INLONG-7774	[Improve][Manager] Add permission verification for streamSource
INLONG-7760	[Bug][Manager] Parse fields failed for streamSink and InlongStream
INLONG-7730	[Feature][Manager] Support node management for Redis
INLONG-7722	[Bug][Manager] The task status is inconsistent with the returned resu...

1.6.0

• Release InLong 1.6.0 - Released (as of 2023-03-16)

• Please refer to the change log for the complete list of changes:
  https://github.com/apache/inlong/blob/release-1.6.0/CHANGES.md

1.5.0

• Release InLong 1.5.0 - Released (as of 2023-01-14)

• Please refer to the change log for the complete list of changes:

https://github.com/apache/inlong/blob/release-1.5.0/CHANGES.md