forked from fluent/fluentd
-
Notifications
You must be signed in to change notification settings - Fork 0
/
ChangeLog
427 lines (274 loc) · 12.5 KB
/
ChangeLog
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
Release 0.10.29 - 2012/11/26
* buf_file: added flush_at_shutdown option to force flush before shuttingdown
* TextParser shows message in warn level if text doesn't match the pattern
Release 0.10.28 - 2012/10/30
* in_http: on_request method can get headers as HTTP_* key and remote address
as REMOTE_ADDR key of the params argument
Release 0.10.27 - 2012/10/11
* added BufferChunk#unique_id which is an unique identifier of a buffered chunk
* BufferedOutput: show 'temporarily failed' message
Release 0.10.26 - 2012/09/26
* added in_debug_agent plugin and fluent-debug command which enable you to
gather internal information of running Fluentd process using interactive shell
* supervisor: --user commandline argument also inherits secondary groups (id -G)
* out_forward: supports 'expire_dns_cache' option to set DNS expire time or disable
caching. Default behavior is 'never expire' which is same as former versions
* out_forward: assumes successful data transfer via TCP as a successful
heartbeat.
* out_forward: lazier failure detection: default phi_threshold 8 -> 10
* in_forward: uses other nodes aggressively if it couldn't send data to the first
candidate to not stall during the wait time before detecting failure
* in_forward: fixed shutdown procedure
* in_tail: seeks to the saved position if detected log rotation actually
didn't rotate the file (meaning inode doesn't change). this change enables
cronolog to work with Fluentd.
* in_tail: fixed a problem that it couldn't recover from uncaught exceptions
caused by output plugins
* fluentd command supports '-q' option to decrease log level
Release 0.10.25 - 2012/07/23
* shutdown won't block
* out_exec_filter supports 'child_respawn' option
* in_tail doesn't remove whitespaces
* out_roundrobin supports 'weight' option
Release 0.10.24 - 2012/06/28
* TextParser/in_tail: supports 'tsv' and 'csv' preset formats
* supervisor set FD_CLOEXEC to @wait_daemonize_pipe_w in case the child
process forked during run_configure
Release 0.10.23 - 2012/06/25
* out_exec_filter: show more error messages when child process unexpectedly exited
* in_tail: Added 'apache2' format template which converts fields into integers or nil
* TextParser creates a parser instance for each output for proper configuration
* BufferedOutput: reset @flush_now flag
* changed default buffer limit parameters:
Fluentd core:
buffer_chunk_limit 256MB -> 8MB
buffer_queue_limit 128 -> 256
buf_memory:
buffer_chunk_limit 32MB -> 8MB
buffer_queue_limit 32 -> 64
out_file:
buffer_chunk_limit -> 256MB
Release 0.10.22 - 2012/05/02
* Fixed in_tail and TextParser not to raise "time_format is required" error
* out_exec_filter: fixed JSONFormatter to add \n at the end of records
* out_exec_filter: separated {tag_key,time_key,time_format} parameters to
{in_,out_}{tag_key,time_key,time_format parameters while keeping
compatibility
Release 0.10.21 - 2012/05/01
* in_tail and TextParser support 'format json'
* in_tail and TextParser support 'time_key' and 'time_format' parameters for 'format json'
* in_tail: improved the file reader not to consume too much memory if the file is huge
* out_stdout: uses logger instead of STDOUT to show records even if Fluentd is daemonized
* Fixed the type of 'retry_wait' parameter of buffered output plugins from 'float' to 'time'
* Fixed owner of log files for log rotation to work properly with --user and --group options
Release 0.10.20 - 2012/04/27
* Fixed Config#to_s
* out_exec_filter: supports 'out_format json' option
* out_exec_filter: supports 'in_format json' option
Release 0.10.19 - 2012/04/17
* Fixed in_syslog
* in_tail: fixed "invalid byte sequence in US-ASCII" error
* in_unix is not obsoleted
Release 0.10.18 - 2012/04/13
* Use Yajl instead of standard json library to avoid encoding problem
* buf_memory: call force_encoding('ASCII-8BIT') to avoid encoding problem
Release 0.10.17 - 2012/04/02
* in_tail: don't ignore last line without LF [#44]
* Added HandleTagNameMixin
* Removed automake/conf style build support
Maintainig automake/conf style files are complex, but no user. We've decided
not to have those files anymore. Otherwise it's still used at rpm/deb packaging
scripts.
Release 0.10.16 - 2012/03/26
* Added in_gc plugin
* Added in_object_space plugin
* Changed dependency yajl-ruby from '~> 1.0.0' to '~> 1.0'
Release 0.10.15 - 2012/03/09
* Added experimental in_status plugin
* out_forward: normalize the phi value of the failure detector into 1sec
* out_forward: improved memory efficiency
* out_forward: use weighted moving average for the phi accrual failure detector
Release 0.10.14 - 2012/03/05
* Show warnings if in_tcp or out_unix is used
* BasicBuffer shows warnings when data.bytesize > @buffer_chunk_limit
* out_forward: randomize roundrobin queue correctly
* Added development dependencies to the gemspec
Release 0.10.13 - 2012/02/21
* Rewrote in_tail
* Fixed SIGUSR1 handler to force flush logs
Release 0.10.12 - 2012/02/13
* Engine shows warnings when emitted record doesn't match any outputs
* in_tail is rewritten to follow symbolic links correctly
* out_forward uses independent default value as 'hard_timeout' parameter
Release 0.10.11 - 2012/02/10
* out_forward supports 'standby' parameter
* out_forward handles 'hard_timeout' correctly
Release 0.10.10 - 2012/02/09
* in_forward and out_forward don't raise exceptions in callback handlers of
cool.io not to stop Loop#run
* TimeSlicedOutput ignores time_slice_wait if flush_interval is specified
* in_tail follows symbolic links correctly
* in_http supports "Content-Type: application/json"
* TestDriver#run sleeps 0.5 seconds for the out_exec_filter plugin
Release 0.10.9 - 2012/01/19
* Fixed TimeSlicedOutputTestDriver
* Updated cool.io 1.0.0 -> 1.1.0
* TextParser: fixed regexp of syslog parser to work with rsyslog on CentOS
* out_exec_filter: improve performance by using buffering
* out_exec_filter: added num_children parameter
* out_exec_filter: added remove_prefix/add_prefix parameters
* out_tail: show warning if pos_file parameter is not set
* out_copy: fixed problems when event stream is not repeatable
Release 0.10.8 - 2011/12/03
* Added Supervisor: restart process on SIGHUP or unexpected end of process
* Added -i commandline option which allows inline config
* Added TimeSlicedOutputTestDriver
* BufferedOutput outputs 'retry succeeded' message
* Use Gem::Specification instead of Gem.searcher which is obsoleted
* Added BasicBuffer#chunk_limit -> buffer_chunk_limit alias for backward
compatibility
* buf_file: fixed to work with keys which contains '/'
Release 0.10.7 - 2011/11/16
* Supports multi-threaded on buffered output plugins ('num_threads')
* Supports multi-process on input plugins ('detach_process')
* Added ObjectBufferedOutput
* Ensure to call 'shutdown' method of started plugins
* in_tail supports 'pos_file' option that stores read position to a file
Release 0.10.6 - 2011/11/11
* Fixed --group NAME cmdline argument
* Run configure(conf) after changing user and group
* Fixed SIGHUP handling
* BasicBuffer plugin uses Configurable module
* buf_file uses microseconds + 12 bits random number for unique file name
Release 0.10.5 - 2011/11/08
* Added out_forward, in_forward
* Added out_exec, in_exec
* Added out_exec_filter
Release 0.10.4 - 2011/11/07
* TestDriver uses klass.dup.module_eval instead of inheriting class to
override methods
* fixed encoding problem of String#[] in FileBufferChunk#<<(data)
Release 0.10.3 - 2011/10/21
* Supports 'include' in config file
* Supports "http://" schema
* Supports wildcards
Release 0.10.2 - 2011/10/18
* Fixed EventStream#to_msgpack_stream (thanks CkReal)
* Added gemspec.required_ruby_version = '~> 1.9.2' (thanks sakuro)
Release 0.10.1 - 2011/10/16
* SetTimeKeyMixin accepts include_time_key parameter
* SetTagKeyMixin accepts include_tag_key parameter
* Fixed Makefile.am
* Fixed MemoryBufferChunk#msgpack_each
Release 0.10.0 - 2011/10/16
* Removed Event class
* def format(tag, event) -> format(time, tag, record)
* def emit(tag, event) -> emit(tag, time, record)
* Added plugin APIs
* Added Configurable
* Added TimeFormatter
* Added SetTimeKeyMixin
* Added SetTagKeyMixin
* Added InputTestDriver
* Added Gemfile, gemspec and .rvmrc files
Release 0.9.20 - 2011/10/07
* Config#has_key? sets used flag not to show warning
* in_tcp supports JSON
* Depends on Yajl
* Fixed fluentd -r option
* Fixed autogen.sh to create plugins directory
Release 0.9.19 - 2011/10/07
* Secondary outputs work only when error count exceededs retry_limit
* Secondary outputs retry upto secondary_limit
* Added Output#secondary_init
* Added unit test driver for output plugins
* Added Fluent::Test.test? method
* Added comparision methods (<=>, ==, eql? and hash) to Event class
* Added test cases for out_copy, out_roundrobin and out_file
Release 0.9.18 - 2011/10/04
* Performance improvements
* in_tcp uses lazy deserialization
* Engine caches results of Match#match
* out_file caches results of strftime
* Fixed TextParser.register_template
Release 0.9.17 - 2011/10/03
* TimeSlicedOutput caches results of strftime() for performance
* Fixed TextParser.register_template (thanks eiichiroi)
* Fixed fluent-cat --port argument to work
Release 0.9.16 - 2011/10/01
* Fixed it can't use relative path for --plugin command line argument
* Fixed out_copy to work with non-repeatable event streams
Release 0.9.15 - 2011/09/21
* Set default encoding to ASCII-8BIT
* Fixed thread issues in BasicBuffer
* Performance improvements
Release 0.9.14 - 2011/09/21
* Fixed to write unexpected error to log files
* Plugin loader uses GemSpec if it is available to load newer plugin
* Added Config.bool_value method for plugins
Release 0.9.13 - 2011/09/21
* Updated out_file plugin
* Uses localtime by default
* Uses \t to separate time, tag and JSON.
* Uses ISO-8601 for the time format
Release 0.9.12 - 2011/09/20
* Updated out_file plugin
* Supports log compression
* Slices log files every day by default
Release 0.9.11 - 2011/09/19
* Added out_null plugin
* Added out_roundrobin plugin
* in_http supports keep-alive
* in_tcp and in_unix detect network failure
Release 0.9.10 - 2011/09/07
* Periodic timer enqueues buffer chunks only when queue is empty
Release 0.9.9 - 2011/09/06
* in_tail strips \n at the end of log line
* Uses newer one if multiple plugins are found
Release 0.9.8 - 2011/08/16
* in_http plugin supports 'Expect: 100-continue' header
* Added --user and --group command line arguments to change privilege
* Changed default retry_limit parameter from 8 to 17
* Changed default buffer_chunk_limit parameter from 1m to 16m
* Changed default buffer_queue_limit parameter from 100 to 64
Release 0.9.7 - 2011/08/06
* Load plugins named fluent_plugin.rb installed by RubyGems
* Load plugins located on fluent/plugin/{buf,in,out}_{type} installed by RubyGems
* Removed out_tdlog plugin to fluent-plugin-td gem
Release 0.9.6 - 2011/08/06
* Force flush buffered events on SIGUSR1
* out_tdlog uses event tag for the database and table name
* Fluent can log Fluent logs
* Colorize Fluent logs on console
* Changed default unix domain socket path to /var/run/fluent/fluent.sock
* Makefile.am and configure.in aware fakeroot
Release 0.9.5 - 2011/07/23
* Added <secondary> tag that fallbacks to secondary output when it can't
write to primary output.
* <match> pattern supports **; matches any fragments recursively.
* <match> pattern supports {x,y,...}; matches any of the inner patterns.
Release 0.9.4 - 2011/07/22
* Switched EventMachine to Cool.io
* in_tail continues to follow file if it is deleted on Linux
* Added fluentd --setup option that installs sample configuration file
* Added out_tdlog plugin
Release 0.9.3 - 2011/07/05
* Disable EventMachine.epoll because it doesn't work correctly on
Ruby 1.9 with threads
* in_tcp and in_unix uses EventMachine instead of threads
* Set BasicSocket.do_not_reverse_lookup = true
Release 0.9.2 - 2011/07/03
* Added TimeSlicedOutput that splits buffer chunk exactly based on the time
* Changed structure of buffers from queue to map + queue
* Show waring if configuration parameters are not used
* Added out_time_file plugin
Release 0.9.1 - 2011/06/26
* Added in_tail plugin
* Added in_syslog plugin
* Added out_stdout plugin
* Added out_tcp plugin
* Added out_unix plugin
* Improved performance of in_http plugin by replacing WEBrick + thread
with EventMachine
Release 0.9.0 - 2011/06/20
* First release