If logWarningForTaskAfterMillis is set, all data retrieval durations are logged as warnings

[ryangardner]

There is a configuration option to tell the KCL to log if a task takes longer than a certain number of milliseconds.

This presence of this same configuration option is used to enable some logging about how long it has been since data was received.

If you look at:

amazon-kinesis-client/amazon-kinesis-client/src/main/java/software/amazon/kinesis/lifecycle/ShardConsumer.java

Lines 296 to 305 in c1e38f0

	private void logNoDataRetrievedAfterTime() {
	logWarningForTaskAfterMillis.ifPresent(value -> {
	Instant lastDataArrival = subscriber.lastDataArrival;
	if (lastDataArrival != null) {
	Instant now = Instant.now();
	Duration timeSince = Duration.between(subscriber.lastDataArrival, now);
	log.warn("Last time data arrived: {} ({})", lastDataArrival, timeSince);
	}
	});
	}

The setting value is not used to determine if a message should be logged - it logs a warning _every_time data is received - even if the duration was only a fraction of a second.

It seems like there should be a threshold before logging the warning. That threshold seems like a separate concern form the long running task setting.

[pfifer]

That message should respect the configuration. We'll look into fixing the issue.

[sahilpalvia]

This issue has been fixed with the KCL release 2.0.2. Closing the issue, feel free to reopen the issue if problem persists.