Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Build the partitionConsumer into the topicConsumer #442

Merged
merged 1 commit into from
May 1, 2015
Merged

Conversation

eapache
Copy link
Contributor

@eapache eapache commented May 1, 2015

@Shopify/kafka this is what I meant by merging them. Adding a flag to the topicConsumer makes the partitionConsumer obsolete.

return nil, err
}
pList = append(pList, int32(val))
}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we check whether the partition is the c.Partitions(*topic) list, or just let it fail later?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It fails later pretty nicely with ERROR: Failed to start consumer for partition -1: kafka server: Request was for a topic or partition that does not exist on this broker.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 that should be enough :)

@wvanbergen
Copy link
Contributor

Maybe just call it kafka-console-consumer now?

@eapache
Copy link
Contributor Author

eapache commented May 1, 2015

Oh, does this whole thing break semantic versioning? Does this need to be a 2.0 change?

@wvanbergen
Copy link
Contributor

I don't feel it's needed, but maybe we should state this in the tools/README?

@eapache
Copy link
Contributor Author

eapache commented May 1, 2015

Added a note to tools/README that they are not guaranteed to version like the main library

@eapache
Copy link
Contributor Author

eapache commented May 1, 2015

The alternative would just be to not remove partitionConsumer, since topicConsumer hadn't been released yet

@wvanbergen
Copy link
Contributor

Like I said, I don't feel too strongly about maintaining backwards compatibility for the tools, but if you do that works for me 👍

Add a flag to support arbitrary partitions. Deprecate (but do not remove, yet)
partitionConsumer tool.
@eapache
Copy link
Contributor Author

eapache commented May 1, 2015

I'm not 100% sure I want to commit to API stability for the tools for eternity, but in this case it's easy enough. I'll add "remove partitionConsumer" to our 2.0 wiki page.

@eapache
Copy link
Contributor Author

eapache commented May 1, 2015

Last 👀? I had to do some git dancing to rebase while undeleting the partitionConsumer.

- [kafka-console-partitionconsumer](./kafka-console-partitionconsumer): a command line tool to consume a single partition of a topic on your Kafka cluster.
- [kafka-console-topicconsumer](./kafka-console-topicconsumer): a command line tool to consume all partition of a topic on your Kafka cluster.
- [kafka-console-partitionconsumer](./kafka-console-partitionconsumer): (deprecated) a command line tool to consume a single partition of a topic on your Kafka cluster.
- [kafka-console-consumer](./kafka-console-consumer): a command line tool to consume arbitrary partitions of a topic on your Kafka cluster.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"all or an arbitrary list of"?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"all of them" still qualifies as an arbitrary list :)

@wvanbergen
Copy link
Contributor

minor wording quibble - :shipit:

eapache added a commit that referenced this pull request May 1, 2015
Build the partitionConsumer into the topicConsumer
@eapache eapache merged commit d8af58a into master May 1, 2015
@eapache eapache deleted the consumer-tools branch May 1, 2015 15:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants