Skip to content

Latest commit

 

History

History
36 lines (24 loc) · 2.57 KB

README.md

File metadata and controls

36 lines (24 loc) · 2.57 KB

Install Kafka & schedule brokers

Step 1: In the DC/OS dashboard navigate to 'Universe - Packages'. The 'Universe' is where you can manage what packages (aka mesos frameworks) your cluster can make use of.


Step 2: Scroll down in the 'Universe' package listings to find the 'kafka' package and click it's corresponding 'INSTALL PACKAGE' button.


Step 3: Click the 'Advanced Installation' button to start the package installation process with the ability to override the default configuration. The first section to review is the kafka 'service' configuration. Leave the defaults on this section.


Step 4: Click the 'brokers' to fine tune the broker installation parameters.


Step 5: Scroll down through the 'brokers' installation parameters. Find the 'count' parameter and change the value to the number of brokers you desire, for the purpose of the demo we will keep the default of '3'.


Step 6: Click 'kafka' and check the option to 'DELETE.TOPIC.ENABLE' so that we can clean up our data between demonstration runs.


Step 7: Click the 'REVIEW AND INSTALL' button and review the parameters values.


Step 8: Click the 'INSTALL' button to install the kafka package.


Step 9: In the DC/OS dashboard navigate to 'Services - Services'. The 'Services' tab is where you can monitor what services have been scheduled and are running on the DC/OS cluster. Notice there is a Service named 'kafka' that now appears.


Step 10: Click on 'kafka' in the service listing to open up more information on the 'kafka' service. Here we can see the three brokers, their names, their status, and the resources that have been allocated to them.


Step 11: Taking a quick glimpse at the Mesos dashboard we can see the 'Active Tasks' that are running to support our Kafka brokers. Note: you can launch into the log files, etc... of any of the brokers from this dashboard.



Congratulations: You now have Kafka installed with three brokers ready to receive data on the DC/OS cluster. Next, we will walk through how to Install Elasticsearch & schedule a cluster.