Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

what different between storm and storm-yarn? #61

Open
justlooks opened this issue Dec 29, 2013 · 3 comments
Open

what different between storm and storm-yarn? #61

justlooks opened this issue Dec 29, 2013 · 3 comments

Comments

@justlooks
Copy link

i use CDH4 yarn framework, i want build storm cluster on yarn framework,is storm can?
or is storm-yarn can? or both can?

@anfeng
Copy link
Contributor

anfeng commented Dec 29, 2013

You will need to use storm-yarn.

Andy Feng

Sent from my iPhone

On Dec 28, 2013, at 7:04 PM, justlooks notifications@github.com wrote:

i use CDH4 yarn framework, i want build storm cluster on yarn framework,is storm can?
or is storm-yarn can? or both can?


Reply to this email directly or view it on GitHub.

@justlooks
Copy link
Author

i have CDH4.4 CLUSTER for benchmark ,and CDH4.3 for develop,but CDH4.4 has
different API, it can not deploy storm-yarn on CDH4.4, CDH4.3 envionment
use JDK 6 ,can storm-yarn support JDK 6?

On Sun, Dec 29, 2013 at 11:09 AM, anfeng notifications@github.com wrote:

You will need to use storm-yarn.

Andy Feng

Sent from my iPhone

On Dec 28, 2013, at 7:04 PM, justlooks notifications@github.com
wrote:

i use CDH4 yarn framework, i want build storm cluster on yarn
framework,is storm can?
or is storm-yarn can? or both can?


Reply to this email directly or view it on GitHub.


Reply to this email directly or view it on GitHubhttps://github.com//issues/61#issuecomment-31310034
.

@revans2
Copy link
Collaborator

revans2 commented Dec 30, 2013

The YARN APIs changed a lot after 4.3. Storm YARN does not compile or run on CDH 4.4, 4.5, or 4.6. It does at least compile on CDH5.0.0 snapshot With a small patch to the master branch. It should work, and has been tested on hadoop 2.1 based builds. Also the master branch will run/compile with just JDK1.6 Thanks to the work of clockfly.

diff --git a/pom.xml b/pom.xml
index 0992424..6d01010 100644
--- a/pom.xml
+++ b/pom.xml
@@ -52,6 +52,10 @@
hortonworks
http://repo.hortonworks.com/content/repositories/releases/

  •    <repository>
    
  •        <id>cloudera</id>
    
  •        <url>https://repository.cloudera.com/artifactory/cloudera-repos/</url>
    
  •    </repository>
    
     <!-- Special: following this instruction alternative 3
     http://slf4j.org/faq.html#excludingJCL -->
    

    @@ -63,7 +67,8 @@


    <storm.version>0.9.0-wip21</storm.version>

  •    <hadoop.version>2.1.0-beta</hadoop.version>
    
  •    <!--<hadoop.version>2.1.0-beta</hadoop.version>-->
    
  •    <hadoop.version>2.2.0-cdh5.0.0-SNAPSHOT</hadoop.version>
     <!--hadoop.version>2.1.0.2.0.5.0-67</hadoop.version-->
    

—Bobby

From: justlooks <notifications@github.commailto:notifications@github.com>
Reply-To: yahoo/storm-yarn <reply@reply.github.commailto:reply@reply.github.com>
Date: Saturday, December 28, 2013 at 9:49 PM
To: yahoo/storm-yarn <storm-yarn@noreply.github.commailto:storm-yarn@noreply.github.com>
Subject: Re: [storm-yarn] what different between storm and storm-yarn? (#61)

i have CDH4.4 CLUSTER for benchmark ,and CDH4.3 for develop,but CDH4.4 has
different API, it can not deploy storm-yarn on CDH4.4, CDH4.3 envionment
use JDK 6 ,can storm-yarn support JDK 6?

On Sun, Dec 29, 2013 at 11:09 AM, anfeng <notifications@github.commailto:notifications@github.com> wrote:

You will need to use storm-yarn.

Andy Feng

Sent from my iPhone

On Dec 28, 2013, at 7:04 PM, justlooks <notifications@github.commailto:notifications@github.com>
wrote:

i use CDH4 yarn framework, i want build storm cluster on yarn
framework,is storm can?
or is storm-yarn can? or both can?


Reply to this email directly or view it on GitHub.


Reply to this email directly or view it on GitHubhttps://github.com//issues/61#issuecomment-31310034
.


Reply to this email directly or view it on GitHubhttps://github.com//issues/61#issuecomment-31310813.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants