Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Changed loadIndexedBam to use hadoop-bam InputFormat #1036

Merged
merged 1 commit into from
Jun 17, 2016

Conversation

fnothaft
Copy link
Member

A bit of cleanup on top of @andrewmchen's work in #953.

@AmplabJenkins
Copy link

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/ADAM-prb/1241/
Test PASSed.

@@ -41,4 +42,19 @@ trait Interval {
*/
def width: Long = end - start

/**
* Need to implement getStart function from Locatable. (1-based start position. closed)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Mixing 0- and 1- based coordinate systems in the same class gives me the hives. Can we hide this as an implementation detail in an adapter somewhere in the i/o code?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think we can hide it, but we could mark it as @deprecated to hint that it is only for use with legacy codebases?

Copy link
Member

@heuermh heuermh May 21, 2016

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I guess I don't see where it is used, so I'm not sure what suggestion to make. Will have to dig a bit.

And is this the Interval that will need to go into bdg-utils to support IntervalRDD? Then there's no way I want to mix htsjdk stuff in.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, this allows us to supply ReferenceRegions to the Hadoop-BAM indexed input format code without going through an intermediate class.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actually, think I may have misread.

And is this the Interval that will need to go into bdg-utils to support IntervalRDD? Then there's no way I want to mix htsjdk stuff in.

@akmorrow13 @erictu, can you all comment?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actually, I get what you're saying now, @heuermh. I will refactor this out.

@fnothaft
Copy link
Member Author

fnothaft commented Jun 6, 2016

Rebased and addressed comments. Ping @heuermh @erictu for review.

@AmplabJenkins
Copy link

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/ADAM-prb/1261/
Test PASSed.

}
}

}
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

oh how I like to see code being removed :)

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Indeed; it is uniquely satisfying!

@heuermh
Copy link
Member

heuermh commented Jun 7, 2016

LGTM

@erictu
Copy link
Member

erictu commented Jun 8, 2016

+1

@fnothaft
Copy link
Member Author

Rebased and ready to merge!

@heuermh heuermh merged commit 30c15fb into bigdatagenomics:master Jun 17, 2016
@heuermh
Copy link
Member

heuermh commented Jun 17, 2016

Oops, didn't let Jenkins have a final say before merging. Builds & tests ok for me locally.

Thank you, @fnothaft @andrewmchen!

@AmplabJenkins
Copy link

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/ADAM-prb/1280/

Build result: FAILURE

[...truncated 24 lines...]Triggering ADAM-prb ? 2.6.0,2.10,1.6.1,centosTriggering ADAM-prb ? 2.3.0,2.10,1.6.1,centosTriggering ADAM-prb ? 2.3.0,2.10,1.5.2,centosTriggering ADAM-prb ? 2.6.0,2.10,1.4.1,centosTriggering ADAM-prb ? 2.3.0,2.11,1.5.2,centosTriggering ADAM-prb ? 2.6.0,2.11,1.4.1,centosTriggering ADAM-prb ? 2.3.0,2.11,1.6.1,centosTriggering ADAM-prb ? 2.3.0,2.11,1.4.1,centosTriggering ADAM-prb ? 2.3.0,2.10,1.4.1,centosADAM-prb ? 2.6.0,2.11,1.6.1,centos completed with result FAILUREADAM-prb ? 2.6.0,2.11,1.3.1,centos completed with result FAILUREADAM-prb ? 2.3.0,2.10,1.3.1,centos completed with result FAILUREADAM-prb ? 2.6.0,2.10,1.3.1,centos completed with result FAILUREADAM-prb ? 2.3.0,2.11,1.3.1,centos completed with result FAILUREADAM-prb ? 2.6.0,2.10,1.6.1,centos completed with result FAILUREADAM-prb ? 2.3.0,2.10,1.6.1,centos completed with result FAILUREADAM-prb ? 2.3.0,2.10,1.5.2,centos completed with result FAILUREADAM-prb ? 2.6.0,2.10,1.4.1,centos completed with result FAILUREADAM-prb ? 2.3.0,2.11,1.5.2,centos completed with result FAILUREADAM-prb ? 2.6.0,2.11,1.4.1,centos completed with result FAILUREADAM-prb ? 2.3.0,2.11,1.6.1,centos completed with result FAILUREADAM-prb ? 2.3.0,2.11,1.4.1,centos completed with result FAILUREADAM-prb ? 2.3.0,2.10,1.4.1,centos completed with result FAILURENotifying endpoint 'HTTP:https://webhooks.gitter.im/e/ac8bb6e9f53357bc8aa8'
Test FAILed.

@fnothaft
Copy link
Member Author

Looks like the @AmplabJenkins failures were just the git failed to determine issue. We should be a-OK but I'll follow up if the ToT build fails.

@fnothaft fnothaft deleted the loadIndexedBam-hadoop-bam branch June 17, 2016 16:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants