[CdapIO] Design and implement Spark Receiver Builder

[damccorm]

Context:

CDAP plugins that support streaming sources include Receiver classes (ex. HubSpotReceiver) that extend org.apache.spark.streaming.receiver.Receiver abstract class. Receiver classes are used by plugin Streaming Utils classes (ex. HubSpotStreamingUtils) to provide getStream() method to Streaming Source classes (ex. HubSpotStreamingSource) and usually placed in cdap/plugin/\{<plugin name>}/plugin/source/streaming folder (ex. HubSpot plugin repo).

Reference information:

• Streaming plug-ins integration (Apache CDAP Connection Design Doc)

• Plugin integration process description (Apache CDAP Connection Design Doc)

• Streaming wrapper design (Apache CDAP Connection Design Doc)

Task Description:

Required to design custom Spark receivers builder class so that the custom receivers can be used in Apache Beam connector via SparkReceiverIO interface (used in CDAP IO as a dependency).

Acceptance criteria:

Design of builder class(es) that will create custom Spark receivers in Apache Beam connectors ({}SparkReceiverIO{}).

Note:

It is necessary that this builder class be independent of CDAP receivers and can be used by any other custom Spark receiver like a part of SparkReceiverIO.

Imported from Jira BEAM-14101. Original Jira may contain additional context.
Reported by: elizaveta.lomteva.

[damccorm]

Unable to assign user @Lizzfox. If able, self-assign, otherwise tag @damccorm so that he can assign you. Because of GitHub's spam prevention system, your activity is required to enable assignment in this repo.

[elizaveta-lomteva]

@damccorm please assign this task to me and @Amar3tto. I can't edit it
Thanks

[damccorm]

I assigned you, @Amar3tto will need to interact with an issue before I can assign them (commenting here is fine)

[Amar3tto]

@damccorm Please assign to me.
Thank you!