Terraform module for creating Kinesis Applications

Creates:

• A kinesis stream
• An S3 bucket for backing up events
• A kinesis firehose to S3 for backing up every record
• A lambda to copy from the stream to the firehose
• Cloudwatch error logging for the firehose
• All applicable IAM roles and policies, including a read-only role for KCL applications
• (Optionally) an APIKey secured API gateway for posting to the stream from outside AWS (e.g. GAE)

Supports:

• backup to an s3 bucket via lambda -> firehose
• optional API Gateway endpoints for writing to the stream

Example usage

terraform.tf

variable aws_access_key {
  type = "string"
}

variable aws_secret_key {
  type = "string"
}

variable aws_region {
  type    = "string"
  default = "us-east-1"
}

aws.tf

provider "aws" {
  access_key = "${var.aws_access_key}"
  secret_key = "${var.aws_secret_key}"
  region     = "${var.aws_region}"
}

main.tf

module "kinesis_tf" {
  source = "github.com/udacity/kinesis_tf"

  stream_name        = "example1"
  retention_period   = "48"
  environment_name   = "production"
  application_name   = "RegistrarTermImporter"
  aws_region         = "${var.aws_region}"
  create_api_gateway = true
}

To get the module from github:

terraform get