-
Notifications
You must be signed in to change notification settings - Fork 45
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Signed-off-by: Simeon H.K. Fitch <fitch@astraea.io>
- Loading branch information
Showing
176 changed files
with
6,251 additions
and
1,278 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -24,3 +24,4 @@ metastore_db | |
.ensime* | ||
tour/jars | ||
tour/*.tiff | ||
scoverage-report* |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,74 +1,22 @@ | ||
<img src="src/main/paradox/_template/images/RasterFramesLogo.png" width="300px"/><sup style="vertical-align: top;">™</sup> | ||
<img src="docs/src/main/paradox/_template/images/RasterFramesLogo.png" width="300px"/><sup style="vertical-align: top;">™</sup> | ||
|
||
[ ![Download](https://api.bintray.com/packages/s22s/maven/raster-frames/images/download.svg) ](https://bintray.com/s22s/maven/raster-frames/_latestVersion) [![Build Status](https://travis-ci.org/s22s/raster-frames.svg?branch=develop)](https://travis-ci.org/s22s/raster-frames) [![codecov](https://codecov.io/gh/s22s/raster-frames/branch/develop/graph/badge.svg)](https://codecov.io/gh/s22s/raster-frames) | ||
[![Maven metadata URI](https://img.shields.io/maven-metadata/v/http/central.maven.org/maven2/io/astraea/raster-frames_2.11/maven-metadata.xml.svg)](http://search.maven.org/#search%7Cga%7C1%7Craster-frames) [![Build Status](https://travis-ci.org/s22s/raster-frames.svg?branch=develop)](https://travis-ci.org/s22s/raster-frames) [![codecov](https://codecov.io/gh/s22s/raster-frames/branch/develop/graph/badge.svg)](https://codecov.io/gh/s22s/raster-frames) | ||
[![Join the chat at https://gitter.im/s22s/raster-frames](https://badges.gitter.im/s22s/raster-frames.svg)](https://gitter.im/s22s/raster-frames?utm_source=badge&utm_medium=badge&utm_campaign=pr-badge&utm_content=badge) | ||
|
||
_RasterFrames™_ brings the power of Spark DataFrames to geospatial raster data, empowered by the map algebra and tile layer operations of [GeoTrellis](https://geotrellis.io/). | ||
|
||
<img src="src/main/tut/RasterFramePipelineOverview.png" width="600px"/> | ||
<img src="docs/src/main/tut/RasterFramePipeline.svg" width="600px"/> | ||
|
||
> **RasterFrames™ is a new project under active development**. Feedback and contributions are welcomed | ||
as we continue to improve it. | ||
|
||
## Getting Started | ||
|
||
## Quick Start | ||
|
||
### macOS | ||
|
||
1. If not already, install [Homebrew](https://brew.sh/) | ||
2. Run `brew install sbt` | ||
3. Run `sbt new s22s/raster-frames.g8` | ||
|
||
### Linux | ||
|
||
1. Install [sbt](http://www.scala-sbt.org/release/docs/Installing-sbt-on-Linux.html) | ||
2. Run `sbt new s22s/raster-frames.g8` | ||
|
||
### Windows | ||
|
||
1. Install [sbt](http://www.scala-sbt.org/release/docs/Installing-sbt-on-Windows.html) | ||
2. Run `sbt new s22s/raster-frames.g8` | ||
|
||
## General Setup | ||
|
||
*RasterFrames* is published via Bintray's JCenter server. In sbt you introduce it with this build setting: | ||
|
||
``` | ||
resolvers += Resolver.jcenterRepo | ||
``` | ||
|
||
(See [this](https://bintray.com/bintray/jcenter) for use of JCenter with other build tools.) | ||
|
||
To use RasterFrames, add the following library dependency: | ||
|
||
sbt: | ||
|
||
```scala | ||
libraryDependencies += "io.astraea" %% "raster-frames" % "x.y.z" | ||
``` | ||
|
||
Maven: | ||
|
||
```xml | ||
<dependency> | ||
<groupId>io.astraea</groupId> | ||
<artifactId>raster-frames</artifactId> | ||
<version>x.y.z</version> | ||
</dependency> | ||
``` | ||
|
||
Note: It assumes that SparkSQL 2.1.1 is available in the runtime classpath. | ||
Please see the [Getting Started](http://rasterframes.io/getting-started.html) section of the Users' Manual to start using RasterFrames. | ||
|
||
## Documentation | ||
|
||
* [Users' Manual](http://rasterframes.io/) | ||
* [API Documentation](http://rasterframes.io/latest/api/index.html) | ||
* [List of available UDFs](http://rasterframes.io/latest/api/index.html#astraea.spark.rasterframes.ColumnFunctions) | ||
|
||
|
||
## Copyright and License | ||
|
||
All code is available to you under the Apache 2.0 License, copyright Astraea, Inc. 2017. | ||
RasterFrames is released under the Apache 2.0 License, copyright Astraea, Inc. 2017. | ||
|
||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,33 @@ | ||
enablePlugins(BuildInfoPlugin) | ||
|
||
moduleName := "raster-frames" | ||
|
||
libraryDependencies ++= Seq( | ||
"com.chuusai" %% "shapeless" % "2.3.2", | ||
"org.locationtech.geomesa" %% "geomesa-z3" % "1.3.5", | ||
"org.locationtech.geomesa" %% "geomesa-spark-jts" % "2.0.0-astraea.1" exclude("jgridshift", "jgridshift"), | ||
spark("core").value % Provided, | ||
spark("mllib").value % Provided, | ||
spark("sql").value % Provided, | ||
geotrellis("spark").value, | ||
geotrellis("raster").value, | ||
geotrellis("spark-testkit").value % Test excludeAll ( | ||
ExclusionRule(organization = "org.scalastic"), | ||
ExclusionRule(organization = "org.scalatest") | ||
), | ||
scalaTest | ||
) | ||
|
||
buildInfoKeys ++= Seq[BuildInfoKey]( | ||
name, version, scalaVersion, sbtVersion, rfGeotrellisVersion, rfSparkVersion | ||
) | ||
|
||
buildInfoPackage := "astraea.spark.rasterframes" | ||
|
||
buildInfoObject := "RFBuildInfo" | ||
|
||
buildInfoOptions := Seq( | ||
BuildInfoOption.ToMap, | ||
BuildInfoOption.BuildTime | ||
) | ||
|
13 changes: 13 additions & 0 deletions
13
core/src/main/scala/astraea/spark/rasterframes/MetadataKeys.scala
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,13 @@ | ||
package astraea.spark.rasterframes | ||
|
||
/** | ||
* | ||
* @since 2/19/18 | ||
*/ | ||
trait MetadataKeys { | ||
/** Key under which ContextRDD metadata is stored. */ | ||
private[rasterframes] val CONTEXT_METADATA_KEY = "_context" | ||
|
||
/** Key under which RasterFrame role a column plays. */ | ||
private[rasterframes] val SPATIAL_ROLE_KEY = "_stRole" | ||
} |
Oops, something went wrong.