Skip to content

Commit

Permalink
update for 0.10.0-ALPHA for adding cache settings to each statement, …
Browse files Browse the repository at this point in the history
…and related docs.

release 0.10.0-ALPHA
  • Loading branch information
apatrida committed May 18, 2017
1 parent 14b9c1b commit dc7ab25
Showing 1 changed file with 5 additions and 1 deletion.
6 changes: 5 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -482,7 +482,7 @@ as usage of off-heap space can be defined as mentioned above in the Spark Config

Prior to version 0.10.0-ALPHA all queries were cached into memory which could cause an overflow. Now by default they
are not cached. For each statement (preperatory or import statements) you can specify these properties to control caching,
otherwise no cache is performed.
otherwise no caching is performed.

```
"cache": true,
Expand All @@ -492,6 +492,10 @@ otherwise no cache is performed.
Where the persist setting is one of the storage levels defined [in the RDD persistence guide](https://spark.apache.org/docs/latest/programming-guide.html#rdd-persistence), and
the default is `MEMORY_ONLY` which might overflow memory if not enough JVM or off-heap space is permitted.

Note that caching helps with preparatory steps that are then used later, or to speed up the two step process
of running the main import queries followed by counting the number of rows that the query caused to be imported. But
it is not required.


### NUMBER and DECIMAL Types Being Disallowed

Expand Down

0 comments on commit dc7ab25

Please sign in to comment.