[SPARK-3235][SQL] Ensure in-memory tables don't always broadcast.

[marmbrus]

No description provided.

[SparkQA]

QA tests have started for PR 2147 at commit 18ce029.

• This patch merges cleanly.

[aarondav]

LGTM, will merge pending tests.

[SparkQA]

QA tests have started for PR 2147 at commit 8da4414.

• This patch merges cleanly.

[SparkQA]

QA tests have finished for PR 2147 at commit 8da4414.

• This patch fails unit tests.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

QA tests have finished for PR 2147 at commit 18ce029.

• This patch passes unit tests.
• This patch merges cleanly.
• This patch adds no public classes.

[aarondav]

Test failure:

[info] - Self-join cached *** FAILED ***
[info]   java.lang.NullPointerException:
[info]   at org.apache.spark.sql.columnar.InMemoryRelation.statistics$lzycompute(InMemoryColumnarTableScan.scala:43)
[info]   at org.apache.spark.sql.columnar.InMemoryRelation.statistics(InMemoryColumnarTableScan.scala:42)
[info]   at org.apache.spark.sql.execution.SparkStrategies$HashJoin$.apply(SparkStrategies.scala:78)
[info]   at org.apache.spark.sql.catalyst.planning.QueryPlanner$$anonfun$1.apply(QueryPlanner.scala:58)
[info]   at org.apache.spark.sql.catalyst.planning.QueryPlanner$$anonfun$1.apply(QueryPlanner.scala:58)
[info]   at scala.collection.Iterator$$anon$13.hasNext(Iterator.scala:371)
[info]   at org.apache.spark.sql.catalyst.planning.QueryPlanner.apply(QueryPlanner.scala:59)
[info]   at org.apache.spark.sql.catalyst.planning.QueryPlanner.planLater(QueryPlanner.scala:54)
[info]   at org.apache.spark.sql.execution.SparkStrategies$BasicOperators$.apply(SparkStrategies.scala:268)
[info]   at org.apache.spark.sql.catalyst.planning.QueryPlanner$$anonfun$1.apply(QueryPlanner.scala:58)
[info]   ...

[marmbrus]

@aarondav provides more useful output than @SparkQA ... :)

[marmbrus]

ok to test

[SparkQA]

QA tests have started for PR 2147 at commit 5390360.

• This patch merges cleanly.

[SparkQA]

QA tests have finished for PR 2147 at commit 5390360.

• This patch passes unit tests.
• This patch merges cleanly.
• This patch adds the following public classes (experimental):
  • case class MutableLiteral(var value: Any, dataType: DataType, nullable: Boolean = true)