clear query| facets| time Search criteria: .   Results from 1 to 10 from 824 (0.0s).
Loading phrases to help you
refine your search...
Access to live data of cached dataFrame - Spark - [mail # user]
...When you cache a dataframe, you actually cache a logical plan. That's whyre-creating the dataframe doesn't work: Spark finds out the logical plan iscached and picks the cached data.You need ...
   Author: Wenchen Fan , 2019-05-21, 13:36
RDD object Out of scope. - Spark - [mail # dev]
...RDD is kind of a pointer to the actual data. Unless it's cached, we don'tneed to clean up the RDD.On Tue, May 21, 2019 at 1:48 PM Nasrulla Khan Haris wrote:> HI Spark developers,>...
   Author: Wenchen Fan , 2019-05-21, 13:28
[SPARK-13155] add runtime null check when convert catalyst array to external array - Spark - [issue]
...scala> Seq(("a", Seq(null, new Integer(1)))).toDS().as[(String, Array[Int])].collect()res5: Array[(String, Array[Int])] = Array((a,Array(0, 1)))This is wrong, we should throw exception fo...
http://issues.apache.org/jira/browse/SPARK-13155    Author: Wenchen Fan , 2019-05-21, 07:59
[SPARK-13853] QueryPlan sub-classes should override producedAttributes to fix missingInput - Spark - [issue]
http://issues.apache.org/jira/browse/SPARK-13853    Author: Wenchen Fan , 2019-05-21, 04:37
[SPARK-13762] support only column names in schema string at createDataFrame - Spark - [issue]
...for example, `createDataFrame(rdd, "a b c")`...
http://issues.apache.org/jira/browse/SPARK-13762    Author: Wenchen Fan , 2019-05-21, 04:36
[SPARK-13720] SQLBuilder.toSQL is broken when there is a sort by after having - Spark - [issue]
...parse this SQL "SELECT COUNT(value) FROM parquet_t1 GROUP BY key HAVING MAX(key) > 0 SORT BY key" to logical plan and generate SQL string again, the generated SQL string can't be parsed.T...
http://issues.apache.org/jira/browse/SPARK-13720    Author: Wenchen Fan , 2019-05-21, 04:36
[SPARK-12474] support deserialization for physical plan and hive logical plan from JSON string - Spark - [issue]
...SPARK-12321 add a framework based on reflection that can serialize TreeNode to JSON and deserialize it back. However, it can't handle all corner cases and we bypass them in the test, see htt...
http://issues.apache.org/jira/browse/SPARK-12474    Author: Wenchen Fan , 2019-05-21, 04:35
[SPARK-11458] add word count example for Dataset - Spark - [issue]
http://issues.apache.org/jira/browse/SPARK-11458    Author: Wenchen Fan , 2019-05-21, 04:34
[SPARK-9778] remove unnecessary evaluation from SortOrder - Spark - [issue]
http://issues.apache.org/jira/browse/SPARK-9778    Author: Wenchen Fan , 2019-05-21, 04:34
[SPARK-13611] import Aggregator doesn't work in Spark Shell - Spark - [issue]
...scala> import org.apache.spark.sql.expressions.Aggregatorimport org.apache.spark.sql.expressions.Aggregatorscala> class SumOf[I, N : Numeric](f: I => N) extends Aggregator[I, N, N] ...
http://issues.apache.org/jira/browse/SPARK-13611    Author: Wenchen Fan , 2019-05-21, 04:34