clear query| facets| time Search criteria: .   Results from 1 to 10 from 824 (0.0s).
Loading phrases to help you
refine your search...
Access to live data of cached dataFrame - Spark - [mail # user]
...When you cache a dataframe, you actually cache a logical plan. That's whyre-creating the dataframe doesn't work: Spark finds out the logical plan iscached and picks the cached data.You need ...
   Author: Wenchen Fan , 2019-05-21, 13:36
RDD object Out of scope. - Spark - [mail # dev]
...RDD is kind of a pointer to the actual data. Unless it's cached, we don'tneed to clean up the RDD.On Tue, May 21, 2019 at 1:48 PM Nasrulla Khan Haris wrote:> HI Spark developers,>...
   Author: Wenchen Fan , 2019-05-21, 13:28
[SPARK-13155] add runtime null check when convert catalyst array to external array - Spark - [issue]
...scala> Seq(("a", Seq(null, new Integer(1)))).toDS().as[(String, Array[Int])].collect()res5: Array[(String, Array[Int])] = Array((a,Array(0, 1)))This is wrong, we should throw exception fo...    Author: Wenchen Fan , 2019-05-21, 07:59
[SPARK-13853] QueryPlan sub-classes should override producedAttributes to fix missingInput - Spark - [issue]    Author: Wenchen Fan , 2019-05-21, 04:37
[SPARK-13762] support only column names in schema string at createDataFrame - Spark - [issue]
...for example, `createDataFrame(rdd, "a b c")`...    Author: Wenchen Fan , 2019-05-21, 04:36
[SPARK-13720] SQLBuilder.toSQL is broken when there is a sort by after having - Spark - [issue]
...parse this SQL "SELECT COUNT(value) FROM parquet_t1 GROUP BY key HAVING MAX(key) > 0 SORT BY key" to logical plan and generate SQL string again, the generated SQL string can't be parsed.T...    Author: Wenchen Fan , 2019-05-21, 04:36
[SPARK-12474] support deserialization for physical plan and hive logical plan from JSON string - Spark - [issue]
...SPARK-12321 add a framework based on reflection that can serialize TreeNode to JSON and deserialize it back. However, it can't handle all corner cases and we bypass them in the test, see htt...    Author: Wenchen Fan , 2019-05-21, 04:35
[SPARK-11458] add word count example for Dataset - Spark - [issue]    Author: Wenchen Fan , 2019-05-21, 04:34
[SPARK-9778] remove unnecessary evaluation from SortOrder - Spark - [issue]    Author: Wenchen Fan , 2019-05-21, 04:34
[SPARK-13611] import Aggregator doesn't work in Spark Shell - Spark - [issue]
...scala> import org.apache.spark.sql.expressions.Aggregatorimport org.apache.spark.sql.expressions.Aggregatorscala> class SumOf[I, N : Numeric](f: I => N) extends Aggregator[I, N, N] ...    Author: Wenchen Fan , 2019-05-21, 04:34