clear query| facets| time Search criteria: author:"Shixiong Zhu".   Results from 1 to 10 from 39 (0.0s).
Loading phrases to help you
refine your search...
[SPARK-16754] NPE when defining case class and searching Encoder in the same line - Spark - [issue]
...Reproducer:scala> :paste// Entering paste mode (ctrl-D to finish)case class TestCaseClass(value: Int)import spark.implicits._Seq(TestCaseClass(1)).toDS().collect()// Exiting paste mode, n...    Author: Shixiong Zhu , 2019-07-25, 20:56
[SPARK-26594] DataSourceOptions.asMap should return CaseInsensitiveMap - Spark - [issue]
...I'm pretty surprised that the following codes will fail.import scala.collection.JavaConverters._import org.apache.spark.sql.sources.v2.DataSourceOptionsval map = new DataSourceOptions(Map("f...    Author: Shixiong Zhu , 2019-07-17, 02:42
[SPARK-28486] PythonBroadcast may delete the broadcast file while a Python worker still needs it - Spark - [issue]
...Steps to reproduce: Run "bin/pyspark --master local[1,1] --conf spark.memory.fraction=0.0001" to start PySpark Run the following codes:b = sc.broadcast([100])sc.parallelize([0],1).ma...    Author: Shixiong Zhu , 2019-08-05, 11:23
[SPARK-20547] ExecutorClassLoader's findClass may not work correctly when a task is cancelled. - Spark - [issue]
...ExecutorClassLoader's findClass may throw some transient exception. For example, when a task is cancelled, if ExecutorClassLoader is running, you may see InterruptedException or IOException,...    Author: Shixiong Zhu , 2019-08-04, 13:42
[SPARK-27468] "Storage Level" in "RDD Storage Page" is not correct - Spark - [issue]
...I ran the following unit test and checked the UI.    val conf = new SparkConf()      .setAppName("test")      .setMaster("local-cluster[2,1,1024]")&nb...    Author: Shixiong Zhu , 2019-10-07, 21:12
[SPARK-30936] Forwards-compatibility in JsonProtocol in broken - Spark - [issue]
...JsonProtocol is supposed to provide strong backwards-compatibility and forwards-compatibility guarantees: any version of Spark should be able to read JSON output written by any other version...    Author: Shixiong Zhu , 2020-02-25, 04:36
[SPARK-30927] StreamingQueryManager should avoid keeping reference to terminated StreamingQuery - Spark - [issue]
...Right now StreamingQueryManager will keep the last terminated query until "resetTerminated" is called. When the last terminated query has lots of states (a large sql plan, cached RDDs, etc.)...    Author: Shixiong Zhu , 2020-02-24, 09:49
[SPARK-20971] Purge the metadata log for FileStreamSource - Spark - [issue]
...Currently FileStreamSource.commit is empty. We can delete unused metadata logs in this method to reduce the size of log files....    Author: Shixiong Zhu , 2020-01-17, 00:13
[SPARK-21869] A cached Kafka producer should not be closed if any task is using it. - Spark - [issue]
...Right now a cached Kafka producer may be closed if a large task uses it for more than 10 minutes....    Author: Shixiong Zhu , 2020-01-13, 07:50
[SPARK-30984] Add UI test for Structured Streaming UI - Spark - [issue]
...It's better to add some basic UI test for Structured Streaming UI....    Author: Shixiong Zhu , 2020-03-04, 06:20