clear query| facets| time Search criteria: .   Results from 1 to 10 from 104 (0.0s).
Loading phrases to help you
refine your search...
[SPARK-31593] Remove unnecessary streaming query progress update - Spark - [issue]
...Structured Streaming progress reporter will always report an `empty` progress when there is no new data. As design, we should provide progress updates every 10s (default) when there is no ne...    Author: Genmao Yu , 2020-06-12, 04:51
[SPARK-31953] Add Spark Structured Streaming History Server Support - Spark - [issue]    Author: Genmao Yu , 2020-06-10, 09:14
[SPARK-31913] StackOverflowError in FileScanRDD - Spark - [issue]
...Reading from FileScanRDD may failed with a StackOverflowError in my environment: There are a mass of empty files in table partition。 Set `spark.sql.files.maxPartitionBytes`  with a larg...    Author: Genmao Yu , 2020-06-05, 10:58
[SPARK-29683] Job failed due to executor failures all available nodes are blacklisted - Spark - [issue]
...My streaming job will fail due to executor failures all available nodes are blacklisted. This exception is thrown only when all node is blacklisted:def isAllNodeBlacklisted: Boolean = curren...    Author: Genmao Yu , 2020-06-01, 14:47
[SPARK-3376] Memory-based shuffle strategy to reduce overhead of disk I/O - Spark - [issue]
...I think a memory-based shuffle can reduce some overhead of disk I/O. I just want to know is there any plan to do something about it. Or any suggestion about it. Base on the work (SPARK-2044)...    Author: Genmao Yu , 2020-05-17, 18:30
[SPARK-2773] Shuffle:use growth rate to predict if need to spill - Spark - [issue]
...Right now, Spark uses the total usage of "shuffle" memory of each thread to predict if need to spill. I think it is not very reasonable. For example, there are two threads pulling "shuffle" ...    Author: Genmao Yu , 2020-05-17, 18:30
[SPARK-31677] Use KVStore to cache stream query progress - Spark - [issue]
...1. Streaming query progress information are cached twice in StreamExecution and StreamingQueryStatusListener.  It is memory-wasting. We can make this two usage unified.2. Use KVStore in...    Author: Genmao Yu , 2020-05-11, 09:30
[SPARK-29438] Failed to get state store in stream-stream join - Spark - [issue]
...Now, Spark use the `TaskPartitionId` to determine the StateStore path.TaskPartitionId   \ StateStoreVersion  --> StoreProviderId -> StateStoreStateStoreName    / &n...    Author: Genmao Yu , 2020-04-14, 04:27
[HADOOP-13377] AliyunOSS: improvements for stabilization and optimization - Hadoop - [issue]
...This work is to handle some stabilization issues....    Author: Genmao Yu , 2020-04-09, 18:52
[SPARK-28256] Failed to initialize FileContextBasedCheckpointFileManager with uri without authority - Spark - [issue]
...reproduce codeCREATE TABLE `user_click_count` (`userId` STRING, `click` BIGINT)USING org.apache.spark.sql.jsonOPTIONS (path 'hdfs:///tmp/test');error:java.lang.RuntimeException:    Author: Genmao Yu , 2020-03-16, 22:54