clear query| facets| time Search criteria: .   Results from 1 to 10 from 28 (0.0s).
Loading phrases to help you
refine your search...
[SPARK-25468] Highlight current page index in the history server - Spark - [issue]
...Spark History Server Web UI should highlight the current page index selected for better navigation. Without it being highlighted it is difficult to identify the current page you are looking ...    Author: Dhruve Ashar , 2018-09-21, 11:24
[SPARK-21243] Limit the number of maps in a single shuffle fetch - Spark - [issue]
...Right now spark can limit the # of parallel fetches and also limits the amount of data in one fetch, but one fetch to a host could be for 100's of blocks. In one instance we saw 450+ blocks....    Author: Dhruve Ashar , 2018-08-03, 07:44
[SPARK-24610] wholeTextFiles broken for small files - Spark - [issue]
...Spark is unable to read small files using the wholeTextFiles method when split size related configs are specified - either explicitly or if they are contained in other config files like hive...    Author: Dhruve Ashar , 2018-07-12, 20:37
[SPARK-21500] Update Shuffle Fetch bookkeeping immediately after receiving remote block - Spark - [issue]
...Currently we update any remote shuffle fetch related parameters only when  we start processing the FetchResult rather than updating them immediately after receiving them. This would spe...    Author: Dhruve Ashar , 2017-07-21, 15:36
[SPARK-21181] Suppress memory leak errors reported by netty - Spark - [issue]
...We are seeing netty report memory leak erros like the one below after switching to 2.1. ERROR ResourceLeakDetector: LEAK: ByteBuf.release() was not called before it's garbage-collected. Enab...    Author: Dhruve Ashar , 2017-07-03, 11:15
Where is yarn-shuffle.jar in maven? - Spark - [mail # user]
...Hi Neal,From my understanding, the reason I think the shuffle is not available inmaven central is that it is an external component and dependent on thecluster manager version - atleast in ca...
   Author: dhruve ashar , 2016-12-13, 18:05
Checkpointing in Spark - Cleaning files and Support across app attempts - Spark - [mail # dev]
...While checkpointing RDDs as a part of an application that doesn't usespark-streaming, I observed that the checkpointed files are not beingcleaned up even after the application completes succ...
   Author: dhruve ashar , 2016-10-11, 22:13
[SPARK-17417] Fix sorting of part files while reconstructing RDD/partition from checkpointed files. - Spark - [issue]
...Spark currently assumes # of partitions to be less than 100000 and uses %05d padding. If we exceed this no., the sort logic in ReliableCheckpointRDD gets messed up and fails. This is because...    Author: Dhruve Ashar , 2016-10-10, 15:57
[SPARK-17365] Kill multiple executors together to reduce lock contention - Spark - [issue]
...To regulate pending and running executors we determine the executors which are eligible to kill and kill them iteratively rather than a loop. This does an RPC call and is synchronized leadin...    Author: Dhruve Ashar , 2016-09-22, 17:11
Setting YARN executors' JAVA_HOME - Spark - [mail # dev]
...Hi Ryan,You can get more info on this here:  Spark documentation.The page addresses what you need. You can look forspark.executorEnv.[EnvironmentVariableName]and set your java home assp...
   Author: dhruve ashar , 2016-08-18, 18:51