clear query| facets| time Search criteria: .   Results from 1 to 10 from 80 (0.0s).
Loading phrases to help you
refine your search...
[expand - 2 more] - ConcurrentModificationExceptions with CachedKafkaConsumers - Spark - [mail # user]
...Cody,Yes - I was able to verify that I am not seeing duplicate calls tocreateDirectStream.  If the spark-streaming-kafka-0-10 will work on a 2.3cluster I can go ahead and give that a sh...
   Author: Bryan Jeffrey , 2018-08-31, 16:57
[expand - 2 more] - Spark-Streaming-Kafka10_2.11 on Spark 2.3 - Spark - [mail # user]
...Cody,No - the group ID is the application name and topic.Get Outlook for Android________________________________From: Cody Koeninger Sent: Friday, July 20, 2018 5:29:06 PMTo: Bryan JeffreyCc...
   Author: Bryan Jeffrey , 2018-07-20, 21:34
Heap Memory in Spark 2.3.0 - Spark - [mail # user]
...Hello.I am working to move our system from Spark 2.1.0 to Spark 2.3.0.  Oursystem is running on Spark managed via Yarn.  During the course of the moveI mirrored the settings to our...
   Author: Bryan Jeffrey , 2018-07-16, 18:43
[expand - 3 more] - Kafka Offset Storage: Fetching Offsets - Spark - [mail # user]
...Cody,Thank you. Let me see if I can reproduce this. We're not seeing offsets load correctly on startup - but perhaps there is an error on my side.BryanGet Outlook for Android________________...
   Author: Bryan Jeffrey , 2018-06-14, 21:15
[Spark 2.x Core] Adding to ArrayList inside rdd.foreach() - Spark - [mail # user]
...You can just call rdd.flatMap(_._2).collectGet Outlook for Android________________________________From: klrmowse Sent: Saturday, April 7, 2018 1:29:34 PMTo: [EMAIL PROTECTED]Subject: Re: [Sp...
   Author: Bryan Jeffrey , 2018-04-07, 17:31
Return statements aren't allowed in Spark closures - Spark - [mail # user]
...Lian,You're writing Scala. Just remove the 'return'. No need for it in Scala.Get Outlook for Android________________________________From: Lian Jiang Sent: Wednesday, February 21, 2018 4:16:0...
   Author: Bryan Jeffrey , 2018-02-22, 00:26
Stopping a Spark Streaming Context gracefully - Spark - [mail # user]
...Hello.I am running Spark 2.1, Scala 2.11.  We're running several Spark streamingjobs.  In some cases we restart these jobs on an occasional basis.  We havecode that looks like...
   Author: Bryan Jeffrey , 2017-11-07, 18:36
about broadcast join of base table in spark sql - Spark - [mail # user]
...Hello. If you want to allow broadcast join with larger broadcasts you can set spark.sql.autoBroadcastJoinThreshold to a higher value. This will cause the plan to allow join despite 'A' being...
   Author: Bryan Jeffrey , 2017-06-30, 10:57
[expand - 1 more] - Question about Parallel Stages in Spark - Spark - [mail # user]
...Satish, Is this two separate applications submitted to the Yarn scheduler? If so then you would expect that you would see the original case run in parallel. However, if this is one applicati...
   Author: Bryan Jeffrey , 2017-06-27, 11:04
[expand - 1 more] - Broadcasts & Storage Memory - Spark - [mail # user]
...Satish, I agree - that was my impression too. However I am seeing a smaller set of storage memory used on a given executor than the amount of memory required for my broadcast variables. I am...
   Author: Bryan Jeffrey , 2017-06-21, 23:09