clear query| facets| time Search criteria: author:"Cody Koeninger".   Results from 1 to 10 from 317 (0.0s).
Loading phrases to help you
refine your search...
[expand - 3 more] - replacement for SPARK_JAVA_OPTS - Spark - [mail # dev]
...Just wanted to check in on this, see if I should file a bug report regarding the mesos argument propagation.   On Thu, Jul 31, 2014 at 8:35 AM, Cody Koeninger  wrote:  > 1. I've tried...
... of the >> > other issues, or a separate bug). >> > >> > - Patrick >> > >> > On Wed, Jul 30, 2014 at 3:10 PM, Cody Koeninger  >> wrote: >> >> In addition, spark.executor.extraJavaOptions does not seem...
... of spark.driver.extraJavaOptions in a local >> spark >> >> shell. >> >> >> >> >> >> On Wed, Jul 30, 2014 at 4:18 PM, Cody Koeninger  >> wrote: >> >> >> >>> Either whitespace or equals sign are valid properties file...
...") >> >>> res0: String = null >> >>> >> >>> >> >>> If you add double quotes, the resulting string value will have double >> >>> quotes. >> >>> >> >>> >> >>> $ cat conf/spark-defaults.conf...
.... :-) >> >>>> > >> >>>> > >> >>>> > On Wed, Jul 30, 2014 at 1:12 PM, Cody Koeninger > [EMAIL PROTECTED]> >> >>>> wrote: >> >>>> >> We were previously using SPARK_JAVA_OPTS to set java system >> properties >> >>>> via >> >>>> >> -D...
   Author: Cody Koeninger , 2014-08-07, 21:35
Structured streaming use of DataFrame vs Datasource - Spark - [mail # dev]
...Sorry, meant DataFrame vs Dataset On Thu, Jun 16, 2016 at 12:53 PM, Cody Koeninger  wrote: ...
   Author: Cody Koeninger , 2016-06-16, 18:18
Zero Data Loss in Spark with Kafka - Spark - [mail # user]
...See https://github.com/koeninger/kafka-exactly-once On Aug 23, 2016 10:30 AM, "KhajaAsmath Mohammed" wrote: ...
   Author: Cody Koeninger , 2016-08-23, 18:22
Maintain kafka offset externally as Spark streaming processes records. - Spark - [mail # user]
...Have you looked at everything linked from https://github.com/koeninger/kafka-exactly-once On Tue, May 24, 2016 at 2:07 PM, sagarcasual .  wrote:   ...
   Author: Cody Koeninger , 2016-05-24, 19:26
[expand - 3 more] - Spark and KafkaUtils - Spark - [mail # user]
... Koeninger > wrote: > >> Ok, that build file I linked earlier has a minimal example of use.  just >> running 'sbt assembly' given a similar build file should build a jar with >> all the dependencies...
..., Feb 24, 2016 at 11:10 AM, Cody Koeninger >>> wrote: >>> >>>> Are you using sbt assembly?  That's what will include all of the >>>> non-provided dependencies in a single jar along with your...
..., >>>>> ~Vinti >>>>> >>>>> On Wed, Feb 24, 2016 at 9:33 AM, Cody Koeninger >>>>> wrote: >>>>> >>>>>> spark streaming is provided, kafka is not. >>>>>> >>>>>> This build file >>>>>> >>>>>> https...
...://github.com/koeninger/kafka-exactly-once/blob/master/build.sbt >>>>>> >>>>>> includes some hacks for ivy issues that may no longer be strictly >>>>>> necessary, but try that build and see if it works...
   Author: Cody Koeninger , 2016-02-24, 21:34
[expand - 4 more] - Automated formatting - Spark - [mail # dev]
... to contributors that they do this manually? Then if it seems to work fine, we can try to automate it. > > > On Nov 22, 2018, at 4:40 PM, Cody Koeninger  wrote: > > > > I believe scalafmt only works...
...: > >> > >> Is this handling only scala or java as well ? > >> > >> Regards, > >> Mridul > >> > >> On Thu, Nov 22, 2018 at 9:11 AM Cody Koeninger  wrote: > >>> > >>> Plugin invocation is ./build/mvn mvn-scalafmt_2.12...
... > >>>> the right diff, seems worth a shot. What's the invocation that Shane > >>>> could add (after this change goes in) > >>>> On Wed, Nov 21, 2018 at 3:27 PM Cody Koeninger  wrote...
...? if the rules > >>>>>> are simple and not too hard to maintain, seems like a win. > >>>>>> On Wed, Nov 21, 2018 at 2:26 PM Cody Koeninger  wrote: > >>>>>>> > >>>>>>> Definitely not suggesting a mass...
... to just check style on PR changes? that's fine. > >>>>>>>> On Wed, Nov 21, 2018 at 11:40 AM Cody Koeninger  wrote: > >>>>>>>>> > >>>>>>>>> Is there any appetite for revisiting automating...
   Author: Cody Koeninger , 2018-11-26, 20:47
Spark kafka integration issues - Spark - [mail # user]
...Yeah, an updated version of that blog post is available at https://github.com/koeninger/kafka-exactly-once On Wed, Sep 14, 2016 at 11:35 AM, Mukesh Jha  wrote: To unsubscribe e-mail...
   Author: Cody Koeninger , 2016-09-14, 17:59
Can spark support exactly once based kafka ? Due to these following question? - Spark - [mail # user]
...Have you read / watched the materials linked from https://github.com/koeninger/kafka-exactly-once On Mon, Dec 5, 2016 at 4:17 AM, Jörn Franke  wrote: To unsubscribe e-mail: user...
   Author: Cody Koeninger , 2016-12-06, 02:23
[expand - 2 more] - Spark Streaming 1.3 & Kafka Direct Streams - Spark - [mail # user]
... only once, and no way of > refreshing them. > > Thanks again! > > On Wed, Apr 1, 2015 at 10:01 AM, Cody Koeninger > wrote: > >> https://github.com/koeninger/kafka-exactly-once/blob/master...
   Author: Cody Koeninger , 2015-04-01, 18:23
[expand - 1 more] - How does Spark streaming's Kafka direct stream survive from worker node failure? - Spark - [mail # user]
..."? Will Spark Streamning try to > consume all the messages in Kafka? > > 发自WPS邮箱客戶端 > 在 Cody Koeninger ,2016年2月25日 上午11:58写道: > > The per partition offsets are part of the rdd as defined on the driver...
.... > Have you read > > https://github.com/koeninger/kafka-exactly-once/blob/master/blogpost.md > > and/or watched > > https://www.youtube.com/watch?v=fXnNEq1v3VA > > On Wed, Feb 24, 2016 at 9:05 PM...
   Author: Cody Koeninger , 2016-02-26, 17:02