clear query| facets| time Search criteria: author:"Tathagata Das".   Results from 1 to 10 from 352 (0.0s).
Loading phrases to help you
refine your search...
[expand - 7 more] - Batchdurationmillis seems "sticky" with direct Spark streaming - Spark - [mail # user]
... to be exposed in case of metadata checkpointing. > > > > On Wed, Sep 9, 2015 at 10:39 PM, Tathagata Das > wrote: > >> The whole point of checkpointing is to recover the *exact* computation >> where...
...)?  Is there a way to override this? >>> Thanks. >>> >>> >>> >>> >>> >>> On Wed, Sep 9, 2015 at 2:44 PM, Tathagata Das >>> wrote: >>> >>>> >>>> >>>> See inline. >>>> >>>> On Tue, Sep 8, 2015 at 9:02 PM...
... the checkpointed context. >>>>> >>>>> Second of all, it's not true that we're loading the checkpointed >>>>> context independent of whether params.isCheckpointed() is true.  I'm >>>>> quoting the code...
   Author: Tathagata Das , 2015-09-10, 20:41
[expand - 1 more] - Re: About FlumeUtils.createStream - Spark - [mail # user]
...) ), > then these Receivers will stay on one cluster node, or will they > distributed among the cluster nodes? > > ------------------------------ > [EMAIL PROTECTED] > > > *From:* Akhil Das > *Date:* 2015-02-24 12:58...
... > *To:* Tathagata Das > *CC:* user ; bit1129 > *Subject:* Re: About FlumeUtils.createStream > > I see, thanks for the clarification TD. > On 24 Feb 2015 09:56, "Tathagata Das"  wrote: > >> Akhil...
... >> details here. >> http://spark.apache.org/docs/latest/streaming-flume-integration.html >> >> >> >> On Sat, Feb 21, 2015 at 12:17 AM, Akhil Das >> wrote: >> >>> Spark won't listen on 9999 mate...
   Author: Tathagata Das , 2015-02-24, 05:03
[expand - 1 more] - spark.scheduler.pool seems not working in spark streaming - Spark - [mail # user]
...I filed a JIRA for this task for future reference.  https://issues.apache.org/jira/browse/SPARK-2780  On Thu, Jul 31, 2014 at 5:37 PM, Tathagata Das  wrote: > Whoa! That worked! I was half...
... afraid it wont, since I hadnt tried it myself. > > TD > > On Wed, Jul 30, 2014 at 8:32 PM, liuwei  wrote: >> Hi, Tathagata Das: >> >>       I followed your advice and solved this problem, thank...
... you very much! >> >> >> 在 2014年7月31日,上午3:07,Tathagata Das  写道: >> >>> This is because setLocalProperty makes all Spark jobs submitted using >>> the current thread belong to the set pool...
   Author: Tathagata Das , 2014-08-01, 00:41
KinesisStreamSuite failing in master branch - Spark - [mail # dev]
...The PR to fix this is out. https://github.com/apache/spark/pull/7519 On Sun, Jul 19, 2015 at 6:41 PM, Tathagata Das  wrote: ...
   Author: Tathagata Das , 2015-07-20, 02:22
[expand - 1 more] - Spark structured streaming: periodically refresh static data frame - Spark - [mail # user]
... is just a few weeks away ) > > Appreciate all the help! > > thanks > App > > > > On 14 February 2018 at 4:41:52 PM, Tathagata Das ( > [EMAIL PROTECTED]) wrote: > > Let me fix my mistake...
.... > > TD > > On Wed, Feb 14, 2018 at 2:57 AM, Appu K  wrote: > >> More specifically, >> >> Quoting TD from the previous thread >> "Any streaming query that joins a streaming dataframe with the view...
   Author: Tathagata Das , 2018-02-15, 02:05
Does RDD checkpointing store the entire state in HDFS? - Spark - [mail # dev]
...BTW, this is more like a user-list kind of mail, than a dev-list. The dev-list is for Spark developers. On Tue, Jul 14, 2015 at 4:23 PM, Tathagata Das  wrote: ...
   Author: Tathagata Das , 2015-07-14, 23:26
[structured streaming] How to remove outdated data when use Window Operations - Spark - [mail # user]
... Das wrote: ...
   Author: Tathagata Das , 2016-12-01, 08:55
[expand - 1 more] - throughput in the web console? - Spark - [mail # user]
... processed in a batch with a max processing > time of 1 second 473 ms? > > On Wed, Feb 25, 2015 at 8:48 AM, Akhil Das > wrote: > >> By throughput you mean Number of events processed etc...
... at 7:54 AM, Akhil Das >>> wrote: >>> >>>> For SparkStreaming applications, there is already a tab called >>>> "Streaming" which displays the basic statistics. >>> >>> >>> Would I just need...
   Author: Tathagata Das , 2015-02-26, 01:39
[expand - 2 more] - Map Question - Spark - [mail # user]
... < > [EMAIL PROTECTED]> wrote: > >> Great. Will try to modify the code. Always room to optimize! >> ᐧ >> >> On Wed, Apr 22, 2015 at 2:11 PM, Tathagata Das >> wrote: >> >>> Absolutely. The same code...
... in local mode? >>>> ᐧ >>>> >>>> On Wed, Apr 22, 2015 at 2:06 PM, Tathagata Das >>>> wrote: >>>> >>>>> Yep. Not efficient. Pretty bad actually. That's why broadcast variable >>>>> were introduced...
... at 1:42 PM, Tathagata Das >>>>>> wrote: >>>>>> >>>>>>> Is the mylist present on every executor? If not, then you have to >>>>>>> pass it on. And broadcasts are the best way to pass them...
   Author: Tathagata Das , 2015-04-22, 22:48
[expand - 2 more] - Spark 0.9.1 released - Spark - [mail # dev]
... for managing this release, and thanks to everyone who >> contributed! >> >> Matei >> >> On Apr 9, 2014, at 2:59 PM, Tathagata Das  >> wrote: >> >> A small additional note: Please use the direct...
..., Tathagata Das > [EMAIL PROTECTED]> wrote: >> >>> Hi everyone, >>> >>> We have just posted Spark 0.9.1, which is a maintenance release with >>> bug fixes, performance improvements, better...
... Ryza, Sean Owen, Shixiong Zhu, >>> shiyun.wxm, Stevo Slavić, Tathagata Das, Tom Graves, Xiangrui Meng >>> >>> TD >>> >> >> >> > ...
   Author: Tathagata Das , 2014-04-09, 23:21