clear query| facets| time Search criteria: author:"Patrick Wendell".   Results from 1 to 10 from 1095 (0.0s).
Loading phrases to help you
refine your search...
[expand - 1 more] - Reading multiple S3 objects, transforming, writing back one - Spark - [mail # user]
...This is a consequence of the way the Hadoop files API works. However, you can (fairly easily) add code to just rename the file because it will always produce the same filename.  (heavy ...
   Author: Patrick Wendell , 2014-05-01, 01:33
[expand - 1 more] - spark ec2 error - Spark - [mail # user]
...Hey Jeremy,  This is actually a big problem - thanks for reporting it, I'm going to revert this change until we can make sure it is backwards compatible.  - Patrick  On Sun, M...
   Author: Patrick Wendell , 2014-05-04, 22:41
combining operations elegantly - Spark - [mail # user]
...Hey All,  I think the old thread is here: https://groups.google.com/forum/#!msg/spark-users/gVtOp1xaPdU/Uyy9cQz9H_8J  The method proposed in that thread is to create a utility clas...
   Author: Patrick Wendell , 2014-03-23, 23:16
[expand - 1 more] - How many partitions is my RDD split into? - Spark - [mail # user]
...As Mark said you can actually access this easily. The main issue I've seen from a performance perspective is people having a bunch of really small partitions. This will still work but the pe...
   Author: Patrick Wendell , 2014-03-24, 05:55
No space left on device exception - Spark - [mail # user]
...Ognen - just so I understand. The issue is that there weren't enough inodes and this was causing a "No space left on device" error? Is that correct? If so, that's good to know because it's d...
   Author: Patrick Wendell , 2014-03-24, 05:57
Error reading HDFS file using spark 0.9.0 / hadoop 2.2.0 - incompatible protobuf 2.5 and 2.4.1 - Spark - [mail # user]
...Starting with Spark 0.9 the protobuf dependency we use is shaded and cannot interfere with other protobuf libaries including those in Hadoop. Not sure what's going on in this case. Would som...
   Author: Patrick Wendell , 2014-03-25, 23:10
Building Spark 0.9.x for CDH5 with mrv1 installation (Protobuf 2.5 upgrade) - Spark - [mail # user]
...I'm not sure exactly how your cluster is configured. But as far as I can tell Cloudera's MR1 CDH5 dependencies are against Hadoop 2.3. I'd just find the exact CDH version you have and link a...
   Author: Patrick Wendell , 2014-03-26, 05:59
spark-ec2 login expects at least 1 slave - Spark - [mail # user]
...Yep, currently it only supports running at least 1 slave.  On Sat, Mar 1, 2014 at 4:47 PM, nicholas.chammas  wrote: > I successfully launched a Spark EC2 "cluster" with 0 slaves...
   Author: Patrick Wendell , 2014-03-02, 00:55
Log analyzer and other Spark tools - Spark - [mail # user]
...Hey Roman,  Ya definitely checkout pull request 42 - one cool thing is this patch now includes information about in-memory storage in the listener interface, so you can see directly whi...
   Author: Patrick Wendell , 2014-03-19, 05:14
Setting the Scala version in the EC2 script? - Spark - [mail # user]
...Spark will only work with Scala 2.10... are you trying to do a minor version upgrade or upgrade to a totally different version?  You could do this as follows if you want: 1. Fork the sp...
   Author: Patrick Wendell , 2014-05-04, 00:15