clear query| facets| time Search criteria: .   Results from 31 to 40 from 558 (0.0s).
Loading phrases to help you
refine your search...
[expand - 2 more] - Identifying specific persisted DataFrames via getPersistentRDDs() - Spark - [mail # dev]
...That’s correct. I probably would have done better to title this threadsomething like “How to effectively track and release persisted DataFrames”.I jumped the gun in my initial email by refer...
   Author: Nicholas Chammas , 2018-05-09, 02:37
eager execution and debuggability - Spark - [mail # dev]
...This may be technically impractical, but it would be fantastic if we couldmake it easier to debug Spark programs without needing to rely on eagerexecution. Sprinkling .count() and .checkpoin...
   Author: Nicholas Chammas , 2018-05-09, 02:22
[SPARK-23945] Column.isin() should accept a single-column DataFrame as input - Spark - [issue]
...In SQL you can filter rows based on the result of a subquery:SELECT *FROM table1WHERE name NOT IN (    SELECT name    FROM table2);In the Spark DataFrame API, the equival...    Author: Nicholas Chammas , 2018-05-08, 22:22
[expand - 1 more] - Correlated subqueries in the DataFrame API - Spark - [mail # dev]
...What about exposing transforms that make it easy to coerce data to what themethod needs? Instead of passing a dataframe, you’d pass df.toSet to isinAssuming toSet returns a local list, would...
   Author: Nicholas Chammas , 2018-04-27, 21:18
[expand - 3 more] - Changing how we compute release hashes - Spark - [mail # dev]
...To close the loop here: SPARK-23716On Fri, Mar 16, 2018 at 5:00 PM Nicholas Chammas wrote:> OK, will do.>> On Fri, Mar 16, 2018 at 4:41 PM Sean Owen  wrote:>>> I think...
   Author: Nicholas Chammas , 2018-03-24, 05:15
[SPARK-23716] Change SHA512 style in release artifacts to play nicely with shasum utility - Spark - [issue]
...As discussed here....    Author: Nicholas Chammas , 2018-03-17, 00:13
[expand - 2 more] - Silencing messages from Ivy when calling spark-submit - Spark - [mail # dev]
...Looks like the only way to change the Ivy log setting, given how we'reusing it in Spark, is via code.This makes me think: People often have trouble(77Kviews) silencing undesired output from ...
   Author: Nicholas Chammas , 2018-03-12, 23:17
[expand - 2 more] - Please keep s3://spark-related-packages/ alive - Spark - [mail # dev]
...Marton,Thanks for the tip. (Too bad the docs referenced from the issueI opened with INFRA  makeno mention of mirrors.cgi.)Matei,A Requester Pays bucket is a good idea. I was trying...
   Author: Nicholas Chammas , 2018-03-02, 04:19
Suppressing output from Apache Ivy (?) when calling spark-submit with --packages - Spark - [mail # user]
...I’m not sure whether this is something controllable via Spark, but when youcall spark-submit with --packages you get a lot of output. Is there any wayto suppress it? Does it come from Apache...
   Author: Nicholas Chammas , 2018-02-27, 18:37
[VOTE] Spark 2.3.0 (RC5) - Spark - [mail # dev]
...Launched a test cluster on EC2 with Flintrock and ran some simple tests. BuildingSpark took much longer than usual, but that may just be a fluke. Otherwise,all looks good to me.+1On Fri...
   Author: Nicholas Chammas , 2018-02-23, 21:30