| clear
query|
facets|
time |
Search criteria: .
Results from 1 to 10 from
945 (0.0s).
|
|
|
Loading phrases to help you
refine your search...
|
|
[PySpark] Revisiting PySpark type annotations -
Spark - [mail # user]
|
| ...I think the annotations are compatible with Python 2 since Maciejimplemented them via stub files, which Python 2simply ignores. Folks using mypy to check typeswill get the benefit whet... |
|
|
|
|
|
|
|
[expand - 1 more]
[collapse]
-
Ask for reviewing on Structured Streaming PRs -
Spark - [mail # dev]
|
| ...OK, good to know, and that all makes sense. Thanks for clearing up myconcern.One of great things about Spark is, as you pointed out, that improvementsto core components benefit multiple feat... |
|
|
|
|
| |
|
Ask for reviewing on Structured Streaming PRs - Spark - [mail # dev]
|
| ...As an observer, this thread is interesting and concerning. Is there anemerging consensus that Structured Streaming is somehow not relevantanymore? Or is it just that folks consider it "compl... |
|
|
|
|
|
|
|
[SPARK-19217] Offer easy cast from vector to array -
Spark - [issue]
|
| ...Working with ML often means working with DataFrames with vector columns. You can't save these DataFrames to storage (edit: at least as ORC) without converting the vector columns to array col... |
|
|
|
|
|
|
|
[expand - 1 more]
[collapse]
-
Noisy spark-website notifications -
Spark - [mail # dev]
|
| ...I'd prefer it if we disabled all git notifications for spark-website. Folkswho want to stay on top of what's happening with the site can simply watchthe repo on GitHub , no?On Wed, Dec 19, 2... |
|
|
|
|
| |
|
Noisy spark-website notifications - Spark - [mail # dev]
|
| ...Can we somehow disable these new email alerts coming through for the Sparkwebsite repo?On Wed, Dec 19, 2018 at 8:25 PM GitBox wrote:> ueshin commented on a change in pull request #1... |
|
|
|
|
|
|
|
[SPARK-18818] Window...orderBy() should accept an 'ascending' parameter just like DataFrame.orderBy() -
Spark - [issue]
|
| ...It seems inconsistent that Window...orderBy() does not accept an ascending parameter, when DataFrame.orderBy() does.It's also slightly inconvenient since to specify a descending sort order y... |
|
|
|
|
|
|
|
[SPARK-25150] Joining DataFrames derived from the same source yields confusing/incorrect results -
Spark - [issue]
|
| ...I have two DataFrames, A and B. From B, I have derived two additional DataFrames, B1 and B2. When joining A to B1 and B2, I'm getting a very confusing error:Join condition is missing or triv... |
|
|
|
|
|
|
|
[expand - 4 more]
[collapse]
-
Documentation of boolean column operators missing? -
Spark - [mail # dev]
|
| ...On Tue, 23 Oct 2018 at 21:32, Sean Owen wrote:>>> The comments say that it is not possible to overload 'and' and 'or',>> which would have been more natural.>>> ... |
|
|
|
|
| |
|
Documentation of boolean column operators missing? - Spark - [mail # dev]
|
| ...Also, to clarify something for folks who don't work with PySpark: Theboolean column operators in PySpark are completely different from those inScala, and non-obvious to boot (since they over... |
|
|
|
|
|
Documentation of boolean column operators missing? - Spark - [mail # dev]
|
| ...So it appears then that the equivalent operators for PySpark are completelymissing from the docs, right? That’s surprising. And if there are columnfunction equivalents for |, &, and ~, then ... |
|
|
|
|
|
Documentation of boolean column operators missing? - Spark - [mail # dev]
|
| ...Nope, that’s different. I’m talking about the operators on DataFramecolumns in PySpark, not SQL functions.For example:(df .where(~col('is_exiled') & (col('age') > 60)) ... |
|
|
|
|
|
Documentation of boolean column operators missing? - Spark - [mail # dev]
|
| ...I can’t seem to find any documentation of the &, |, and ~ operators forPySpark DataFrame columns. I assume that should be in our docs somewhere.Was it always missing? Am I just missing somet... |
|
|
|
|
|
|
|
[VOTE] SPARK 2.4.0 (RC3) -
Spark - [mail # dev]
|
| ...FYI I believe we have an open correctness issue here:https://issues.apache.org/jira/browse/SPARK-25150However, it needs review by another person to confirm whether it is indeeda correctness ... |
|
|
|
|
|
|
|
[VOTE] SPARK 2.4.0 (RC1) -
Spark - [mail # dev]
|
| ...I believe -1 votes are merited only for correctness bugs and regressionssince the previous release.Does SPARK-23200 count as either?2018년 9월 17일 (월) 오전 9:40, Stavros Kontopoulos <[EMAIL P... |
|
|
|
|
|
|
|
Should python-2 be supported in Spark 3.0? -
Spark - [mail # user]
|
| ...As Reynold pointed out, we don't have to drop Python 2 support right offthe bat. We can just deprecate it with Spark 3.0, which would allow us toactually drop it at a later 3.x release.On Sa... |
|
|
|
|
|
|
|
|