clear query| facets| time Search criteria: author:"Reynold Xin".   Results from 41 to 50 from 101 (0.0s).
Loading phrases to help you
refine your search...
[expand - 1 more] - Decimals with negative scale - Spark - [mail # dev]
...So why can't we just do validation to fail sources that don't support negative scale, if it is not supported? This way, we don't need to break backward compatibility in anyway and it becomes...
   Author: Reynold Xin , 2018-12-18, 18:08
[DISCUSS] Default values and data sources - Spark - [mail # dev]
...I'd only do any of the schema evolution things as add-on on top. This is an extremely complicated area and we could risk never shipping anything because there would be a lot of different req...
   Author: Reynold Xin , 2018-12-21, 18:11
[SQL] hash: 64-bits and seeding - Spark - [mail # dev]
...Rather than calling it hash64, it'd be better to just call it xxhash64. The reason being ten years from now, we probably would look back and laugh at a specific hash implementation. It'd be ...
   Author: Reynold Xin , 2019-03-07, 07:33
Benchmark Java/Scala/Python for Apache spark - Spark - [mail # dev]
...If you use UDFs in Python, you would want to use Pandas UDF for betterperformance.On Mon, Mar 11, 2019 at 7:50 PM Jonathan Winandy wrote:> Thanks, I didn't know!>> That being said, ...
   Author: Reynold Xin , 2019-03-12, 03:08
Hive Hash in Spark - Spark - [mail # dev]
...I think they might be used in bucketing? Not 100% sure.On Wed, Mar 06, 2019 at 1:40 PM,  wrote:> > > > Hi,> > > >  > > > > I noticed the existence of...
   Author: Reynold Xin , 2019-03-06, 21:57
Trigger full GC during executor idle time? - Spark - [mail # dev]
...Not sure how reputable or representative that paper is...On Mon, Dec 31, 2018 at 10:57 AM Sean Owen  wrote:> https://github.com/apache/spark/pull/23401>> Interesting PR; I thou...
   Author: Reynold Xin , 2018-12-31, 19:01
[PySpark] Revisiting PySpark type annotations - Spark - [mail # user]
...If we can make the annotation compatible with Python 2, why don’t we addtype annotation to make life easier for users of Python 3 (with type)?On Fri, Jan 25, 2019 at 7:53 AM Maciej Szymkiewi...
   Author: Reynold Xin , 2019-01-25, 17:27
Make .unpersist() non-blocking by default? - Spark - [mail # dev]
...Seems to make sense to have it false by default.(I agree this deserves a dev list mention though even if there is easyconsensus). We should make sure we mark the Jira with releasenotes so we...
   Author: Reynold Xin , 2019-01-28, 17:21
[DISCUSS] New sections in Github Pull Request description template - Spark - [mail # dev]
...I like the spirit, but not sure about the exact proposal. Take a look atk8s':https://raw.githubusercontent.com/kubernetes/kubernetes/master/.github/PULL_REQUEST_TEMPLATE.mdOn Tue, Jul 23, 20...
   Author: Reynold Xin , 2019-07-24, 05:07
Revisiting Python / pandas UDF - Spark - [mail # dev]
...Hi all,In the past two years, the pandas UDFs are perhaps the most important changes to Spark for Python data science. However, these functionalities have evolved organically, leading to som...
   Author: Reynold Xin , 2019-07-05, 20:52