Subject: Re: [DISCUSS] Spark Columnar Processing

  Bobby Evans 2019-04-11, 14:13
  Reynold Xin 2019-04-11, 17:34
  Bobby Evans 2019-04-13, 20:33
  Wenchen Fan 2019-03-26, 04:53
  Bobby Evans 2019-03-26, 13:57
  Kazuaki Ishizaki 2019-03-27, 04:59
  Bobby Evans 2019-03-27, 15:10
  Bobby Evans 2019-03-25, 20:05
  Reynold Xin 2019-03-26, 17:21
  Bobby Evans 2019-03-26, 19:48
  Renjie Liu 2019-04-03, 02:16
  Bobby Evans 2019-04-05, 19:25
  Bobby Evans 2019-04-02, 14:00
I just realized I didn't make it very clear my stance here ... here's another try:

I think it's a no brainer to have a good columnar UDF interface. This would facilitate a lot of high performance applications, e.g. GPU-based accelerations for machine learning algorithms.

On rewriting the entire internals of Spark SQL to leverage columnar processing, I don't see enough evidence to suggest that's a good idea yet.

On Wed, Mar 27, 2019 at 8:10 AM, Bobby Evans < [EMAIL PROTECTED] > wrote:
  Bobby Evans 2019-04-04, 00:16