Subject: [DISCUSS] Spark Columnar Processing


I just realized we had an earlier SPIP on a similar topic: https://issues.apache.org/jira/browse/SPARK-24579

Perhaps we should tie the two together. IIUC, you'd want to expose the existing ColumnBatch API, but also provide utilities to directly convert from/to Arrow.

On Thu, Apr 11, 2019 at 7:13 AM, Bobby Evans < [EMAIL PROTECTED] > wrote: