clear query| facets| time Search criteria: .   Results from 1 to 10 from 295 (0.0s).
Loading phrases to help you
refine your search...
[SPARK-30814] Add Columns references should be able to resolve each other - Spark - [issue]
...In ResolveAlterTableChanges, we have checks that make sure that positional arguments exist and are normalized around case sensitivity for ALTER TABLE ADD COLUMNS. However, we missed the case...    Author: Burak Yavuz , 2020-02-17, 08:08
[expand - 2 more] - Best way to read batch from Kafka and Offsets - Spark - [mail # user]
...Yay! Glad you could figure it out!On Sat, Feb 15, 2020 at 7:41 AM Ruijing Li  wrote:> Thought to update this thread. Figured out my issue with forEachBatch and> structured streami...
   Author: Burak Yavuz , 2020-02-16, 04:17
[SPARK-30697] Handle database and namespace exceptions in catalog.isView - Spark - [issue]
...The non-existence of a database shouldn't throw a NoSuchDatabaseException from catalog.isView...    Author: Burak Yavuz , 2020-02-03, 06:24
[SPARK-30324] Simplify API for JSON access in DataFrames/SQL - Spark - [issue]
...get_json_object() is a UDF to parse JSON fields. It is verbose and hard to use, e.g. I wasn't expecting the path to a field to have to start with "$.". We can simplify all of this when a col...    Author: Burak Yavuz , 2020-02-01, 23:41
[SPARK-30334] Add metadata around semi-structured columns to Spark - Spark - [issue]
...Semi-structured data is used widely in the data industry for reporting events in a wide variety of formats. Click events in product analytics can be stored as json. Some application logs can...    Author: Burak Yavuz , 2020-02-01, 23:41
[SPARK-30669] Introduce AdmissionControl API to Structured Streaming - Spark - [issue]
...In Structured Streaming, we have the concept of Triggers. With a trigger like Trigger.Once(), the semantics are to process all the data available to the datasource in a single micro-batch. H...    Author: Burak Yavuz , 2020-01-31, 06:12
[SPARK-29219] DataSourceV2: Support all SaveModes in - Spark - [issue]
...We currently don't support all save modes in as the TableProvider interface allows for the reading/writing of data, but not for the creation of tables. We created a cata...    Author: Burak Yavuz , 2020-01-09, 19:25
[SPARK-29568] Add flag to stop existing stream when new copy starts - Spark - [issue]
...In multi-tenant environments where you have multiple SparkSessions, you can accidentally start multiple copies of the same stream (i.e. streams using the same checkpoint location). This will...    Author: Burak Yavuz , 2020-01-03, 01:42
[SPARK-28863] Add an AlreadyPlanned logical node that skips query planning - Spark - [issue]
...With the DataSourceV2 write operations, we have a way to fallback to the V1 writer APIs using InsertableRelation.The gross part is that we're in physical land, but the InsertableRelation tak...    Author: Burak Yavuz , 2020-01-03, 00:08
Issues with Delta Lake on 3.0.0 preview + preview 2 - Spark - [mail # dev]
...I can't imagine any Spark data source using Spark internals compiled onSpark 2.4 working on 3.0 out of the box. There are many braking changes.I'll try to get a *dev* branch for 3.0 soon (mi...
   Author: Burak Yavuz , 2019-12-30, 14:43