clear query| facets| time Search criteria: *:*.   Results from 1 to 10 from 410 (0.0s).
Loading phrases to help you
refine your search...
[SPARK-32173] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp - Spark - [issue]
...The FromUTCTimestamp and ToUTCTimestamp expressions have similar implementation. The common code can be extracted to a common expression and re-used from those expressions....    Author: Maxim Gekk , 2020-07-11, 15:19
[SPARK-32273] Support ANSI dialect in MAKE_DATE and MAKE_TIMESTAMP - Spark - [issue]
...The MAKE_DATE and MAKE_TIMESTAMP functions should throw an exception for invalid parameters in the ANSI dialect (spark.sql.ansi.enabled is true) instead of NULLs....    Author: Maxim Gekk , 2020-07-10, 11:50
[SPARK-32209] Re-use GetTimestamp in ParseToDate - Spark - [issue]
...Replace the combination of expressions SecondsToTimestamp and UnixTimestamp by GetTimestamp in ParseToDate. This will allow to eliminate unnecessary parsing overhead in: string -> timesta...    Author: Maxim Gekk , 2020-07-07, 14:27
[SPARK-31579] Replace floorDiv by / in localRebaseGregorianToJulianDays() - Spark - [issue]
...Most likely utcCal.getTimeInMillis % MILLIS_PER_DAY == 0 but need to check that for all available time zones in the range of [0001, 2100] years with the step of 1 hour or maybe small...    Author: Maxim Gekk , 2020-07-06, 06:34
[SPARK-26246] Infer timestamp types from JSON - Spark - [issue]
...Currently, TimestampType cannot be inferred from JSON. To parse JSON string, you have to specify schema explicitly if JSON input contains timestamps. This ticket aims to extend JsonInferSche...    Author: Maxim Gekk , 2020-07-01, 15:14
Apache Spark 3.1 Feature Expectation (Dec. 2020) - Spark - [mail # dev]
...Hi Dongjoon,I would add:- Filters pushdown to JSON ( Filters pushdown to other datasources like Avro- Support nested attributes of filters pushed ...
   Author: Maxim Gekk , 2020-06-29, 16:31
Spark 3.0 almost 1000 times slower to read json than Spark 2.4 - Spark - [mail # user]
...Hello Sanjeev,It is hard to troubleshoot the issue without input files. Could you open anJIRA ticket at and attach theJSON files there (or sampl...
   Author: Maxim Gekk , 2020-06-29, 15:21
[SPARK-32108] Silent mode of spark-sql is broken - Spark - [issue]
...1. I download the recent release Spark 3.0 from Run bin/spark-sql -S, it prints a lot of INFO➜  ~ ./spark-3.0/bin/spark-sql -S20/06/26 20:43:38 ...    Author: Maxim Gekk , 2020-06-28, 08:50
[SPARK-32071] Benchmark make_interval - Spark - [issue]
...Add benchmarks for interval constructor - make_interval. To goal is to have a base line for future perf improvements of make_interval....    Author: Maxim Gekk , 2020-06-28, 00:54
[expand - 1 more] - [Spark SQL] Question about support for TimeType columns in Apache Parquet files - Spark - [mail # dev]
...Hi Bart,> Isn't it a best practice to have those event timestamps be recorded inUTC?The triple (date, time, time zone) from my examples can be mapped totimestamp in UTC w/o ambigues (almo...
   Author: Maxim Gekk , 2020-06-26, 13:38