clear query| facets| time Search criteria: .   Results from 1 to 10 from 961 (0.0s).
Loading phrases to help you
refine your search...
[expand - 1 more] - Ingesting from KafkaIO into HDFS, problems with checkpoint and data lost on top of yarn + spark - Beam - [mail # user]
...> I am curious about what you mentioned (30min of 1hr window would belost), just a noob question, why?Say you have 1 hour windowing in your pipeline. The aggregation is emittedat the end ...
   Author: Raghu Angadi , 2018-10-02, 15:58
[expand - 2 more] - Kafka Avro Schema Registry Support - Beam - [mail # user]
...Looks like your producer writing a Avro specfic records.Can you read the records using bundled console consumer? I think it will besimpler for you to get it returning valid records and use t...
   Author: Raghu Angadi , 2018-09-28, 16:58
Is Splittable DoFn suitable for fetch data from a socket server? - Beam - [mail # dev]
...> This in-house built socket server could accept multiple clients, but onlysend messages to the first-connected client, and will send messages to thesecond client if the first one disconn...
   Author: Raghu Angadi , 2018-09-21, 23:01
[BEAM-5412] TFRecordIO fails with records larger than 8K - Beam - [issue]
...This was reported on Stackoverflow. TFRecordIO reader assumes a single call to channel.read() returns as much as can fit in the input buffer. read() can return fewer bytes than requested. As...
http://issues.apache.org/jira/browse/BEAM-5412    Author: Raghu Angadi , 2018-09-21, 02:55
[ANNOUNCEMENT] New Beam chair: Kenneth Knowles - Beam - [mail # dev]
...Congrats Kenn!On Wed, Sep 19, 2018 at 12:54 PM Davor Bonaci  wrote:> Hi everyone --> It is with great pleasure that I announce that at today's meeting of the> Foundation's Boar...
   Author: Raghu Angadi , 2018-09-20, 17:09
KafkaIO needs access to the brokers even before the pipeline reach the worker - Beam - [mail # user]
...This access is needed in order to determine number of partitions for atopic. If you know number of partitions already, you can provide a list ofpartitions manually and that avoids accessing ...
   Author: Raghu Angadi , 2018-09-19, 19:21
[expand - 12 more] - Problem with KafkaIO - Beam - [mail # user]
...On Wed, Sep 19, 2018 at 11:24 AM Juan Carlos Garcia wrote:> Sorry I hit the send button to fast... The error occurs in the worker.>Np. Just one more comment on it: it is a very importa...
   Author: Raghu Angadi , 2018-09-19, 18:37
[BEAM-5375] KafkaIO reader should handle runtime exceptions kafka client - Beam - [issue]
...KafkaIO reader might stop reading from Kafka without any explicit error message if KafkaConsumer throws a runtime exception while polling for messages. One of the Dataflow customers encounte...
http://issues.apache.org/jira/browse/BEAM-5375    Author: Raghu Angadi , 2018-09-18, 23:59
[expand - 1 more] - [VOTE] Release 2.7.0, release candidate #1 - Beam - [mail # dev]
...Thanks Charles. Sent cherry-pick for KafkaIO fix:https://github.com/apache/beam/pull/6421On Mon, Sep 17, 2018 at 10:18 AM Charles Chen  wrote:> Luke, Maximillian, Raghu, can you plea...
   Author: Raghu Angadi , 2018-09-18, 00:50
[expand - 1 more] - Donating the Dataflow Worker code to Apache Beam - Beam - [mail # dev]
...On Thu, Sep 13, 2018 at 12:53 PM Romain Manni-Bucau wrote:> If usable by itself without google karma (can you use a worker without> dataflow itself?) it sounds awesome otherwise it sou...
   Author: Raghu Angadi , 2018-09-13, 21:07