clear query| facets| time Search criteria: .   Results from 11 to 20 from 63 (0.0s).
Loading phrases to help you
refine your search...
[BEAM-3966] Move core utilities into a new top-level module - Beam - [issue]
...As part of a longer-term dependency cleanup, fn-execution and similar utilities should be moved into a new top-level module (util?) that can be shared among runner and/or SDK code while clea...    Author: Ben Sidhom , 2018-09-03, 18:14
[BEAM-3672] FlinkRunner: Implement an Artifact service using the Flink DistributedCache - Beam - [issue]
...We need to have a DistributedCache-based artifact service to ship with the portable Flink runner. The DistributedCache is a perfect fit for Flink because it comes for free and is the mechani...    Author: Ben Sidhom , 2018-08-22, 15:57
[BEAM-3673] FlinkRunner: Harness manager for connecting operators to SDK Harnesses - Beam - [issue]
...SDK harnesses require a common set of gRPC services to operate. The role of the harness manager is to provide a uniform interface that multiplexes data streams and auxiliary data between SDK...    Author: Ben Sidhom , 2018-08-22, 03:10
[BEAM-4148] Local server api descriptors contain urls that work on Mac and Linux - Beam - [issue]
...Docker for Mac does not allow host networking and thus will not allow SDK harnesses to access runner services via `localhost`. Instead, a special DNS name is used to refer to the host machin...    Author: Ben Sidhom , 2018-08-04, 00:19
[BEAM-4147] Abstractions for artifact delivery via arbitrary storage backends - Beam - [issue]
...We need a way to wire in arbitrary runner artifact storage backends into the job server and through to artifact staging on workers. This requires some new abstractions in front of the job se...    Author: Ben Sidhom , 2018-08-01, 22:30
[BEAM-4067] Java: FlinkPortableTestRunner: runs portably via self-started local Flink - Beam - [issue]
...The portable Flink runner cannot be tested through the normal mechanisms used for ValidatesRunner tests because it requires a job server to be constructed out of band and for pipelines to be...    Author: Ben Sidhom , 2018-08-01, 22:03
[BEAM-3971] Pipeline translation utilities should not use SDK construction classes - Beam - [issue]
...In general, portable runners will require access to pipeline information not available in rehydrated pipelines while constructing physical plans. Translation utilities should operate directl...    Author: Ben Sidhom , 2018-07-02, 19:52
[BEAM-3883] Python SDK stages artifacts when talking to job server - Beam - [issue]
...The Python SDK does not currently stage its user-defined functions or dependencies when talking to the job API. Artifacts that need to be staged include the user code itself, any SDK compone...    Author: Ben Sidhom , 2018-06-28, 23:09
[BEAM-4523] Implement Flink batch ExecutableStage context - Beam - [issue]
...The the ExecutableStage context is a wrapper for the job and stage bundle factories and pooled artifact sources. It should take care of caching the overall job bundle factory since we do not...    Author: Ben Sidhom , 2018-06-21, 21:11
[BEAM-4231] Runner utility for Coder instantiation - Beam - [issue]
...Portable runners need to instantiate coders for communicating with SDK harnesses in a consistent way. They cannot simply instantiate coders as defined by PCollections because some component ...    Author: Ben Sidhom , 2018-06-21, 21:10