clear query| facets| time Search criteria: .   Results from 1 to 10 from 65 (0.0s).
Loading phrases to help you
refine your search...
[HADOOP-15780] S3Guard: document how to deal with non-S3Guard processes writing data to S3Guarded buckets - Hadoop - [issue]
...Our general policy for S3Guard is this: All modifiers of a bucket that is configured for use with S3Guard, must use S3Guard. Otherwise, the MetadataStore will not be properly updated as the ...    Author: Aaron Fabbri , 2018-09-21, 00:46
[HADOOP-15621] s3guard: implement time-based (TTL) expiry for DynamoDB Metadata Store - Hadoop - [issue]
...Similar to HADOOP-13649, I think we should add a TTL (time to live) feature to the Dynamo metadata store (MS) for S3Guard.This is a similar concept to an "online algorithm" version of the CL...    Author: Aaron Fabbri , 2018-09-21, 00:31
[HADOOP-15779] S3guard: add inconsistency detection metrics - Hadoop - [issue]
...S3Guard uses a trailing log of metadata changes made to an S3 bucket to add consistency to the eventually-consistent AWS S3 service. We should add some metrics that are incremented when we d...    Author: Aaron Fabbri , 2018-09-21, 00:28
[VOTE] Merge HADOOP-15407 to trunk - Hadoop - [mail # dev]
...+1 (Binding). Haven't thoroughly reviewed all the new code but successfullyran all the integration and unit tests today. Based on the progress thislooks ready to merge.  Good work folks...
   Author: Aaron Fabbri , 2018-09-20, 03:15
[HADOOP-15754] s3guard: testDynamoTableTagging should clear existing config - Hadoop - [issue]
...I recently committed HADOOP-14734 which adds support for tagging Dynamo DB tables for S3Guard when they are created. Later, when testing another patch, I hit a test failure because I still h...    Author: Aaron Fabbri , 2018-09-17, 22:12
[HADOOP-14927] ITestS3GuardTool failures in testDestroyNoBucket() - Hadoop - [issue]
...Hit this when testing for the Hadoop 3.0.0-beta1 RC0.hadoop-3.0.0-beta1-src/hadoop-tools/hadoop-aws$ mvn clean verify -Dit.test="ITestS3GuardTool*" -Dtest=none -Ds3guard -Ddynamo...Failed te...    Author: Aaron Fabbri , 2018-09-12, 15:16
[HADOOP-14468] S3Guard: make short-circuit getFileStatus() configurable - Hadoop - [issue]
...Currently, when S3Guard is enabled, getFileStatus() will skip S3 if it gets a result from the MetadataStore (e.g. dynamodb) first.I would like to add a new parameter fs.s3a.metadatastore.get...    Author: Aaron Fabbri , 2018-08-29, 17:06
[HADOOP-14936] S3Guard: remove "experimental" from documentation - Hadoop - [issue]
...I think it is time to remove the "experimental feature" designation in the site docs for S3Guard.  Discuss....    Author: Aaron Fabbri , 2018-08-09, 09:02
[HADOOP-15400] Improve S3Guard documentation on Authoritative Mode implementation - Hadoop - [issue]
...Part of the design of S3Guard is support for skipping the call to S3 listObjects and serving directory listings out of the MetadataStore under certain circumstances.  This feature is called ...    Author: Aaron Fabbri , 2018-08-08, 04:52
[HADOOP-13761] S3Guard: implement retries for DDB failures and throttling; translate exceptions - Hadoop - [issue]
...Following the S3AFileSystem integration patch in HADOOP-13651, we need to add retry logic.In HADOOP-13651, I added TODO comments in most of the places retry loops are needed, including: open...    Author: Aaron Fabbri , 2018-07-31, 22:14