clear query| facets| time Search criteria: .   Results from 1 to 10 from 32 (0.0s).
Loading phrases to help you
refine your search...
[HDFS-13777] [PROVIDED Phase 2] Scheduler in the NN for distributing DNA_BACKUP work. - HDFS - [issue]
...When the SyncService is running, it should periodically take snapshots, make a snapshotdiff, and then distribute DNA_BACKUP work to the Datanodes (See HDFS-13421). Upon completion of the wor...    Author: Ewan Higgs , 2018-09-13, 07:56
[HDFS-12478] [PROVIDED Phase 2] Command line tools for managing Provided Storage Backup mounts - HDFS - [issue]
...This is a task for implementing the command line interface for attaching a PROVIDED storage backup system (see HDFS-9806, HDFS-12090). The administrator should be able to mount a PROVIDED st...    Author: Ewan Higgs , 2018-09-10, 19:16
[HDFS-13579] Out of memory when running TestDFSStripedOutputStreamWithFailure testCloseWithExceptionsInStreamer - HDFS - [issue]
...When running  TestDFSStripedOutputStreamWithFailure testCloseWithExceptionsInStreamer we often get OOM errors. It's not every time, but it occurs frequently. We have reproduced this on a few...    Author: Ewan Higgs , 2018-08-16, 20:39
[HDFS-13794] [PROVIDED Phase 2] Teach BlockAliasMap.Writer `remove` method. - HDFS - [issue]
...When updating the BlockAliasMap we may need to deal with deleted blocks. Otherwise the BlockAliasMap will grow indefinitely.Therefore, the BlockAliasMap.Writer needs a method for removing bl...    Author: Ewan Higgs , 2018-08-10, 22:28
[HDFS-12665] [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb) - HDFS - [issue]
...The design of Provided Storage requires the use of an AliasMap to manage the mapping between blocks of files on the local HDFS and ranges of files on a remote storage system. To reduce load ...    Author: Ewan Higgs , 2018-08-06, 21:05
[HDFS-13421] [PROVIDED Phase 2] Implement DNA_BACKUP command in Datanode - HDFS - [issue]
...HDFS-13310 introduces an API for DNA_BACKUP. Here, we implement DNA_BACKUP command in Datanode. These have been broken up to make reviewing it easier....    Author: Ewan Higgs , 2018-08-01, 19:19
[HDFS-13186] [PROVIDED Phase 2] Multipart Uploader API - HDFS - [issue]
...To write files in parallel to an external storage system as in HDFS-12090, there are two approaches: Naive approach: use a single datanode per file that copies blocks locally as it streams d...    Author: Ewan Higgs , 2018-07-24, 17:00
[HDFS-13310] [PROVIDED Phase 2] The DatanodeProtocol should be have DNA_BACKUP to backup blocks - HDFS - [issue]
...As part of HDFS-12090, Datanodes should be able to receive DatanodeCommands in the heartbeat response that instructs it to backup a block.This should take the form of two sub commands: PUT_F...    Author: Ewan Higgs , 2018-07-23, 11:43
[HDFS-13698] [PROVIDED Phase 2] Provided ReplicaMap should be LRU with separate lookup from normal Replicas - HDFS - [issue]
...The existing ReplicaMap uses ExtendedBlock to lookup the replica information. However, Provided replicas should not be in the ReplicaMap; instead they should be lookups in the AliasMap. In o...    Author: Ewan Higgs , 2018-06-25, 10:35
[HDFS-13606] [PROVIDED Phase 2] Implement full resync command for syncservice - HDFS - [issue]
...In the unlikely event of an operator error such that the sync service external storage system has data removed from it, there should be a command line tool to repair it through a full resync...    Author: Ewan Higgs , 2018-05-23, 12:45