Subject: [DISCUSS] KIP-317 - Add end-to-end data encryption functionality to Apache Kafka

  Sönke Liebau 2020-04-28, 23:26
Tom, good point, I've done exactly that -- hashing record keys -- but it's
unclear to me what should happen when the hash key must be rotated. In my
case the (external) solution involved rainbow tables, versioned keys, and
custom materializers that were aware of older keys for each record.

In particular I had a pipeline that would re-key records and re-ingest
them, while opportunistically overwriting records materialized with the old

For a native solution I think maybe we'd need to carry around any old
versions of each record key, perhaps as metadata. Then brokers and
materializers can compact records based on _any_ overlapping key, maybe?
Not sure.


On Thu, May 7, 2020, 12:05 PM Tom Bentley <[EMAIL PROTECTED]> wrote:
  Tom Bentley 2020-05-07, 17:42
  Ryanne Dolan 2020-05-09, 21:05
  Maulin Vasavada 2020-05-09, 22:12
  Adam Bellemare 2020-05-09, 16:00
  Tom Bentley 2020-05-01, 16:19
  Sönke Liebau 2020-05-01, 22:18
  Tom Bentley 2020-05-07, 13:37
  Michael André Pearce 2020-05-07, 15:02
  Michael André Pearce 2020-05-07, 15:02
  Ryanne Dolan 2020-05-07, 16:10
  Tom Bentley 2020-05-07, 17:05
  Sönke Liebau 2020-05-08, 09:05
  Adam Bellemare 2020-05-10, 23:53
  Ryanne Dolan 2020-05-16, 17:54
  Adam Bellemare 2020-05-16, 14:04