incremental-batch-processing

  • ์ฆ๋ถ„๋ฐฐ์น˜

  • ๋ฐ์ดํ„ฐ ๋ฒ ์ด์Šค์—์„œ ๋ณ€๊ฒฝ๋œ ๋ฐ์ดํ„ฐ๋งŒ ๋ฐฐ์น˜์ž‘์—…์„ ํ†ตํ•ด ์ฒ˜๋ฆฌํ•˜๋Š” ๋ฐฉ์‹

๊ตฌํ˜„ ๋ฐฉ๋ฒ•

  • [[transaction]] - id๋ฅผ ํ†ตํ•ด ๋ณ€๊ฒฝ๋œ ๋ฐ์ดํ„ฐ ์‹๋ณ„ํ•˜๋Š” ๋ฐฉ๋ฒ•

  • timestamp ๋ฅผ ํ†ตํ•ด ๋ณ€๊ฒฝ๋œ ๋ฐ์ดํ„ฐ ์‹๋ณ„

  • database log ๋ฅผ ํ†ตํ•ด ๋ณ€๊ฒฝ๋œ ๋ฐ์ดํ„ฐ ์‹๋ณ„

์ฐธ๊ณ 

  • https://cwiki.apache.org/confluence/display/KAFKA/KIP-95%3A+Incremental+Batch+Processing+for+Kafka+Streams

  • https://en.wikipedia.org/wiki/Incremental_computing

PreviousDomain?Nextmapped-by

Last updated