💻
Software Engineering Notes
  • Introduction
  • Event-Sourcing
  • CQS and CQRS
  • Domain-Driven Design
    • Overview
    • Business Domain
    • Subdomain
    • Bounded Context
      • Interaction Between Contexts
    • Layers
      • Domain Layer
      • Application Layer
      • Infrastructure Layer
  • Database
    • In-Memory (Redis)
    • Search Engine (Elasticsearch)
    • Column-Oriented (Cassandra)
    • Document-Oriented (MongoDB)
  • Messaging
    • Brokers
      • Kafka
  • Race Condition
  • Concurrency vs Parallelism
  • API Architectural Styles
    • gRPC
  • Language & Framework Specific Notes
    • Go (Golang)
Powered by GitBook
On this page
  1. Messaging
  2. Brokers

Kafka

PreviousBrokersNextRace Condition

Last updated 1 year ago

Note

  • If you set a topic's consumer to autoscale (by using k8 or similar orchestrator), you must make sure that the max pod is no more than the amount of the topic's partition.

    • This is because of each topic's partition can only be assigned to one subscriber.

  • It is okay for your consumer to be less than the topic's partition amount, because each consumer can handle multiple partitions from the same topic.

Strimzi also wrote about kafka here

https://strimzi.io/docs/operators/latest/overview#kafka-concepts_str
https://strimzi.io/docs/operators/latest/overview#kafka-concepts_str
Kafka Basics and Core conceptsMedium
Logo