> For the complete documentation index, see [llms.txt](https://note.levelcode.org/software-engineering-notes/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://note.levelcode.org/software-engineering-notes/messaging/brokers/kafka.md).

# Kafka

{% embed url="<https://youtu.be/aj9CDZm0Glc?si=1XZL0MXS3gxY9-ss>" %}

{% embed url="<https://youtu.be/Ch5VhJzaoaI?si=MoKaPVBl4znibyp5>" %}
<https://strimzi.io/docs/operators/latest/overview#kafka-concepts_str>
{% endembed %}

{% embed url="<https://medium.com/inspiredbrilliance/kafka-basics-and-core-concepts-5fd7a68c3193>" %}

Strimzi also wrote about kafka here <https://strimzi.io/docs/operators/latest/overview#kafka-concepts_str>

## Note

* If you set a topic's consumer to autoscale (by using k8 or similar orchestrator), you must make sure that the max pod is no more than the amount of the topic's partition.
  * This is because of each topic's partition can only be assigned to one subscriber.
* It is okay for your consumer to be less than the topic's partition amount, because each consumer can handle multiple partitions from the same topic.