Apache Kafka - ArchWiki

Jump to content

# Apache Kafka

From ArchWiki

Apache Kafka is a distributed streaming platform that:

1. Lets you publish and subscribe to streams of records. In this respect it is similar to a message queue or enterprise messaging system.
2. Lets you store streams of records in a fault-tolerant way.
3. Lets you process streams of records as they occur.

## Installation

Install the kafka package.

Start `kafka.service`, which should also automatically start/enable `zookeeper@kafka.service` as well.

## Confluent Platform

To use the Confluent Platform or Confluent Server, install the confluent-platformAUR package. confluent-platformAUR install the following services:

- ksqlDB - `confluent-ksqldb.service`
- Schema Registry - `confluent-schema-registry.service`
- REST Proxy - `confluent-kafka-rest.service`
- Confluent Control Center - `confluent-control-center.service`
- Confluent Server - `confluent-server.service`

## Usage

For usage see official documentation

## Clients

- C - librdkafka-gitAUR
- PHP - php-rdkafkaAUR
- Python - https://github.com/dpkp/kafka-python
- .Net - https://github.com/confluentinc/confluent-kafka-dotnet
- Go - https://github.com/confluentinc/confluent-kafka-go

For additional clients, see the official client list.

Categories:

- Development
- Apache

Apache Kafka
Add topic