Skip to navigation
ExtensibilityMediationMeter ComponentsSources and TargetsKafka as a source

Configure Kafka as a source

View as Markdown

Learn how to configure custom meters to use Apache Kafka as a source, including setting up connections, selecting topics, and configuring data formats.

1

Navigate to Mediation > Meters

2

Create a Custom meter.

3

Select Kafka as the source. The Kafka settings page is displayed.

Kafka source settings

4

Click Select to select an Event Definition on the Kafka settings page. Only event schema import from an AVSC schema is supported.

5

Under the Kafka Settings section, configure the following settings:

Setting

Configuration

Connection

Select a connection from the Connection drop-down list. To set up a connection, see Create Kafka connections in meters.

Topic

Select a topic from Apache Kafka for event ingestion.

Data Format

Select a data format from the Kafka events. You must ensure that all the events in the Kafka topic must be in the same format, else the message ingestion fails.

For example, use the event definition generated from the AVRO data file for the AVRO data format.

Offset Reset Strategy

Select a value from the following options:

  • Latest: Selecting this option causes the meter to ignore the existing data events in the Kafka topic and only ingest the new events added to the topic.
  • Earliest: Selecting this option makes the meter ingest all the data events, including the existing data in the Kafka topic, and the new events added to the topic path.
6

Click Save to save the Kafka source settings.