How To Create A Kafka Schema

Introduction

Code

In this guide, you will learn how to create a Kafka Avro Schema in the Hopsworks Schema Registry.

Step 1: Get the Kafka API

import hopsworks

project = hopsworks.login()

kafka_api = project.get_kafka_api()

Step 2: Define the schema

Define the Avro Schema, see types for the format of the schema.

schema = {
    "type": "record",
    "name": "tutorial",
    "fields": [
        {
            "name": "id",
            "type": "int"
        },
        {
            "name": "data",
            "type": "string"
        }
    ]
}

Step 3: Create the schema

Create the schema in the Schema Registry.

SCHEMA_NAME="schema_example"

my_schema = kafka_api.create_schema(SCHEMA_NAME, schema)

API Reference

KafkaSchema

Conclusion

In this guide you learned how to create a Kafka Schema.