Event Stream Producer Runtime Environments

The prerequisites for all Event Stream Producer (ESP) runtime scenarios are as follows.

• Windows operating system for the Jade Platform database and capture process

• Event Stream Producer (ESP) component installed

• Azure Command Line Interface (Azure CLI) for Azure scenarios

• One of the following Infrastructure as Code (IaC) tools

  • Terraform

  • Pulumi

  • Ansible

  • Azure Bicep

  Using IaC tools like Terraform, Pulumi, Ansible, or Azure Bicep allows for version‑controlled, repeatable deployments. This is especially useful for maintaining consistency across development, testing, and production environments. Always follow security best practices when managing infrastructure and credentials.

Scenario 1: Development and Testing with Local Single Node Kafka Cluster

This scenario sets up a local development environment using a single‑node Kafka cluster, preferably using Kraft instead of ZooKeeper.

The development and testing with local single node Kafka cluster steps are as follows.

1. Install WSL2 on Windows. Follow the official Microsoft guide.

2. Set up Kafka in WSL2.

3. Start Kafka server.

4. Configure ESP to connect to local Kafka.

5. Run ESP and test event streaming. (The ESP and verify events are produced using a consumer, or tool, that can consume the stream.)

Additional Resources

Additional resources are as follows.

• Kafka documentation

• WSL2 documentation

Scenario 2: Windows VM in Azure with Azure Event Hubs

This scenario sets up ESP in an Azure Windows Virtual Machine (VM), connecting to Azure Event Hubs with Schema Registry and Azure Blob Storage.

The Windows VM in Azure with Azure Event Hubs steps are as follows.

1. Create a Terraform or Azure Bicep script to provision:

   1. Windows VM in Azure

   2. Azure Event Hubs namespace and hub

   3. Azure Schema Registry

   4. Azure Blob Storage account

2. Run the IaC script to create the infrastructure.

3. Install and configure ESP on the Windows VM. Consider using Ansible for this step.

4. Configure ESP to connect to Event Hubs, Schema Registry, and Azure Blob Storage.

5. Run ESP and verify event streaming.

Additional Resources

Additional resources are as follows.

• Azure Event Hubs documentation

• Azure Blob Storage documentation

• Terraform Azure Provider

• Azure Bicep documentation