In today's rapidly evolving data landscape, you as NonStop technical professionals understand the challenges of bridging the gap between your high-availability systems and the diverse ecosystem of contemporary data tools. uLinga for Kafka addresses this precise challenge, providing a robust, reliable bridge between NonStop applications and Apache Kafka's powerful distributed streaming capabilities. With our latest release featuring significant WebCon UI enhancements, we've made it even easier to implement, manage, and monitor these critical integrations while maintaining the performance and reliability your NonStop environments demand.
Apache Kafka Overview
Apache Kafka is an open-source distributed streaming system used for stream processing, real-time data pipelines, and data integration at scale. It offers a scalable and fault-tolerant platform for handling large volumes of data, making it ideal for applications requiring immediate insights and high throughput. Kafka's benefits include its ability to handle trillions of messages daily, support for distributed streaming, and a rich set of third-party product connectors for easy integration.
uLinga for Kafka
uLinga for Kafka from Infrasoft integrates NonStop applications and data with Kafka, offering robust capabilities in integration and data transformation. This integration enhances real-time data processing and analytics by connecting NonStop systems with Kafka clusters seamlessly.
Key Use Cases for uLinga and Kafka
uLinga for Kafka enables NonStop systems to seamlessly integrate with Kafka, unlocking powerful use cases across industries. Here are some examples:
- Change Data Capture (CDC): uLinga for Kafka facilitates the capture of changes from NonStop databases and streams them to other data platforms ensuring real-time data synchronization across different systems. This capability is crucial for maintaining data consistency and supporting advanced analytics.
- Application Integration with Cloud Service and Service Buses: uLinga for Kafka can integrate NonStop applications with services like Salesforce or Mulesoft, enabling efficient data exchange and workflow automation between diverse systems. This integration enhances interoperability and supports complex business processes.
- Asynchronous Messaging Interface for E-Commerce Platforms: By leveraging Kafka's event streaming architecture, uLinga allows NonStop systems to replace traditional synchronous communication with event-driven workflows. This enables real-time updates across order management, inventory tracking, and customer notifications.
Exciting New WebCon UI Features
WebCon is the browser-based user interface included with all uLinga products, designed to simplify resource management and monitoring. It is served directly by the uLinga process running under Guardian, eliminating the need for additional web server software or OSS components.
WebCon supports all essential uLinga command and control operations, while also offering advanced functionalities for configuration and monitoring. This intuitive interface ensures users can efficiently manage their Kafka integrations without requiring additional tools or complex setups. uLinga for Kafka now offers exciting new features in its WebCon administrative user interface.
Traffic Light Status Indicators: Instant Resource Monitoring
A new feature in WebCon includes "traffic light" status indicators, allowing users to instantly identify resources that are started, stopped, or in an abnormal state.
- Green: Indicates that the resource is active and functioning normally.
- Red: Signals that the resource is stopped or inactive.
- Yellow: Highlights resources in an abnormal or warning state, requiring attention.
This visual feedback allows administrators to quickly identify which components are running smoothly and which require intervention. It is particularly useful in large, complex configurations involving multiple interconnected resources like producers, consumers, file readers, and data transformers.
Resource Configuration Relationships: Visualizing Interconnected Resources
The Resource Configuration Relationships feature, introduced in the V3R2 release of uLinga for Kafka, offers a powerful way to visualize how resources interact within a configuration. This feature provides a graphical representation of resource dependencies, making it easier for administrators to understand and manage complex setups.
Key benefits of this feature include:
- Interactive Navigation: Each resource in the graphic is hyperlinked, allowing users to click through and explore related resources directly. This simplifies troubleshooting and configuration management by enabling quick access to detailed information about interconnected components.
- Dynamic Adjustments: The graphic dynamically adjusts based on the resource being viewed. Whether you are examining a producer, consumer, or other resource type, the visualization updates to reflect only relevant relationships.
- Streamlined Management: By providing a clear overview of how resources are connected, administrators can ensure consistency across configurations and quickly identify potential issues or misconfigurations.
Data Transformation: Streamlining Data Processing with uLinga
The Data Transformation feature in uLinga for Kafka has been significantly enhanced, making it easier than ever to configure, test, and deploy data transformation processes. This functionality is crucial for organizations that need to convert data formats—such as transforming NonStop fixed-structure data into JSON objects for Kafka topics. The updated WebCon interface provides a streamlined, user-friendly experience.
Key Features of the Data Transformation Tab
Flexible Configuration Options
The Data Transformation tab allows users to create or modify data transformation configurations with multiple options.
- Load from DATATRANSFORMER Resource: Retrieve existing configurations directly from a DATATRANSFORMER resource.
- Generate from Schema: Automatically generate a configuration using NonStop DDL definitions or other schema formats.
- Create from Scratch: Build a new configuration manually, offering complete flexibility for custom use cases.
Users can easily select their preferred method and begin configuring their data transformations with just a few clicks.
Intuitive Mapping Interface
The mapping interface provides a clear layout for defining input-to-output transformations. Users can map fields between input data structures (e.g., Enscribe files or binary formats) and output formats (e.g., JSON). Each mapping is displayed in an organized table, allowing users to quickly identify and adjust mappings as needed.
Preview Data Transformation
One of the most powerful enhancements is the Preview Data Transformation feature, which allows users to test their configurations with real data before deploying them. Input data can be provided in raw text or retrieved directly from an Enscribe file on the NonStop host. The preview displays transformed output in real time, helping users validate their configurations.
- Users can specify input and output formats (e.g., Binary to JSON).
- The preview displays transformed output in real time, helping users validate their configurations.
In this example, raw input text (ABCA12 123456789) is transformed into a structured JSON object with nested keys (JOBS-KEY, JOBS-ZIP), showcasing how uLinga simplifies complex data transformations.
Benefits of Enhanced Data Transformation
- Efficiency: Automates complex data conversion tasks, reducing manual effort.
- Accuracy: Real-time previews help eliminate errors before deployment.
- Flexibility: Supports various input/output formats and custom mapping requirements.
- Integration: Simplifies interoperability between NonStop systems and modern platforms like Kafka.
Success Story: US Foods and uLinga for Kafka
In the January-February 2025 issue of Connection Magazine, Dale Hiatt highlighted US Foods' implementation of uLinga for Kafka, demonstrating the power and flexibility of integrating NonStop systems with modern event streaming platforms. By leveraging Kafka Producers and Consumers, US Foods has streamlined workflows, enabled real-time data processing, and achieved seamless communication between legacy systems and cloud-based applications. Their use of uLinga's Data Transformer to convert fixed-structure data into JSON messages has further enhanced their ability to publish and consume data efficiently.
Conclusion
These uLinga for Kafka enhancements and success stories reflect Infrasoft's commitment to delivering user-driven improvements that address real-world needs. With uLinga for Kafka, technical managers can rely on a reliable and adaptable tool for their Kafka integration requirements, knowing that Infrasoft is dedicated to excellence and continuous innovation based on customer feedback.
