Real-Time Event Streaming with IBM Confluent Platform for Z and LinuxONE: Performance Validation at Enterprise Scale - ILOG SA
Explicit Guidance:
- No financial guidance (revenue, earnings, margins, capex, etc.) provided.
Business-Segment Outlook:
- Product Capability Releases: Native connectivity for Z subsystems (DB2, ZDIH, IMS, MQ) with the Confluent Platform is already General Available (GA) since March; additional business event refinery architecture capabilities were GA'd in November.
- Future Roadmap (Preview): Native Z/OS support for connectors and brokers (ZOS brokers, ZOS connectors) is planned for the first quarter of the upcoming year.
- Strategic Focus: Transitioning Z from a passive system of record to an active "first-class producer" of real-time business events, enabling AI agents to act on current data rather than stale batches.
Market and Competitive Outlook:
- Agentic AI Adoption: Gartner forecasts that by 2028, one-third of enterprise software applications will include agentic AI; by 2029, 80% of common customer service issues are expected to be resolved by these agents.
- Efficiency Shifts: Organizations anticipate a 30% reduction in service operating costs through agentic AI deployment by 2029, driven by the ability to act on real-time data.
- Competitive Gap: A significant market challenge exists where 75% of organizations plan to deploy agentic AI within two years, yet 91% lack full visibility into the data dependencies required to run them safely.
- Use Case Expansion: Emerging demand for sub-millisecond latency in trade finance, real-time fraud detection, and "live customer views" across all channels (branch, app, HQ) requiring immediate data consistency.
Macro / Industry Outlook:
- Data Freshness Requirement: Industry shift away from "yesterday's summary" data toward "truth right now"; legacy batch processing (overnight copies) is becoming a structural barrier to real-time decision-making (fraud, personalization).
- Regulatory/Trust Focus: Increasing necessity for data lineage, governance, and source verification to ensure AI agents act on trustworthy, context-rich data derived from Z transactions.
Strategic Initiatives:
- Architecture Evolution: Implementation of a "Business Event Refinery" architecture on IBM Z and Linux on Z, which correlates fragmented signals from multiple subsystems (KICS, IMS, DB2) into unified business events with embedded schema contracts and lineage.
- Performance Optimization: Planned transition from virtualized OpenShift deployments to containerized Confluent Kafka components; upcoming testing using 100 Gigabit integrated network adapters added to IBM Z17 Linux on Z 1.5.
- Deployment Models: Promotion of a "Hybrid Broker Architecture" where critical eventing occurs on Z/Linux on Z, with selective cluster linking to cloud or x86 platforms for specific use cases.
- Customer Engagement Strategy: Shift from generic product sales to active discovery, pilot/POC execution for high-value use cases (e.g., fraud, ledger management), and joint customer benchmarks to validate scale.
Risks and Headwinds to Outlook:
- Roadmap Volatility: IBM explicitly states that future roadmap items (e.g., Z/OS native brokers/connectors) are "subject to change" based on ongoing customer feedback.
- Performance Variability: Benchmarked results (e.g., 6x–8x lower P99 latency vs. open source) are specific to the "Open Messaging Benchmark" and may not generalize to all customer workloads due to parameter differences.
- Architectural Complexity: Moving from horizontal scaling (x86) to vertical scaling (Linux on Z) requires re-optimization of parameters (e.g., vCPU to broker ratios, linger times), as traditional x86 optimization strategies can degrade Z performance if applied directly.
- Data Lineage Gaps: Risk of fragmented governance and trust if downstream consumers receive raw row-level changes without business context, leading to "stale" or "context-poor" data for decision engines.
Management Tone on the Future:
- Confidence: High confidence in Z's capability to handle real-time eventing, evidenced by performance benchmarks showing significantly lower latency and reduced broker/core requirements compared to x86.
- Urgency: Strong emphasis on the immediacy of the AI opportunity; management frames agentic AI not as a "future trend" but as a "this year's plan" priority.
- Strategic Pivot: Confident positioning of IBM Z as the "source of truth" for AI agents, asserting that Z must announce business events in real-time to meet the 2028–2029 AI adoption curves.
Miscellaneous:
- Cost Efficiency: Anticipated reduction in egress costs as processing occurs on Z at "light speed," avoiding the need to ship raw data out of the Z ecosystem for transformation.
- Security: Leveraging IBM Z's hardware cryptography and isolation to provide "trust and residency" for sensitive event data.
- Resource Optimization: Ability to scale vertically on Z (fewer IFLs/brokers) reduces physical core management overhead compared to distributed x86 clusters.
- Company
- ILOG SA
- Keywords
- ILOG SA