Sign up for our newsletter and get the latest big data news and analysis.

Developing a Deeper Understanding of Apache Kafka Architecture Part 2: Write and Read Scalability

In this contributed article, Paul Brebner, Tech Evangelist at Instaclustr provides Part 2 of his two-part series on Apache Kafka. In Par 1 we gained an understanding of the main Kafka components and how Kafka consumers work. Now, we’ll see how these contribute to the ability of Kafka to provide extreme scalability for streaming write and read workloads.

Developing a Deeper Understanding of Apache Kafka Architecture

In this contributed article, Paul Brebner, Tech Evangelist at Instaclustr provides an understanding of the main Kafka components and how Kafka consumers work. The Apache Kafka distributed streaming platform features an architecture that – ironically, given the name – provides application messaging that is markedly clearer and less Kafkaesque when compared with alternatives.

Slidecast: Striim – Streaming Integration with Intelligence

Coming to you from our popular “Rich Report Podcast” channel, we offer a new slidecast with Steve Wilkes, Co-founder and CTO at Striim presenting: Striim – Streaming Integration with Intelligence. Striim recently announced the launch of version 3.8 of the Striim platform, with 47 new and enhanced capabilities.

Stream Sees Increase in Globally Deployed Enterprise Applications, Garnering Launch of Stream 2.0

Stream, a leading feed and activity stream platform for developers and product leaders, announced the next generation of its API, allowing organizations to build highly performant newsfeeds. This enhancement further strengthens Stream’s mission to deliver reliable, scalable and modern feed technology to its customers.

Keen IO Adds Real-Time Data Streaming to Google BigQuery Enterprise Data Warehouses

Keen IO, the data analytics platform company, announced it has been named a Google Cloud Platform Technology Partner and the availability of a new real-time event data streaming service for Google BigQuery. Keen IO Stream to BigQuery enables organizations to stream and enrich data from any source to BigQuery data warehouses for enhanced analytics and business intelligence applications.

data Artisans Unveils Turnkey Real-Time Stream Processing for Enterprises

data Artisans, founded by the original creators of Apache Flink®, announced dA Platform 2, the next generation of its enterprise stream processing platform. Featuring the Application Manager, the new release productionizes stream processing and enables companies to provide real-time data applications as a centralized enterprise service.

Arcadia Data Announces Native Visual Analytics on Real-Time Streaming Data

Arcadia Data, provider of the native visual analytics software for big data, announced upcoming support for KSQL, a new technology for continuous, interactive queries on Kafka topics via SQL, which was announced today by Confluent. The integration gives all users advanced visualizations for streaming data use cases, specifically around alerts and time-based data exploration (and drill downs). The integration will be available in Arcadia Enterprise later this year.

End-to-End, SQL-based Streaming Data Platform Simplifies and Speeds Delivery of Kafka-driven Analytics Applications

Striim, Inc., provider of a leading end-to-end, real-time data integration and streaming analytics platform, announced that it has launched version 3.7.4 of the Striim™ platform, bolstering its ease of use, connectivity, manageability, and scalability for delivering streaming analytics applications involving Apache Kafka.

Unravel Data Adds Native Support for Impala and Kafka

Unravel Data, the Application Performance Management (APM) platform designed for Big Data, announced that it has integrated support for Cloudera Impala and Apache Kafka into its platform, allowing users to derive the maximum value from those applications. Unravel continues to offer the only full-stack solution that doesn’t just monitor and unify system-level data, but rather tracks, correlates, and interprets performance data across the full-stack in order to optimize, troubleshoot, and analyze from a single pane.

Interview: Gwen Shapira, System Architect at Confluent

I recently caught up with Gwen Shapira, System Architect at Confluent, to talk about the market dynamics of new “fast data” technologies and what is driving its rapid adoption across large companies.