Zaloni, a leading provider of peerless Hadoop software and services solutions, announced the Bedrock Data Management Platform™ 3.1. The newest version of the Bedrock platform focuses on data quality, operational improvements, an enhanced inventory dashboard, HDFS landing zone, query engine security updates, Impala, Spark, SparkSQL support, and new workflow actions.
Key to the enhancements in Bedrock 3.1 is the addition of the Hadoop Data Quality feature set. Enhancing the Bedrock managed data pipeline to include checking data for compliance to a user-defined set of quality rules adds to Bedrock’s ability to ensure that data in a Bedrock managed hadoop data lake is always organized, prepared and ready for users to consume.
Zaloni is widely recognized as providing the only fully integrated, single platform solution on top of Hadoop that integrates Data Ingestion, Organization, and Preparation with Metadata Management and Workflow. With this release, Zaloni increases the depth and breadth of the Bedrock platform, and further delivers on its promise to make it quicker and easier to ingest, manage and use data, and to realize faster time to business value.
The new functionality in Zaloni Bedrock 3.1 includes:
Hadoop Data Quality: Users can now define the rules that specify the expected structure and format of their data, then associate these rules with the metadata entity types they will ingest into Hadoop, and check the rules against the data as part of the preparation workflow.
Inventory Dashboard: Finding and managing access to datasets that have been ingested into Hadoop can become difficult, or in some cases impossible, if a Hadoop inventory is not captured and made available to data consumers. The Bedrock Inventory Dashboard now resolves this challenge by providing a familiar faceted search interface with both graphical and tabular views of Hadoop data inventory.
HDFS Landing Zone: Release 3.1 extends the managed data ingestion capabilities of Bedrock to support HDFS Landing Zones. While there are many tools that can copy data into Hadoop, most lack managed ingestion capability or metadata capture and management capability. The Bedrock landing zone architecture has now been extended to include directories that are inside of HDFS. This means that other tools can be used to move data into Hadoop; once in Hadoop, Bedrock provides the capability to see new data as it arrives and begins the managed data pipeline for that new data.
Spark and SparkSQL Support: Bedrock users now have full support for using Spark and SparkSQL as part of their data preparation workflows. This brings real-time, in-memory processing capability into the array of hadoop workflow options available to the Bedrock user.
Query Engine Updated to include Impala and Spark support: The Bedrock Query Engine provides the user advanced tools to build/design queries and then submit them for execution. With 3.1 Query Engine has been enhanced to support Spark and Impala as execution targets. This broadens the options for users wanting to use the latest and fastest Hadoop SQL query environments in conjunction with the Hadoop metadata management of Bedrock.
Query Engine Projects: Release 3.1 introduces the administrative concept of Projects. Projects are used to group datasets and associate user access to those datasets. This allows the Hadoop data lake to contain a wide variety of data from across the business, while providing the Hadoop administrator the ability to grant Bedrock Query Engine users access to only the data that they should see.
Bedrock CDC (Change Data Capture): As incremental updates are ingested into Hadoop they often need to be integrated into existing datasets. Bedrock CDC is completely metadata driven and automates the entire process of ingesting and integrating incremental updates to Hadoop datasets.
Operational Tools Update: Bedrock users benefit from a rich set of operational tools that make keeping a Hadoop Data Lake up and running easier. With 3.1 the Bedrock Notifications capability has been enhanced to support custom notification distribution lists and custom notification templates. This allows Hadoop administrators to notify the right people about the right activity at the right time, so that appropriate action can be taken.
We are committed to listening to, and working closely with, our customers,” said Ben Sharma, CEO of Zaloni. “Bedrock 3.1 includes a host of high value, customer requested features and enhancements that make it simpler and faster for end users to accelerate production and deployment of production Hadoop Data Lakes.”
Bedrock 3.2
Bedrock 3.2 is planned for Q2 2015 and will focus on delivering additional updates to Query Engine, adding Oracle GoldenGate integration for CDC, support for Avro data and integration with Flume for data ingestion.
Pricing & Availability
The latest Zaloni Bedrock release is generally available through the company’s direct sales representatives. Bedrock is licensed on a per Hadoop node basis. The license is an annual subscription license. Pricing is tiered, and options exist for multi-year agreements.
Sign up for the free insideBIGDATA newsletter.
Speak Your Mind