Syncsort, a global leader in Big Data and mainframe software, announced new capabilities in its industry leading data integration software, DMX-h, that for the first time, allow organizations to work with mainframe data in Hadoop or Spark in its native format ̶ essential for maintaining data lineage and compliance.
With its latest release, Syncsort also introduced the new high-speed DMX Data FunneI, which customers use to quickly ingest hundreds of database tables from sources like DB2 at the push of a button, dramatically reducing the time and effort to populate their Enterprise Data Hubs.
The largest organizations want to leverage the scalability and cost benefits of Big Data platforms like Apache Hadoop and Apache Spark to drive real-time insights from previously unattainable mainframe data, but they have faced significant challenges around accessing that data and adhering to compliance requirements,” said Tendü Yoğurtçu, General Manager of Syncsort’s Big Data business. “Our customers tell us we have delivered a solution that will allow them to do things that were previously impossible. Not only do we simplify and secure the process of accessing and integrating mainframe data with Big Data platforms, but we also help organizations who need to maintain data lineage when loading mainframe data into Hadoop.”
Many companies in highly-regulated industries, such as banking, insurance and healthcare, have struggled with utilizing Hadoop or Spark to cost-effectively analyze massive volumes of mainframe data because they’re required to preserve the data in its original EBCDIC format, which could not be processed in Hadoop. These organizations can now leverage the benefits of Big Data platforms to quickly analyze mainframe data just as they do with data from any other source, without requiring specialized skills to do so.
Another significant hurdle facing mainframe users is getting the data into Hadoop. One customer, Guardian Insurance, has the challenge of moving over 1TB of data into their Hadoop data lake very rapidly – a task that used to require one table to be moved at a time. With the new Data Funnel, they can now take hundreds of tables, and in one step, load them into Hadoop’s Distributed File System (HDFS).
With new support for Fujitsu NetCOBOL, Syncsort delivers these benefits for both IBM z Systems and Fujitsu mainframes, responding to strong demand in Asia Pac and CEMEA markets.
Syncsort continues to leverage their Mainframe and Big Data expertise to solve complex technology issues that prevent organizations from leveraging Hadoop and Spark to store, process and analyze their mainframe data,” said George Gilbert, Lead Big Data Analyst, Wikibon. “Syncsort’s new features don’t require hard-to-find skills that companies don’t want to spend money and time to acquire.”
Sign up for the free insideBIGDATA newsletter.