Sign up for our newsletter and get the latest big data news and analysis.

Apache Hadoop® Distributions Now ODPi Runtime Compliant

ODPi_logoHadoop Summit 2016 News

ODPi, a nonprofit organization accelerating the open ecosystem of big data solutions, announced that the Apache Hadoop® distributions products from Altiscale, ArenaData, Hortonworks, IBM, and Infosys are now ODPi Runtime Compliant. This ensures that their distributions provide big data application vendors a consistent set of base level expectations as defined by ODPi Runtime specification.

Our members represent all key roles in the big data ecosystem – Apache Hadoop distros, ISVs, system integrators, solution providers and end users – and have brought their real-world experience in helping to align enterprise demands with the developer community,” said John Mertic, director of program management for ODPi. “Having Altiscale, ArenaData, Hortonworks, IBM, and Infosys declare compliance with the ODPi Runtime Specification is a strong step toward simplifying and standardizing the big data ecosystem to accelerate the delivery of business outcomes.”

ODPi’s work complements the Apache Software Foundation and helps companies use Apache Hadoop more effectively. The organization’s aim is to develop a cross-industry standard that enables developers to easily write applications that sit on top of big data stacks, lowering the costs of interoperability across systems.

ODPi Compliant Guidelines and Testing

Descending from Apache Hadoop 2.7, the Runtime Specification covers HDFS, YARN, and MapReduce components. It specifies how Apache components should be installed and configured and provides a set of tests for validation to make it easier to create big data solutions and data-driven applications.

To become ODPi compliant, the Apache Hadoop distributions submitted test results through a GitHub repository for specific products. To assist with compliance, ODPi provides a test suite and a reference build. The ODPi validation test suite guarantees that a distribution of Apache Hadoop from a compliant vendor or an end-user deployment of Apache Hadoop complies with the ODPi-defined specifications. The test framework and self-certification aligns closely with the Apache Software Foundation by leveraging Apache BigTop for comprehensive packaging, testing, and configuration.

We are proud to become ODPi Runtime compliant, which aligns with our Hortonworks Data Platform certification program, said Alan Gates, co-founder, Hortonworks. The ODPi common reference specs should lower the investment for application builders and increase the number of applications in the ecosystem, allowing us to provide greater value to our customers.”

Participation in the ODPi is open to anyone, with all work being done is public on GitHub. Developers can join the conversation on the mailing lists or Slack channel, as well as give feedback on the spec or provide tests for validating ODPi compliance.

What’s Next for ODPi

The ODPi Operations Specification to help enterprises improve installation and management of Apache Hadoop and Apache Hadoop-based applications will be available later this year. The Operations Specification leverages Apache Ambari as a reference project. Apache Ambari is an ASF project for provisioning, managing, and monitoring Apache Hadoop clusters.

 

Sign up for the free insideBIGDATA newsletter.

Leave a Comment

*

Resource Links: