SAN FRANCISCO, CA: Hortonworks, a leading innovator of open and connected data platforms, has partnered with Hewlett Packard Labs, the central research organization of Hewlett Packard Enterprise, to enhance Apache Spark.

With the blazing growth in data business, faster data processing is the need, Apache Spark is an open source cluster computing framework which helps processing multiple petabytes of data.

Enhanced shuffle engine technologies which will help in faster sorting and in-memory computations, thatwill dramatically improve Spark performance, better memory utilization will improve performance and usage for broader scalability, which will help enable new large-scale use cases.

“We're hoping to enable the Spark community to derive insight more rapidly from much larger data sets without having to change a single line of code," says Martin Fink, EVP and CTO, Hewlett Packard Enterprise and Hortonworks Board Member. "We're very pleased to be able to work with Hortonworks to broaden the range of challenges that Spark can address."

Hortonworks is an industry leading innovator that creates, distributes and supports enterprise-ready open data platforms and modern data applications. Hortonworks provides the expertise, training and services that allow customers to unlock transformational value for their organizations across any line of business.