Hortonworks Data Platform for Enterprise Data Lakes delivers robust, big data analytics that accelerate decision making and innovation

IBM United States Software Announcement 218-187
March 20, 2018


Table of contents
OverviewOverviewPublicationsPublications
Key prerequisitesKey prerequisitesTechnical informationTechnical information
Planned availability datePlanned availability dateOrdering informationOrdering information
DescriptionDescriptionTerms and conditionsTerms and conditions
Program numberProgram numberPricesPrices


(Corrected on February 13, 2019)

A link to Software Subscription and Support information was added.



Overview

Top rule

Hortonworks Data Platform is an enterprise ready open source Apache Hadoop distribution based on a centralized architecture supported by YARN. Hortonworks Data Platform is designed to address the needs of data at rest, power real-time customer applications, and deliver big data analytics that can help accelerate decision making and innovation.

The official Apache versions for Hortonworks Data Platform V2.6.4 include:

  • Apache Accumulo 1.7.0
  • Apache Atlas 0.8.0
  • Apache Calcite 1.2.0
  • Apache DataFu 1.3.0
  • Apache Falcon 0.10.0
  • Apache Flume 1.5.2
  • Apache Hadoop 2.7.3
  • Apache HBase 1.1.2
  • Apache Hive 1.2.1
  • Apache Hive 2.1.0
  • Apache Kafka 0.10.1
  • Apache Knox 0.12.0
  • Apache Mahout 0.9.0
  • Apache Oozie 4.2.0
  • Apache Phoenix 4.7.0
  • Apache Pig 0.16.0
  • Apache Ranger 0.7.0
  • Apache Slider 0.92.0
  • Apache Spark 1.6.3
  • Apache Spark 2.2.0
  • Apache Sqoop 1.4.6
  • Apache Storm 1.1.0
  • Apache TEZ 0.7.0
  • Apache Zeppelin 0.7.3
  • Apache ZooKeeper 3.4.6

IBM® clients can download this new offering from Passport Advantage®.



Back to topBack to top

Key prerequisites

Top rule

For details, see the Hardware requirements and the Software requirements sections.



Back to topBack to top

Planned availability date

Top rule

March 20, 2018



Back to topBack to top

Description

Top rule

Apache Components

Atlas

Enterprise readiness

Cloud

  • Shared services HDC: Atlas (AMBARI-19007)
  • Install and configure Atlas hook components independently of Atlas admin components

Core capabilities

  • Manually create entities (ATLAS-1193)
  • Higher-level API - Simplify and streamline usecases
  • Integration of ATLAS with Hive 2 (ATLAS-1280)

Integration

SmartSense data capture for Atlas (ATLAS-1436)

HDFS

Enterprise readiness

  • Detect slow disks and slow data nodes

Hive

HDP 2.6.0 includes two versions of Apache Hive, one based on the Hive 1 branch, meant for batch processing and one based on the Hive 2 branch, meant for interactive processing. Hortonworks applies stabilizations, bug fixes, and features from the trunk code base as deemed appropriate, so neither of these is identical to any specific released build in Apache. Specific details on the differences are provided here.

HDP deployments driven by Apache Ambari can deploy both Hive 1 and Hive 2 side by side. In this setup, Hive 2 features are accessed through the Hive LLAP interface.

  • Hive LLAP (Hive 2 only)
  • ACID Merge (Hive 1 and 2)

Hue

Ease of use

  • GA criteria for Hue migration tool

Knox

Security features

  • Knox support for Hadoop user-group mapping (KNOX-237)
  • Support for Linux® user authentication via PAM (KNOX-537)

Integration

  • Add support for WebSockets to Knox

Phoenix

Reliability

  • Phoenix index stability improvements

Ranger

Security features

  • Tag-based security expand for existing type common to Atlas + Ranger: Kafka, HDFS, Hbase (RANGER-1233)
  • Ranger authorization for "show Databases/Tables/Columns/Views" or "describe database/schema/table" permissions on HiveServer2 (RANGER-1195, RANGER-1204)
  • Support for $username variable in Ranger policies (RANGER-698)

Integration

  • SmartSense rules: Product analytics for Ranger (RANGER-1304)

Enterprise readiness

  • Support governance and security features for Beacon - Ranger
  • Policy versions in use for each Ranger plug-in (RANGER-1230)
  • UI hints for Audit search for Ranger Audit Logs & Policy Search on Report Manager or Policy Listing Page (RANGER-1227)
  • Change Ranger Admin start script to setup db for ranger (AMBARI-18065)
  • Export/import of policies in Ranger (RANGER-1214)
  • Ranger usersync improvement - Incremental, group filtered usersync with additional attributes (RANGER-1211)

Spark

Ease of use

  • [Codev 2016-17] Support virtualenv in PySpark (SPARK-13587)

Integration

  • Umbrella - Provide Spark 2 GA on HDP: Features across Spark, Livy, and Zeppelin components
  • Spark HBase connector enhancements

Enterprise readiness, security

  • Spark Thrift Server doAs support for identity propagation, for Spark SQL queries
  • Livy API (version 0.3) for REST-based access to Spark and Spark2 jobs, including support for Kerberos authentication and high availability

Core capabilities

  • Support for user-defined functions in SparkR
  • Support in SparkR for additional large-scale machine learning algorithms

Storm

Integration

  • Connectivity enhancements: Kinesis spout, openTSDB bolt, new Kafka Consumer spout

YARN

Enterprise readiness

  • Queue priorities to allow high-priority services (for example, LLAP) to run in a shared cluster (YARN-5864)
  • Fault tolerance of Slider apps
  • Support port range for YARN apps

Zeppelin

Core capabilities

  • Zeppelin to work with Spark version 2.x

Ease of use

  • Improve JDBC interpreter
  • Improve Zeppelin Livy integration
  • Support multiple SQL statements in one notebook paragraph

Enterprise readiness, security

Integration

  • Umbrella - Provide Spark 2 GA on HDP: Features across Spark, Livy, and Zeppelin components
  • Support for Phoenix interpreter

The Hortonworks Data Platform part is being released under the following restriction.

This part can only be purchased by clients who qualify any of the below stated scenarios:

  • Have existing IBM BigInsights® entitlement
  • Have IBM Db2® Big SQL in Enterprise Licensing Agreement (ELA) catalog
  • Have IBM Db2 Big SQL entitlements and are currently having HDP support subscription from Hortonworks


Back to topBack to top

Program number

Top rule

Program number VRM Program name
5737-H46 2.6.0 Hortonworks Data Platform


Back to topBack to top

Offering Information

Top rule

Product information is available on the IBM Offering Information website.

More information is also available on the Passport Advantage and Passport Advantage Express® website.



Back to topBack to top

Publications

Top rule

Technical documentation can be found in IBM Knowledge Center.



Back to topBack to top

Services

Top rule

Software Services

IBM Software Services has the breadth, depth, and reach to manage your services needs. You can leverage the deep technical skills of our lab-based Software Services team and the business consulting, project management, and infrastructure expertise of our IBM Global Services team. Together, we provide the global reach, intellectual capital, industry insight, and technology leadership to support a wide range of critical business needs.

To learn more about IBM Software Services, contact your Lab Services Sales or Delivery Leader.



Back to topBack to top

Technical information

Top rule

Specified operating environment

Hardware requirements

Although there is no single hardware requirement for installing HDP, there are some basic guidelines. A complete installation of HDP 2.6.0 consumes about 6.5 GB of disk space. For more information about HDP hardware recommendations, see the HDP Cluster Planning Guide. A guideline is provided below:

Machine Type Workload Pattern/ Cluster Type Storage Processor (# of Cores) Memory (GB) Network
Slaves Balanced workload Twelve 2-3 TB disks 8 128-256 1 GB onboard, 2x10 GBE mezzanine/external
Compute-intensive workload Twelve 1-2 TB disks 10 128-256 1 GB onboard, 2x10 GBE mezzanine/external
Storage-heavy workload Twelve 4+ TB disks 8 128-256 1 GB onboard, 2x10 GBE mezzanine/external
Name Node Balanced workload Four or more 2-3 TB RAID 10 with spares 8 128-256 1 GB onboard, 2x10 GBE mezzanine/external
Resource Manager Balanced workload Four or more 2-3 TB RAID 10 with spares 8 128-256 1 GB onboard, 2x10 GBE mezzanine/external
Software requirements

Browser requirements

The Ambari Install Wizard runs as a browser-based web application. You must have a machine capable of running a graphical browser to use this tool. The minimum required browser versions are:

Operating System Browser
Linux Chrome 56.0.2924.87, 57.0.2987
Firefox 51, 52
Mac OS X Chrome 56.0.2924.87, 57.0.2987
Firefox 51, 52
Safari 10.0.1, 10.0.3
Windows™ * Chrome 56.0.2924.87, 57.0.2987
Edge 38
Firefox 51.0.1, 52.0
Internet Explorer 10, 11

* For HDP Stack component UIs, browsers are not tested or supported for the Windows OS.

On any platform, it is recommended you update your browser to the latest, stable version.

Planning information

Packaging

This offering is delivered through the internet as an electronic download. There is no physical media.

This program, when downloaded from a website, contains the applicable IBM license agreement and License Information, if appropriate, which will be presented for acceptance at the time of installation of the program. For future reference, the license and License Information will be stored in a directory such as LICENSE.TXT.



Back to topBack to top

Ordering information

Top rule

Product: Hortonworks Data Platform (5737-H46)


Passport Advantage

Description Part number
Hortonworks Data Platform Virtual Server License + SW Subscription & Support 12 Months D1XCELL
Hortonworks Data Platform Virtual Server SW Subscription & Support Reinstatement 12 Months D1XCFLL
Hortonworks Data Platform Virtual Server Annual SW Subscription & Support Renewal 12 Months E0PAELL

Charge metric

Program name Part number or PID number Charge metric
Hortonworks Data Platform 5737-H46 Virtual Server

Virtual Server

Virtual Server is a unit of measure by which the Program can be licensed. A server is a physical computer that is comprised of processing units, memory, and input/output capabilities and that executes requested procedures, commands, or applications for one or more users or client devices. Where racks, blade enclosures, or other similar equipment is being employed, each separable physical device (for example, a blade or a rack-mounted device) that has the required components is considered itself a separate server. A virtual server is either a virtual computer created by partitioning the resources available to a physical server or an unpartitioned physical server. Licensee must obtain Virtual Server entitlements for each Virtual Server made available to the Program, regardless of the number of processor cores in the Virtual Server or the number of copies of the Program on the Virtual Server.



Back to topBack to top

Terms and conditions

Top rule

The information provided in this announcement letter is for reference and convenience purposes only. The terms and conditions that govern any transaction with IBM are contained in the applicable contract documents such as the IBM International Program License Agreement, IBM International Passport Advantage Agreement, and IBM Agreement for Acquisition of Software Maintenance.

Licensing

IBM International Program License Agreement including the License Information document and Proof of Entitlement (PoE) govern your use of the program. PoEs are required for all authorized use. Part number products only, offered outside of Passport Advantage, where applicable, are license only and do not include Software Maintenance.

Agreement for Acquisition of Software Maintenance

Licenses under the IBM Program License Agreement (IPLA) and the associated Agreement for Acquisition of Software Maintenance provide for support with ongoing access to releases and versions of the program. IBM includes one year of Software Subscription and Support (also referred to as Software Maintenance) with the initial license acquisition of each program acquired. The initial period of Software Subscription and Support can be extended by the purchase of a renewal option, if available. Two charges apply: a one-time license charge for use of the program and an annual renewable charge for the enhanced support that includes telephone assistance (voice support for defects during normal business hours), as well as access to updates, releases, and versions of the program as long as support is in effect.

License Information number

L-MLOY-AW5TJY

See the License Information documents page on the IBM Software License Agreement website for more information.

Limited warranty applies

Yes

Limited warranty

IBM warrants that when the program is used in the specified operating environment, it will conform to its specifications. The warranty applies only to the unmodified portion of the program. IBM does not warrant uninterrupted or error-free operation of the program or that IBM will correct all program defects. You are responsible for the results obtained from the use of the program.

IBM provides you with access to IBM databases containing information on known program defects, defect corrections, restrictions, and bypasses at no additional charge. For further information, see the IBM Software Support Handbook.

IBM will maintain this information for at least one year after the original licensee acquires the program (warranty period).

Money-back guarantee

If for any reason you are dissatisfied with the program and you are the original licensee, you may obtain a refund of the amount you paid for it, if within 30 days of your invoice date you return the program and its PoE to the party from whom you obtained it. If you downloaded the program, you may contact the party from whom you acquired it for instructions on how to obtain the refund.

For clarification, note that (1) for programs acquired under the IBM International Passport Advantage offering, this term applies only to your first acquisition of the program and (2) for programs acquired under any of IBM's On/Off Capacity on Demand (On/Off CoD) software offerings, this term does not apply since these offerings apply to programs already acquired and in use by you.

Volume orders (IVO)

No

Passport Advantage applies

Yes, information is available on the Passport Advantage and Passport Advantage Express website.

Software Subscription and Support applies

Yes. Software Subscription and Support, also referred to as Software Maintenance, is included with licenses purchased through Passport Advantage and Passport Advantage Express. Product upgrades and Technical Support are provided by the Software Subscription and Support offering as described in the Agreements. Product upgrades provide the latest versions and releases to entitled software, and Technical Support provides voice and electronic access to IBM support organizations, worldwide.

IBM includes one year of Software Subscription and Support with each program license acquired. The initial period of Software Subscription and Support can be extended by the purchase of a renewal option, if available.

While your Software Subscription and Support is in effect, IBM provides you assistance for your routine, short-duration installation and usage (how-to) questions, and code-related questions. IBM provides assistance by telephone and, if available, electronic access, only to your information systems (IS) technical support personnel during the normal business hours (published prime shift hours) of your IBM support center. (This assistance is not available to your users.) IBM provides Severity 1 assistance 24 hours a day, 7 days a week. For additional details, see the IBM Software Support Handbook. Software Subscription and Support does not include assistance for the design and development of applications, your use of programs in other than their specified operating environment, or failures caused by products for which IBM is not responsible under the applicable agreements.

Unless specified otherwise in a written agreement with you, IBM does not provide support for third-party products that were not provided by IBM. Ensure that when contacting IBM for covered support, you follow problem determination and other instructions that IBM provides, including in the IBM Software Support Handbook.

For additional information about the International Passport Advantage Agreement and the IBM International Passport Advantage Express Agreement, go to the Passport Advantage and Passport Advantage Express website.

Software Support Lifecycle

Variable charges apply

No

Educational allowance available

Not applicable



Back to topBack to top

Statement of good security practices

Top rule

IT system security involves protecting systems and information through intrusion prevention, detection, and response to improper access from within and outside your enterprise. Improper access can result in information being altered, destroyed, or misappropriated or can result in misuse of your systems to attack others. Without a comprehensive approach to security, no IT system or product should be considered completely secure and no single product or security measure can be completely effective in preventing improper access. IBM systems and products are designed to be part of a regulatory compliant, comprehensive security approach, which will necessarily involve additional operational procedures, and may require other systems, products, or services to be most effective.

Important: IBM does not warrant that any systems, products, or services are immune from, or will make your enterprise immune from, the malicious or illegal conduct of any party.



Back to topBack to top

Prices

Top rule


Passport Advantage

For Passport Advantage information and charges, contact your IBM representative. Additional information is also available on the Passport Advantage and Passport Advantage Express website.

Trademarks

IBM, Passport Advantage, Express, BigInsights and Db2 are registered trademarks of IBM Corporation in the United States, other countries, or both.

Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both.

Windows is a trademark of Microsoft Corporation in the United States, other countries, or both.

Other company, product, and service names may be trademarks or service marks of others.

Terms of use

IBM products and services which are announced and available in your country can be ordered under the applicable standard agreements, terms, conditions, and prices in effect at the time. IBM reserves the right to modify or withdraw this announcement at any time without notice. This announcement is provided for your information only. Additional terms of use are located at

Terms of use

For the most current information regarding IBM products, consult your IBM representative or reseller, or go to the IBM worldwide contacts page

IBM United States

Share this page

Digg Linked In

Contact IBM

Feedback

-->