IBM z/OS Platform for Apache Spark, V1.1 offers an enterprise-grade platform to enable Apache Spark on z/OS with integrated data abstraction and virtualization services

IBM United States Software Announcement 216-067
March 22, 2016


Table of contents
OverviewOverviewTechnical informationTechnical information
Key prerequisitesKey prerequisitesOrdering informationOrdering information
Planned availability datePlanned availability dateTerms and conditionsTerms and conditions
DescriptionDescriptionPricesPrices
Program numberProgram numberOrder nowOrder now
PublicationsPublications 

 


(Corrected on March 23, 2016)

The charge metric definition was corrected in the Ordering information section, and a link was corrected in the Publications section.



Top rule
At a glance
Bottom rule

IBM® z/OS® Platform for Apache Spark offers an Apache Spark distribution of the open source, in-memory processing engine that is designed for big data. It provides z/OS clients with the ability to combine the benefits of Apache Spark with the advantage of analyzing business-critical data in place, with no data movement.

Apache Spark benefits:

  • Streamline development. Developers and data scientists can use their existing expertise with programming languages such as Scala, Python, and SQL to speed time to market. With Apache Spark, there's no need to learn new languages.
  • Simplify data access. Apache Spark removes data access complexity, providing seamless access to enterprise data with familiar tools. Built-in machine learning and graph algorithm libraries make it easy to enable interactive queries and deliver fast responses.
  • Develop a wide range of algorithms. Apache Spark lets you develop and deploy all workloads, including machine learning, iterative, and batch, faster.
  • Accelerate analytics results. Apache Spark uses an in-memory approach for processing data to deliver results quickly.


Back to topBack to top

Top rule
Overview
Bottom rule

The large volume and variety of data available today offers the possibility of seeing things in new ways. Value comes from data-driven insights, not data alone. Analytic algorithms can combine and extract insights from a wide range of data, from transactional systems and data on the mainframe, to customer data collected from mobile and social applications and data streaming in from the Internet of Things and sensors to identify trends, model possible scenarios, and predict future results. These insights can provide business advantage by identifying emerging opportunities, improving the customer experience, enhancing operational efficiencies, reducing risks, and more.

Apache Spark is an open source engine that is built specifically to accelerate the time to insight from analytics by providing a full framework of capability for data science. It helps simplify algorithm development and accelerate analytics results. With Apache Spark, you can better extract value from data, conducting deeper analyses and delivering results faster, all while reducing the time and effort required for coding.

IBM z/OS Platform for Apache Spark offers an enterprise-grade platform to enable Apache Spark natively on z/OS. It includes Apache Spark open source capabilities consisting of the Apache Spark core, Spark SQL, Spark Streaming, Machine Learning Library (MLib), and Graphx.

IBM z/OS Platform for Apache Spark also provides optimized data abstraction and virtualization to enable efficient access to a broad set of structured and unstructured data sources through Spark APIs. With this capability, traditional z/OS data sources such as IMS™, VSAM, DB2® z/OS, PDSE, or SMF data can be accessed in a performance-optimized manner with Spark SQL. When a significant portion of the data to be analyzed resides on z/OS, analytic applications deployed on z/OS can leverage standard Spark APIs to analyze data in place, gaining significant performance and avoiding costly processing and security considerations associated with data movement.



Back to topBack to top

Top rule
Key prerequisites
Bottom rule

IBM z/OS Platform for Apache Spark requires:

  • IBM z/OS V2.1, or later
  • IBM 64-bit SDK for z/OS, Java™ Technology Edition, Version 8 Refresh 2 Fix Pack 10
  • Bourne Again Shell (bash) version 4.2.53, or later


Back to topBack to top

Top rule
Planned availability date
Bottom rule

March 25, 2016



Back to topBack to top

Top rule
Description
Bottom rule

What is it?

IBM z/OS Platform for Apache Spark offers an enterprise-grade platform to enable Apache Spark natively on z/OS.

What does it do?

IBM z/OS Platform for Apache Spark includes Apache Spark open source capabilities consisting of the Apache Spark core, Spark SQL, Spark Streaming, Machine Learning Library (MLib), and Graphx.

IBM z/OS Platform for Apache Spark also provides optimized data abstraction and virtualization to enable efficient access to a broad set of structured and unstructured data sources through Spark APIs. With this capability, traditional z/OS data sources such as IMS, VSAM, DB2 z/OS, PDSE, or SMF data can be accessed in a performance-optimized manner with Spark SQL.

Apache Spark benefits:

  • Streamline development. Developers and data scientists can use their existing expertise with programming languages such as Scala, Python, and SQL to speed time to market. With Apache Spark, there's no need to learn new languages.
  • Simplify data access. Apache Spark removes data access complexity, providing seamless access to enterprise data with familiar tools. Built-in machine learning and graph algorithm libraries make it easy to enable interactive queries and deliver fast responses.
  • Develop a wide range of algorithms. Apache Spark lets you develop and deploy all workloads, including machine learning, iterative, and batch, faster.
  • Accelerate analytics results. Apache Spark uses an in-memory approach for processing data to deliver results quickly.

Why should I buy?

When a significant portion of the data to be analyzed resides on z/OS, analytic applications deployed on z/OS can leverage standard Spark APIs and in-memory processing engine to analyze business-critical data in place, gaining significant performance and avoiding costly processing and security considerations associated with data movement.

Accessibility by people with disabilities

A US Section 508 Voluntary Product Accessibility Template (VPAT) containing details on accessibility compliance can be found on the Product accessibility information website.



Back to topBack to top

Top rule
Reference information
Bottom rule

For information about the IBM z Systems™ servers, refer to the following announcements:

  • IBM z13™ Hardware Announcement 115-001, dated January 14, 2015
  • IBM z13s Hardware Announcement 116-002, dated February 16, 2016
  • IBM zEnterprise® EC12 Hardware Announcement 113-119, dated July 23, 2013, and Software withdrawal 912-153, dated August 14, 2012
  • IBM zEnterprise BC12 Hardware Announcement 113-121, dated July 23, 2013
  • IBM z/OS V2.2 Software Announcement 215-267, dated July 28, 2015
  • IBM z/OS V2.1 Software Announcement 213-292, dated July 23, 2013



Back to topBack to top

Top rule
Program number
Bottom rule
Program number VRM Program name
5655-AAB 1.1.0 IBM z/OS Platform for Apache Spark

Product identification number

IBM z/OS Platform for Apache Spark

Program PID number Subscription and Support PID number
5655-AAB 5655-AAC


Back to topBack to top

Top rule
Education support
Bottom rule

IBM training provides education to support many IBM offerings. Descriptions of courses for IT professionals and managers can be found on the IBM authorized training website.

Call IBM training at 800-IBM-TEACH (426-8322) for catalogs, schedules, and enrollments.



Back to topBack to top

Top rule
Offering Information
Bottom rule

Product information is available on the IBM Offering Information website.



Back to topBack to top

Top rule
Business Partner information
Bottom rule

If you are a Direct Reseller - System Reseller acquiring products from IBM, you may link directly to Business Partner information for this announcement. A PartnerWorld® ID and password are required (use IBM ID).

BP Attachment for Announcement Letter 216-067


Back to topBack to top

Top rule
Publications
Bottom rule

The product documentation includes these publications:

Title Order number
Program Directory for IBM z/OS Platform for Apache Spark GI13-4318-00
License Information for IBM z/OS Platform for Apache Spark GI13-4319-00
IBM z/OS Platform for Apache Spark Installation and Customization Guide SC27-8449-00
IBM z/OS Platform for Apache Spark User's Guide SC27-8450-00
IBM z/OS Platform for Apache Spark Administrator's Guide SC27-8451-00
IBM z/OS Platform for Apache Spark Solutions Guide SC27-8452-00

IBM Knowledge Center provides access to the documentation at the z/OS Platform for Apache Spark home page.

The IBM Publications Center is a worldwide central repository for IBM product publications and marketing material with a catalog of over 70,000 items. Extensive search facilities are provided. A large number of publications are available online in various file formats, which can currently be downloaded.



Back to topBack to top

Top rule
Services
Bottom rule

Software Services

IBM Software Services has the breadth, depth, and reach to manage your services needs. You can leverage the deep technical skills of our lab-based, software services team and the business consulting, project management, and infrastructure expertise of our IBM Global Services team. Also, we extend our IBM Software Services reach through IBM Business Partners to provide an extensive portfolio of capabilities. Together, we provide the global reach, intellectual capital, industry insight, and technology leadership to support a wide range of critical business needs.

To learn more about IBM Software Services or to contact a Software Services sales specialist, go to the IBM Software Services website.



Back to topBack to top

Top rule
Technical information
Bottom rule

Specified operating environment

Hardware requirements

IBM z/OS Platform for Apache Spark requires one of the following IBM z Systems servers:

  • z13™
  • z13s
  • zEnterprise EC12
  • zEnterprise BC12

Software requirements

IBM z/OS Platform for Apache Spark requires:

  • z/OS V2.1, or later
  • IBM 64-bit SDK for z/OS, Java Technology Edition, Version 8 Service Refresh 2 Fix Pack 10
  • Bourne Again Shell (bash) version 4.2.53, or later
  • Use LZ4 as compression codec

The program's specifications and specified operating environment information may be found in documentation accompanying the program, if available, such as a readme file, or other information published by IBM, such as an announcement letter. Documentation and other program content may be supplied only in the English language.

Planning information

Packaging

The z/OS Platform for Apache Spark product package is distributed by download only.

Direct customer support

For technical support or assistance, contact your IBM representative or go to the IBM Support Portal website.

Security, auditability, and control

The announced product uses the security and auditability features and functions of host hardware, host software, and application software.

The customer is responsible for evaluation, selection, and implementation of security features, administrative procedures, and appropriate controls in application systems and communication facilities.



Back to topBack to top

Top rule
Ordering information
Bottom rule

Charge metric

Pricing Metric Description

Program name Program number Pricing metric description
IBM z/OS Platform for Apache Spark 5655-AAB Per Install
IBM z/OS Platform for Apache Spark S&S 5655-AAC Per Install


Install

Install is a unit of measure by which the program can be licensed. An Install is an installed copy of the program on a physical or virtual disk made available to be executed on a computer. Licensee must obtain an entitlement for each Install of the program.

Notwithstanding anything to the contrary, each server on which the program is installed counts as one Install entitlement. Multiple copies of the program installed on the same server count as one Install entitlement. A server is a physical computer that is comprised of processing units, memory, and input/output capabilities and that executes requested procedures, commands, or applications for one or more users or client devices.

Basic license

To order, specify the program product number and the appropriate license or charge option. Also, specify the desired distribution medium. To suppress shipment of media, select the license-only option in CFSW.

Program name: z/OS Platform for Apache Spark

Program PID: 5655-AAB

Entitlement identifier Description License option/Pricing metric
S017ZB4 z/OS Platform for Apache Spark Basic OTC, Per Install

Subscription and Support PID: 5655-AAC

Entitlement identifier Description License option/Pricing metric
S017ZB7 z/OS Platform for Apache Spark S&S (5655-AAC) Basic ASC, per Install SW S&S
  z/OS Platform for Apache Spark S&S No charge, decline SW S&S

Orderable supply ID Language Distribution medium
S017ZB8 US English Paper
S017ZB9 US English 1/2 Inch Data Cartridge - IBM 3590 - 30 GB - 128 Track

Subscription and Support

To receive voice technical support via telephone and future releases and versions at no additional charge, Subscription and Support must be ordered. The capacity of Subscription and Support (Value Units) must be the same as the capacity ordered for the product licenses.

To order, specify the Subscription and Support program number (PID) referenced above and the appropriate license or charge option.

IBM is also providing Subscription and Support for these products via a separately purchased offering under the terms of the IBM International Agreement for Acquisition of Software Maintenance. This offering:

  • Includes and extends the support services provided in the base support to include technical support via telephone.
  • Entitles you to future releases and versions, at no additional charge. Note that you are not entitled to new products.

When Subscription and Support is ordered, the charges will automatically renew annually unless cancelled by you.

The combined effect of the IPLA license and the Agreement for Acquisition of Software Maintenance gives you rights and support services comparable to those under the traditional ICA S/390® and System z® license or its equivalent. To ensure that you continue to enjoy the level of support you are used to in the ICA business model, you must order both the license for the program and the support for the selected programs at the same Value Unit quantities.

Customized Offerings

Product deliverables are shipped only through CBPDO and ServerPac. These customized offerings are offered for Internet delivery in countries where Shopz product ordering is available. Internet delivery reduces software delivery time and allows you to install software without the need to handle tapes. For more details on Internet delivery, go to the Help section on the Shopz website.

You choose the delivery method when you order the software. IBM recommends Internet delivery. In addition to Internet and DVD, the supported tape delivery options include:

  • 3590
  • 3592

Most products can be ordered in ServerPac the month following their availability in CBPDO. z/OS can be ordered through CBPDO and ServerPac at general availability. Many products will also be orderable in a Product ServerPac without also having to order the z/OS operating system or subsystem.

Shopz and CFSW will determine the eligibility based on product requisite checking. For more details on the product ServerPac, go to the Help section on the Shopz website.

For additional information about the Product ServerPac option, refer to Software Announcement 212-272, dated July 31, 2012.

Production of software product orders will begin on the planned general availability date.

  • CBPDO shipments will begin one week after general availability.
  • ServerPac shipments will begin two weeks after general availability.



Back to topBack to top

Top rule
Terms and conditions
Bottom rule

The information provided in this announcement letter is for reference and convenience purposes only. The terms and conditions that govern any transaction with IBM are contained in the applicable contract documents such as the IBM International Program License Agreement, IBM International Passport Advantage® Agreement, and the IBM Agreement for Acquisition of Software Maintenance.

Licensing

IBM International Program License Agreement including the License Information document and Proof of Entitlement (PoE) govern your use of the program. PoEs are required for all authorized use.

This software license includes Software Subscription and Support (also referred to as Software Maintenance).

Agreement for Acquisition of Software Maintenance

The following agreement applies for Software Subscription and Support (Software Maintenance) and does not require customer signatures:

  • IBM Agreement for Acquisition of Software Maintenance (Z125-6011)

These programs are licensed under the IBM Program License Agreement (IPLA) and the associated Agreement for Acquisition of Software Maintenance, which provide for support with ongoing access to releases and versions of the program. These programs have a one-time license charge for use of the program and an annual renewable charge for the enhanced support that includes telephone assistance (voice support for defects during normal business hours), as well as access to updates, releases, and versions of the program as long as support is in effect.

License Information number

L-WDEN-A64PB7

See the License Information documents page on the IBM Software License Agreement website for more information.

Limited warranty applies

Yes

Limited warranty

IBM warrants that when the program is used in the specified operating environment, it will conform to its specifications. The warranty applies only to the unmodified portion of the program. IBM does not warrant uninterrupted or error-free operation of the program or that IBM will correct all program defects. You are responsible for the results obtained from the use of the program.

IBM provides you with access to IBM databases containing information on known program defects, defect corrections, restrictions, and bypasses at no additional charge. For further information, see the IBM Software Support Handbook.

IBM will maintain this information for at least one year after the original licensee acquires the program (warranty period).

Program support

Enhanced support, called Subscription and Support, includes telephone assistance, as well as access to updates, releases, and versions of the program as long as support is in effect. You will be notified of discontinuance of support with 12 months' notice.

Money-back guarantee

If for any reason you are dissatisfied with the program and you are the original licensee, you may obtain a refund of the amount you paid for it, if within 30 days of your invoice date you return the program and its PoE to the party from whom you obtained it. If you downloaded the program, you may contact the party from whom you acquired it for instructions on how to obtain the refund.

For clarification, note that for programs acquired under any of IBM's On/Off Capacity on Demand (On/Off CoD) software offerings, this term does not apply since these offerings apply to programs already acquired and in use by you.

Volume orders (IVO)

No

Passport Advantage applies

No

Software Subscription and Support applies

Yes. During the S&S period, for the unmodified portion of a program, and to the extent problems can be recreated in the specified operating environment, IBM will provide the following:

  • Defect correction information, a restriction, or a bypass.
  • Program updates: Periodic releases of collections of code corrections, fixes, functional enhancements and new versions and releases to the program and documentation.
  • Technical assistance: A reasonable amount of remote assistance by telephone or electronically to address suspected program defects. Technical assistance is available from the IBM support center in the organization's geography.

Additional details regarding Technical Assistance, that includes IBM contact information, are provided in the IBM Software Support Handbook.

S&S does not include assistance for:

  • The design and development of applications
  • Organization's use of program in other than their specified operating environment, or
  • Failures caused by products for which IBM is not responsible under the IBM Agreement for Acquisition of Software Maintenance.

S&S is provided only if the program is within its support timeframe as specified in the Software Support Lifecycle policy for the program.

IBM Operational Support Services - SoftwareXcel

No

System i Software Maintenance applies

No

Variable charges apply

No

Educational allowance available

Yes. A 15% education allowance applies to qualified education institution customers.



Back to topBack to top

Top rule
Statement of good security practices
Bottom rule

IT system security involves protecting systems and information through prevention, detection, and response to improper access from within and outside your enterprise. Improper access can result in information being altered, destroyed, or misappropriated or can result in misuse of your systems to attack others. Without a comprehensive approach to security, no IT system or product should be considered completely secure and no single product or security measure can be completely effective in preventing improper access. IBM systems and products are designed to be part of a lawful, comprehensive security approach, which will necessarily involve additional operational procedures, and may require other systems, products, or services to be most effective.

Important: IBM does not warrant that any systems, products, or services are immune from, or will make your enterprise immune from, the malicious or illegal conduct of any party.



Back to topBack to top

Top rule
Prices
Bottom rule

For additional information and current prices, contact your local IBM representative.

Information on charges is available on the IBM Support Portal website.

Choose the option entitled Purchase/upgrade tools.

Program name: IBM z/OS Platform Apache Spark

Program PID: 5655-AAB

Entitlement identifier Description License option/Pricing metric
S017ZB4   Basic OTC, Per Install

Subscription and Support PID: 5655-AAC

Entitlement identifier Description License option/Pricing metric
S017ZB7 z/OS Platform for Apache Spark S&S Basic ASC, per Install SW S&S
  z/OS Platform for Apache Spark S&S No charge, decline SW S&S

IBM Global Financing

IBM Global Financing offers competitive financing to credit-qualified customers to assist them in acquiring IT solutions. Offerings include financing for IT acquisition, including hardware, software, and services, from both IBM and other manufacturers or vendors. Offerings (for all customer segments: small, medium, and large enterprise), rates, terms, and availability can vary by country. Contact your local IBM Global Financing organization or go to the IBM Global Financing website for more information.

IBM Global Financing offerings are provided through IBM Credit LLC in the United States, and other IBM subsidiaries and divisions worldwide to qualified commercial and government customers. Rates are based on a customer's credit rating, financing terms, offering type, equipment type, and options, and may vary by country. Other restrictions may apply. Rates and offerings are subject to change, extension, or withdrawal without notice.

Financing from IBM Global Financing helps you preserve cash and credit lines, enables more technology acquisition within current budget limits, permits accelerated implementation of economically attractive new technologies, offers payment and term flexibility, and can help match project costs to projected benefits. Financing is available worldwide for credit-qualified customers.



Back to topBack to top

Top rule
Order now
Bottom rule

To order, contact your Americas Call Centers, local IBM representative, or your IBM Business Partner. To identify your local IBM representative or IBM Business Partner call 800-IBM-4YOU (426-4968). For more information, contact the Americas Call Centers.

Phone: 800-IBM-CALL (426-2255)

Fax: 800-2IBM-FAX (242-6329)

For IBM representative: callserv@ca.ibm.com

For IBM Business Partner: pwcs@us.ibm.com

Mail:
IBM Teleweb Customer Support
ibm.com® Sales Execution Center, Americas North
3500 Steeles Ave. East, Tower 3/4
Markham, Ontario
Canada L3R 2Z1
Reference:
LE001

The Americas Call Centers, our national direct marketing organization, can add your name to the mailing list for catalogs of IBM products.


Note: Shipments will begin after the planned availability date.
Trademarks

IMS, IBM z Systems, IBM z13 and z13 are trademarks of IBM Corporation in the United States, other countries, or both.

IBM, z/OS, DB2, PartnerWorld, Passport Advantage, System i, zEnterprise, S/390, System z and ibm.com are registered trademarks of IBM Corporation in the United States, other countries, or both.

Oracle and Java are trademarks of Oracle and/or its affiliates in the United States, other countries, or both.

Other company, product, and service names may be trademarks or service marks of others.

Terms of use

IBM products and services which are announced and available in your country can be ordered under the applicable standard agreements, terms, conditions, and prices in effect at the time. IBM reserves the right to modify or withdraw this announcement at any time without notice. This announcement is provided for your information only. Additional terms of use are located at

Terms of use

For the most current information regarding IBM products, consult your IBM representative or reseller, or visit the IBM worldwide contacts page

http://www.ibm.com/planetwide/us/

Share this page

Digg Linked In

Contact IBM

Considering a purchase?