IBM Big Replicate LiveData Migrator migrates changing data at scale from Apache HDFS to user choice of target environments; IBM Db2 Big SQL 7.1 on CDP Private Cloud Base 7.1.3 accelerates your digital transformation journey

IBM United States Software Announcement 220-356
October 6, 2020

Table of contents
OverviewOverviewTechnical informationTechnical information
Key requirementsKey requirementsOrdering informationOrdering information
Planned availability datePlanned availability dateTerms and conditionsTerms and conditions
Program numberProgram numberPricesPrices
PublicationsPublicationsOrder nowOrder now


At a glance

Top rule

IBM® Big Replicate LiveData Migrator is designed to automate cloud migration at scale with no application downtime and no risk of data loss, even when the data sets are under active change.

Advantages include:

  • As changes occur anywhere in the donor system, Big Replicate LiveData Migrator creates and helps ensure beneficiary data consistency.
  • With one-click replication across all major commercial Hadoop distributions and storage and analytic services, Big Replicate LiveData Migrator minimizes IT resources while requiring only one pass of the source storage.
  • Through enhanced migration target options, users can choose to migrate data to Microsoft™ Azure Data Lake Storage Gen2 (ADLS Gen2), Apache Hadoop Distributed File System (HDFS), local file systems, or Amazon S3.


Back to topBack to top

Overview

Top rule

IBM Big Replicate LiveData Migrator

Big Replicate LiveData Migrator migrates HDFS data to other Hadoop-compatible file systems and cloud storage, including ongoing changes made to those data before, throughout, and after migration. This data solution is purpose-built to migrate data lake content easily and simply for architects, administrators, and operators. It is immediate, live, and scalable. Organizations can manage their migrations through a robust and intuitive command-line interface or from the self-documenting REST API, track and monitor migration progress, and take advantage of optional management capabilities in the browser-based user interface.

Differentiating factors of Big Replicate LiveData Migrator:

  • Hadoop and object storage. Works across a variety of big data source and target environments, including all major Hadoop and object storage technologies.
  • Petabyte scale. Migrates big data sets at scale to cloud storage and eliminates the need to halt changes made to the data sets during migration.
  • Selective migration. Provides flexible options that enable users to select only those data sets that they want to migrate. Administrators can define replication policies that identify and control the data that is replicated between clusters, selectively exclude data from migration to specific clusters in the new environment, or move the data to an archive.
  • One pass. Migrates existing data sets with a single pass through the source storage system, eliminating the overhead of repeated scans.
  • Consensus-based consistency. Incorporates changes that are made to the data sets under migration with a strongly consistent distributed consensus engine, enabling applications to continue to modify the donor system's data without causing divergence between donor and beneficiary.
  • Strengthened consistency. As changes occur anywhere in the donor system, LiveData Migrator creates and helps ensure beneficiary data consistency.

For IBM Big Replicate version mapping to WANdisco Fusion releases, see Big Replicate Mapping.

IBM Big Replicate now delivers a committed term license option. Like monthly licenses, committed term licenses enable clients to purchase IBM software in a cloud-centric model. This new purchasing model aligns to cloud-centered consumption models.

As organizations adopt multicloud architectures for their most critical applications, an alignment of pricing and consumption models becomes of utmost importance.

Committed term licenses are designed and priced to:

  • Make it easier for organizations to acquire IBM software
  • Align consumption models and spend to those clients accustomed to cloud-based solutions
  • Align with the Red Hat® subscription model to deliver a consistent buying experience across product portfolios

Committed term licenses will be available for new license sales or expansion of existing IBM software licenses. Committed term licenses can be procured for a minimum of 12 months.

IBM Db2® Big SQL

IBM Db2 Big SQL, an advanced SQL engine for Big Data, is making strides with the fast-evolving open source ecosystem by supercharging analytical workloads on Hadoop platforms. The core capabilities of Big SQL focus on SQL compatibility, scalability, performance, and of course enterprise security/governance, making it a desirable query engine to seek insights from Big Data.

Db2 Big SQL is now available on Cloudera Data Platform Private Cloud Base (previously called CDP Data Center) 7.1.3. Db2 Big SQL. It allows data engineers and data scientists to analyze the structured and unstructured data already stored on HDFS. This Db2 format is optimized for open source file formats stored in Hadoop. Highlights include:

  • Integration with CDP Private Cloud Base 7.1.3:
    • Tight integration with components such as Hadoop, Hive, Cloudera Manager, and Ranger
    • ACID capabilities for changing data
    • Zookeeper-based solution for HA automatic failover
    • Big SQL upgrade from legacy platforms to the latest, unified platform
  • Capability to create and centrally manage data access policies using Ranger for Db2 Big SQL tables:
    • Add support for column-level Ranger tag-based policies for fine grained access controls on data
    • Enhance Ranger policies on Big SQL tables to have both column masking and row filtering through Ranger UI
    • Extend the Ranger column masking/row-filtering policies to Hadoop tables and federated tables (Nicknames only)
  • SQL core:
    • Enhanced SQL core by improving reader/writer operations and enhanced error handling to improve trouble-shooting of client issues
    • Extended federation capabilities to query data in Blockchain from a single SQL engine
    • Added support for ACID on Hive tables that are compacted to merge the changes to a table
  • Performance:
    • Enhanced Scheduler to better coordinate operations between Big SQL workers in data nodes

With its advanced SQL capabilities, Db2 Big SQL enables business intelligence tools to directly connect for interactive SQL analytics with high performance and high concurrency without data duplication or vendor lock-in. With changing platforms, Big SQL provides a stable environment for applications and avoid unnecessary query rewrites with platform changes or migrations. Port business intelligence applications for business intelligence tools including Cognos®, Tableau, and others using ODBC or JDBC connections. With its support for popular open source file formats such as Parquet, ORC, Avro, Text, Sequence, and so on, data engineers and data scientists can access data directly by using their tool of choice and can build, test, and deploy models seamlessly using Db2 Big SQL.



Back to topBack to top

Key requirements

Top rule

IBM Big Replicate LiveData Migrator

Supports Red Hat Enterprise Linux® (RHEL) and CentOS operating systems.

IBM Db2 Big SQL

Supports RHEL and CentOS operating systems.

For details, see the Hardware requirements and the Software requirements sections.



Back to topBack to top

Planned availability date

Top rule

October 6, 2020



Back to topBack to top

Accessibility by people with disabilities

Top rule

Accessibility Compliance Reports (previously known as a VPAT) containing details on accessibility compliance to standards, including the Worldwide Consortium Web Content Accessibility Guidelines, European Standard EN 301 349, and US Section 508, can be found on the IBM Accessibility Conformance Report Request website.



Back to topBack to top

Reference information

Top rule

For more information about IBM Db2 Big SQL, see Software Announcement 220-141, dated March 24, 2020.



Back to topBack to top

Program number

Top rule

Program number VRM Program name
5737-N62 1.4.7 IBM Big Replicate LiveData Migrator
5737-E74 7.1.0 IBM Db2 Big SQL
5737-H85 1.0.0 IBM Big Replicate for Hadoop
5737-H86 1.0.0 IBM Big Replicate for Object Stores
5737-H87 1.0.0 IBM Big Replicate for Hive
5737-H88 1.0.0 IBM Big Replicate for Security
5737-J36 1.0.0 IBM Big Replicate for Backup


Back to topBack to top

Offering Information

Top rule

Product information is available on the IBM Offering Information website.

More information is also available on the Passport Advantage® and Passport Advantage Express® website.



Back to topBack to top

Publications

Top rule

None



Back to topBack to top

Services

Top rule

Software Services

IBM Software Services has the breadth, depth, and reach to manage your services needs. You can leverage the deep technical skills of the lab-based software services team and the business consulting, project management, and infrastructure expertise of the IBM Global Services team. Also, IBM extends the reach of IBM Software Services through IBM Business Partners to provide an extensive portfolio of capabilities. IBM provides the global reach, intellectual capital, industry insight, and technology leadership to support a wide range of critical business needs.

To learn more about IBM Software Services, contact your Lab Services Sales or Delivery Leader.



Back to topBack to top

Technical information

Top rule

Specified operating environment

Hardware requirements

IBM Big Replicate LiveData Migrator

Hadoop distributions:

  • Cloudera Data Platform 5.5.0 - 6.3.x
  • Hortonworks Data Platform 2.3.0 - 3.1.x
  • Elastic MapReduce 5.3 - 5.4
  • Google Data Proc 1.0 - 1.3
  • ASF 2.7.x - 3.1
  • IBM (IOP) 4.2.5
  • MapR 5.0 - 6.1.0

Object storage:

  • Amazon S3 compatible file systems
  • Microsoft Azure Data Lake Storage Gen2 (ADLS Gen2)
  • Apache Hadoop Distributed File System (HDFS)
  • Local file systems

IBM Db2 Big SQL

  • Minimum of 3 SKUs with each SKU of 4 nodes each (for example, 12 nodes, in cluster installation)
  • Processor: x86 or IBM POWER® 64-bit systems
  • Memory: Minimum 24 GB of memory
  • Disk space: Minimum 80 GB of disk storage
  • Minimum 32 GB of disk storage on the management node
  • Minimum 20 GB of disk storage on other nodes
Software requirements

IBM Big Replicate LiveData Migrator

Operating systems:

  • RHEL 6 x86_64
  • RHEL 7 x86_64
  • CentOS 6 x86_64
  • CentOS 7 x86_64

Web browsers:

  • Mozilla Firefox 11, or later
  • Google Chrome

Java™:

  • Java JRE 1.7 and 1.8

IBM Db2 Big SQL

Operating systems:

  • Red Hat Enterprise Linux (RHEL) Server 7.6, 7.7, and 7.8 (x86-64)
  • CentOS 7.6, 7.7, and 7.8 (x86-64)

Platform:

  • Cloudera Data Platform Data Center 7.1.3
IBM Support

IBM Support is your gateway to technical support tools and resources that are designed to help you save time and simplify support. IBM Support can help you find answers to questions, download fixes, troubleshoot, submit and track problem cases, and build skills. Learn and stay informed about the transformation of IBM Support, including new tools, new processes, and new capabilities, by going to the IBM Support Insider.

Planning information

Packaging

This offering is delivered through the internet as an electronic download. There is no physical media.



Back to topBack to top

Ordering information

Top rule

For ordering information, consult your IBM representative or IBM Business Partner, or go to the Passport Advantage website.

These programs are only available through Passport Advantage. They are not available as shrinkwrap.

These products may only be sold directly by IBM or by IBM Business Partners.

To locate IBM Business Partners in your geography, see the Find a Business Partner page.


Passport Advantage

IBM Big Replicate LiveData Migrator (5737-N62)

Part number description Part number
IBM Big Replicate LiveData Migrator Annual Terabyte Committed Term License D291ULL

IBM Big Replicate for Hadoop (5737-H85)

Part number description Part number
IBM Big Replicate for Hadoop Virtual Server Committed Term License D2923LL

IBM Big Replicate for Object Stores (5737-H86)

Part number description Part number
IBM Big Replicate for Object Stores Terabyte Committed Term License D2924LL

IBM Big Replicate for Hive (5737-H87)

Part number description Part number
IBM Big Replicate for Hive Install Committed Term License D2925LL

IBM Big Replicate for Security (5737-H88)

Part number description Part number
IBM Big Replicate for Security Install Committed Term License D2926LL

IBM Big Replicate for Backup (5737-J36)

Part number description Part number
IBM Big Replicate for Backup Install Committed Term License D2927LL

Charge metric

The charge metrics for this licensed product can be found in the following License Information documents:

Program identifier License Information document title License Information document number
5737-N62 IBM Big Replicate LiveData Migrator L-JPHR-BRPS2B
5737-E74 IBM Db2 Big SQL L-JPHR-BRXR6T
5737-H85 IBM Big Replicate for Hadoop L-JPHR-BPZKDQ
5737-H86 IBM Big Replicate for Object Stores L-JPHR-BPZK5L
5737-H87 IBM Big Replicate for Hive L-JPHR-BPZKJF
5737-H88 IBM Big Replicate for Security L-MBIS-BJ63RD
5737-J36 IBM Big Replicate for Backup L-MBIS-BKL2FA

Select your language of choice and scroll down to the Charge Metrics section. Follow-on releases, if any, may have updated terms. See the License Information documents website for more information.



Back to topBack to top

Terms and conditions

Top rule

The information provided in this announcement letter is for reference and convenience purposes only. The terms and conditions that govern any transaction with IBM are contained in the applicable contract documents such as the IBM International Program License Agreement, IBM International Passport Advantage Agreement, and the IBM Agreement for Acquisition of Software Maintenance.

This product is only available through Passport Advantage.

Licensing

IBM International Program License Agreement including the License Information document and Proof of Entitlement (PoE) govern your use of the program. PoEs are required for all authorized use. Part number products only, offered outside of Passport Advantage, where applicable, are license only and do not include Software Maintenance.

This software license includes Software Subscription and Support (also referred to as Software Maintenance).

Software Maintenance

Licenses under the IBM International Program License Agreement (IPLA) provide for support with ongoing access to releases and versions of the program. IBM includes one year of Software Subscription and Support (also referred to as Software Maintenance) with the initial license acquisition of each program acquired. The initial period of Software Subscription and Support can be extended by the purchase of a renewal option, if available. Two charges apply: a one-time license charge for use of the program and an annual renewable charge for the enhanced support that includes telephone assistance (voice support for defects during normal business hours), as well as access to updates, releases, and versions of the program as long as support is in effect.

License Information number

The following License Information documents apply to the offering in this announcement:

Program identifier License Information document title License Information document number
5737-N62 IBM Big Replicate LiveData Migrator L-JPHR-BRPS2B
5737-E74 IBM Db2 Big SQL L-JPHR-BRXR6T
5737-H85 IBM Big Replicate for Hadoop L-JPHR-BPZKDQ
5737-H86 IBM Big Replicate for Object Stores L-JPHR-BPZK5L
5737-H87 IBM Big Replicate for Hive L-JPHR-BPZKJF
5737-H88 IBM Big Replicate for Security L-MBIS-BJ63RD
5737-J36 IBM Big Replicate for Backup L-MBIS-BKL2FA

Follow-on releases, if any, may have updated terms. See the License Information documents website for more information.

Limited warranty applies

Yes

Limited warranty

IBM warrants that when the program is used in the specified operating environment, it will conform to its specifications. The warranty applies only to the unmodified portion of the program. IBM does not warrant uninterrupted or error-free operation of the program or that IBM will correct all program defects. You are responsible for the results obtained from the use of the program.

IBM provides you with access to IBM databases containing information about known program defects, defect corrections, restrictions, and bypasses at no additional charge. For further information, see the IBM Support Guide.

IBM will maintain this information for at least one year after the original licensee acquires the program (warranty period).

Program technical support

Technical support of a program product version or release will be available for a minimum of three years from the general availability date, as long as your Software Subscription and Support (also referred to as Software Maintenance) is in effect.

This technical support allows you to obtain assistance (by telephone or electronic means) from IBM for product-specific, task-oriented questions regarding the installation and operation of the program product. Software Subscription and Support (Software Maintenance) also provides you with access to updates (modifications or fixes), releases, and versions of the program. You will be notified, through an announcement letter, of discontinuance of support with 12 months' notice.

If you require additional technical support from IBM, including an extension of support beyond the discontinuance date, contact your IBM representative or IBM Business Partner. This extension may be available for a fee.

For additional information about the IBM Software Support Lifecycle Policy, see the IBM Software Support Lifecycle Policy website.

Money-back guarantee

If for any reason you are dissatisfied with the program and you are the original licensee, you may obtain a refund of the amount you paid for it, if within 30 days of your invoice date you return the program and its PoE to the party from whom you obtained it. If you downloaded the program, you may contact the party from whom you acquired it for instructions on how to obtain the refund.

For clarification, note that (1) for programs acquired under the IBM International Passport Advantage offering, this term applies only to your first acquisition of the program and (2) for programs acquired under any of IBM's On/Off Capacity on Demand (On/Off CoD) software offerings, this term does not apply since these offerings apply to programs already acquired and in use by you.

Volume orders (IVO)

No

Passport Advantage applies

Yes, information is available on the Passport Advantage and Passport Advantage Express website.

Software Subscription and Support applies

Yes. Software Subscription and Support, also referred to as Software Maintenance, is included with licenses purchased through Passport Advantage and Passport Advantage Express. Product upgrades and Technical Support are provided by the Software Subscription and Support offering as described in the Agreements. Product upgrades provide the latest versions and releases to entitled software, and Technical Support provides voice and electronic access to IBM support organizations, worldwide.

IBM includes one year of Software Subscription and Support with each program license acquired. The initial period of Software Subscription and Support can be extended by the purchase of a renewal option, if available.

While your Software Subscription and Support is in effect, IBM provides you assistance for your routine, short duration installation and usage (how-to) questions, and code-related questions. IBM provides assistance by telephone and, if available, electronic access, only to your information systems (IS) technical support personnel during the normal business hours (published prime shift hours) of your IBM support center. (This assistance is not available to your users.) IBM provides Severity 1 assistance 24 hours a day, 7 days a week. For additional details, see the IBM Support Guide. Software Subscription and Support does not include assistance for the design and development of applications, your use of programs in other than their specified operating environment, or failures caused by products for which IBM is not responsible under the applicable agreements.

Unless specified otherwise in a written agreement with you, IBM does not provide support for third-party products that were not provided by IBM. Ensure that when contacting IBM for covered support, you follow problem determination and other instructions that IBM provides, including in the IBM Support Guide.

For additional information about the International Passport Advantage Agreement and the IBM International Passport Advantage Express Agreement, go to the Passport Advantage and Passport Advantage Express website.

Variable charges apply

No

Educational allowance available

Not applicable.



Back to topBack to top

Statement of good security practices

Top rule

IT system security involves protecting systems and information through intrusion prevention, detection, and response to improper access from within and outside your enterprise. Improper access can result in information being altered, destroyed, or misappropriated or can result in misuse of your systems to attack others. Without a comprehensive approach to security, no IT system or product should be considered completely secure and no single product or security measure can be completely effective in preventing improper access. IBM systems and products are designed to be part of a regulatory compliant, comprehensive security approach, which will necessarily involve additional operational procedures, and may require other systems, products, or services to be most effective.

Important: IBM does not warrant that any systems, products, or services are immune from, or will make your enterprise immune from, the malicious or illegal conduct of any party.



Back to topBack to top

Prices

Top rule

For additional information and current prices, contact your local IBM representative or IBM Business Partner.


Business Partner information

If you are an IBM Business Partner acquiring products from IBM, you may link to Passport Advantage Online for resellers where you can obtain Business Partner pricing information. An IBMid and password are required to access the IBM Passport Advantage or IBM PartnerWorld® website.


Passport Advantage

For Passport Advantage information and charges, contact your IBM representative or IBM Business Partner. Additional information is also available on the Passport Advantage and Passport Advantage Express website.



Back to topBack to top

Order now

Top rule

To order, contact the IBM Digital Sales Center, your local IBM representative, or your IBM Business Partner. To identify your local IBM representative or IBM Business Partner, call 800-IBM-4YOU (426-4968). For more information, contact the IBM Digital Sales Center.

Phone: 800-IBM-CALL (426-2255)

Fax: 800-2IBM-FAX (242-6329)

For IBM representative: askibm@ca.ibm.com

For IBM Business Partner: pwcs@us.ibm.com



IBM Digital Sales Offices
1177 S Belt Line Rd
Coppell, TX 75019-4642, US

The IBM Digital Sales Center, our national direct marketing organization, can add your name to the mailing list for catalogs of IBM products.

Note: Shipments will begin after the planned availability date.

Trademarks

IBM, Db2, Cognos, Passport Advantage, Express, PartnerWorld and POWER are registered trademarks of IBM Corporation in the United States, other countries, or both.

Microsoft is a trademark of Microsoft Corporation in the United States, other countries, or both.

Red Hat is a registered trademark of Red Hat Inc. in the U.S. and other countries.

The registered trademark Linux® is used pursuant to a sublicense from the Linux Foundation, the exclusive licensee of Linus Torvalds, owner of the mark on a world­wide basis.

Oracle and Java are trademarks of Oracle and/or its affiliates in the United States, other countries, or both.

Other company, product, and service names may be trademarks or service marks of others.

Terms of use

IBM products and services which are announced and available in your country can be ordered under the applicable standard agreements, terms, conditions, and prices in effect at the time. IBM reserves the right to modify or withdraw this announcement at any time without notice. This announcement is provided for your information only. Additional terms of use are located at

Terms of use

For the most current information regarding IBM products, consult your IBM representative or reseller, or go to the IBM worldwide contacts page

IBM United States