Treehouse Software, Inc. Collaborates with Google Cloud to Offer Mainframe-to-Google Cloud Data Replication for Enterprise Transformation and Modernization

by Joseph Brady, Director of Business Development / Cloud Alliance Lead at Treehouse Software, Inc.

_0_Treehouse_And_Google_Cloud_Logos_H

Treehouse Software, Inc. is pleased to announce an agreement with Google Cloud as a technology partner in the Google Cloud Partner Advantage Program. As a technology partner, Treehouse Software Inc. will now offer enterprise customers a comprehensive Mainframe-to-Google Cloud data replication and migration solution. This relationship provides Google Cloud customers with Treehouse’s combination of decades worth of mainframe systems experience and comprehensive data replication capabilities, with Google Cloud’s platform.

The Google Cloud Enterprise Transformation Practice assists companies in migrating and modernizing workloads on Google Cloud’s global, secure, and reliable platform. Once an enterprise’s data is on Google Cloud, they can immediately take advantage of some of the most advanced artificial intelligence, machine learning, big data analytics, and data warehousing services in the world.

01_tcV_Arch_Google_Cloud

The same technology that supports Google’s global network protects data while meeting rigorous industry-specific compliance standards, and Treehouse Software’s tcVISION product moves or syncs mainframe data with real-time and bi-directional data replication. tcVISION’s GUI modeling and mapping, and ease of migrating data to Google Cloud, makes it an ideal choice for modernizing large mainframe environments.

“Through this exciting new collaboration with Google Cloud, Treehouse Software expands its mature and proven mainframe data delivery capabilities, and customers benefit from modernization of their data on one of the most popular and advanced Cloud platforms in the world”, said Joseph Brady, Director of Business Development and Cloud Alliance Lead at Treehouse Software.


__tsi_logo_400x200

Contact Treehouse Software Today…

Treehouse Software has been helping mainframe enterprises since 1982, and our extensive experience, deep knowledge, and wide-ranging capabilities in mainframe technologies makes us a valued partner and a trusted advisor to customers.

No matter where you want your mainframe data to go – the cloud, open systems, or any LUW target – tcVISION from Treehouse Software is your answer.

Just fill out the Treehouse Software Product Demonstration Request Form and a Treehouse representative will contact you to set up a time for your online tcVISION demonstration.

Don’t Jump in the Lake Without Treehouse Software! We Can Help Your Enterprise Safely Move Large Volumes of Mainframe Data to Centralized, Scalable, Cloud-Based Repositories

by Joseph Brady, Director of Business Development / Cloud Alliance Lead at Treehouse Software, Inc.

___JumpInTheLake

Many enterprises have relied on traditional data infrastructures for decades, but older data solutions can’t keep up with the volume and variety of data being collected today. This blog takes a look at building a data lake on Amazon Web Services (AWS), which allows you to store all of your data in one central repository.

What is a Data Lake?

A data lake is a centralized repository for storing structured and unstructured data at any scale. A customer can store data as-is, without having to first structure the data, and run different types of analytics—from dashboards and visualizations to big data processing, real-time analytics, and machine learning to guide better decisions.

___AWS_Data_Lake

Depending on the requirements, a typical organization will require both a data warehouse and a data lake as they serve different needs, and use cases.

A data warehouse is a database optimized to analyze relational data coming from transactional systems and line of business applications. The data structure, and schema are defined in advance to optimize for fast SQL queries, where the results are typically used for operational reporting and analysis. Data is cleaned, enriched, and transformed so it can act as the “single source of truth” that users can trust.

A data lake is different, because it stores relational data from line of business applications, and non-relational data from mobile apps, IoT devices, and social media. The structure of the data or schema is not defined when data is captured. This means you can store all of your data without careful design or the need to know what questions you might need answers for in the future. Different types of analytics on your data like SQL queries, big data analytics, full text search, real-time analytics, and machine learning can be used to uncover insights.

As organizations with data warehouses see the benefits of data lakes, they are evolving their warehouses to include data lakes, and enable diverse query capabilities, data science use-cases, and advanced capabilities for discovering new information models. Gartner names this evolution the “Data Management Solution for Analytics” or “DMSA.”

Data lakes built on Amazon S3 provide the foundation for analytics and innovation, and AWS Partner Network (APN) Partners have demonstrated success in helping enterprises evaluate and use the tools and best practices for collecting, storing, governing, and analyzing data.

Key data lake-enabling features of Amazon S3 include the following:

  • Decoupling of storage from compute and data processing – With Amazon S3, you can cost-effectively store all data types in their native formats. You can then launch as many or as few virtual servers as you need using Amazon Elastic Compute Cloud (EC2), and you can use AWS analytics tools to process your data. You can optimize your EC2 instances to provide the right ratios of CPU, memory, and bandwidth for best performance.
  • Centralized data architecture – Amazon S3 makes it easy to build a multi-tenant environment, where many users can bring their own data analytics tools to a common set of data. This improves both cost and data governance over that of traditional solutions, which require multiple copies of data to be distributed across multiple processing platforms.
  • Integration with clusterless and serverless AWS services – Use Amazon S3 with Amazon Athena, Amazon Redshift Spectrum, Amazon Rekognition, and AWS Glue to query and process data. Amazon S3 also integrates with AWS Lambda serverless computing to run code without provisioning or managing servers. With all of these capabilities, you only pay for the actual amounts of data you process or for the compute time that you consume.
  • Standardized APIs – Amazon S3 RESTful APIs are simple, easy to use, and supported by most major third-party independent software vendors (ISVs), including leading Apache Hadoop and analytics tool vendors. This allows customers to bring the tools they are most comfortable with and knowledgeable about to help them perform analytics on data in Amazon S3.

— Source: AWS


Getting to the Lake: Mainframe-to-AWS Data Replication with tcVISION…

An enterprise’s long-standing mainframe data can be residing on one, or a combination of  databases, including IBM Db2, IBM VSAM, IBM IMS/DB, Software AG Adabas, CA IDMS, CA Datacom, or even sequential files.  Treehouse Software’s tcVISION writes .csv or JSON to AWS S3, providing an optimal foundation for a data lake, because of its virtually unlimited scalability.

Here is a look at three options for data replication with tcVISION:

1. tcVISION Bulk Load of Mainframe Data – Initial load of the database where tables can be loaded as a parallel operation in one or more EC2 instances. tcVISION reads the database from the mainframe directly, and can FTP or use S3 to migrate unloads directly to the EC2 instance.

___tcVISION_AWS_Bulk_Load

2. tcVISION Enterprise Change Data Capture (CDC) Integration – A multiple platform solution for real-time, continuous data synchronization and replication based on log-based Change Data Capture technology and mainframe batch integration. It turns data exchange into a single-step operation as it includes a powerful repository for data transparency, data transformation, and apply processing logic for the targets. Transfer mainframe data to your AWS targets continuously and in real-time for Big Data, Analytics, Business Intelligence, ERP, CRM, or for application modernization or mainframe offload initiatives or mainframe migration.

___tcVISION_AWS_CDC

3. tcVISION Bi-directional Data ReplicationtcVISION allows bi-directional, real-time data synchronization of changes on either platform to be reflected on the other platform (e.g., a change to a PostgreSQL table is reflected back on mainframe). The customer can then modernize their application on the cloud, open systems, etc. without disrupting the existing critical work on the legacy system.

___tcVISION_AWS_BiDirect

The tcVISION solution focuses on CDC when transferring information between mainframe data sources and Cloud databases and applications. Through an innovative technology, changes occurring in any mainframe application data are tracked and captured, and then published to a variety of Cloud targets.


Further reading: tcVISION Mainframe-to-AWS data replication is featured on the AWS Partner Network Blog…

___tcVISION_AWS_HA_Architecture

Treehouse Software is an AWS Technology Partner, and AWS published a blog about tcVISION’s Mainframe-to-AWS data replication capabilities, including a technical overview, security, high availability, scalability, and a step-by-step example of the creation of tcVISION metadata and scripts for replicating mainframe Db2 z/OS data to Amazon Aurora.

Read the blog here: AWS Partner Network (APN) Blog: Real-Time Mainframe Data Replication to AWS with tcVISION from Treehouse Software.


__tsi_logo_400x200

Contact Treehouse Software Today…

Treehouse Software has been helping mainframe enterprises since 1982, and our extensive experience, deep knowledge, and wide-ranging capabilities in mainframe technologies makes us a valued partner and a trusted advisor to customers.

No matter where you want your mainframe data to go – the cloud, open systems, or any LUW target – tcVISION from Treehouse Software is your answer.

Just fill out the Treehouse Software Product Demonstration Request Form and a Treehouse representative will contact you to set up a time for your online tcVISION demonstration.

Treehouse Software Customer Successes: Real-time, Bi-directional Data Synchronization Between Mainframe, Cloud, LUW, and Open Systems

_0_CustomerLogos01

Treehouse Software’s customer base includes many large companies, universities, and government organizations located in the United States and worldwide. Read about some of our Data Integration and Replication Customer Case Studies (PDF Documents) using tcVISION from the following links:

Many more mainframe data migration and replication customer case studies can be read on the Treehouse Software Website.


__TSI_LOGO

Contact Treehouse Software for a Demo Today…

Just fill out the Treehouse Software Product Demonstration Request Form and a Treehouse representative will contact you to set up a time for your online tcVISION demonstration.

U.S. Government Customers Can Now Use Treehouse Software’s tcVISION Mainframe Data Replication on the AWS GovCloud

Treehouse Software’s tcVISION Mainframe-to-AWS data replication product is now available in the AWS GovCloud (US) Region of the AWS Marketplace.

The AWS GovCloud (US) Region is designed to host sensitive data, regulated workloads, and address the most stringent U.S. government security and compliance requirements.

The AWS GovCloud (US) is available to government customers, organizations in government-regulated industries, and other private entities that meet AWS GovCloud (US) requirements.

AWS GovCloud (US) gives government customers and their partners the flexibility to architect secure cloud solutions that comply with: the FedRAMP High baseline, the DOJ’s Criminal Justice Information Systems (CJIS) Security Policy, U.S. International Traffic in Arms Regulations (ITAR), Export Administration Regulations (EAR), Department of Defense (DoD) Cloud Computing Security Requirements Guide (SRG) for Impact Levels 2, 4 and 5, FIPS 140-2, IRS-1075, and other compliance regimes.

From Personally Identifiable Information (PII), sensitive patient medical records, and financial data to law enforcement data, export controlled data and other forms of CUI, AWS GovCloud (US) Regions can help customers address compliance at every stage of their cloud journey.


_0_AWS_Marketplace_Logo01

The tcVISION Amazon Machine Images (AMIs) are available on the AWS Marketplace. A tcVISION AMI automatically sets up the product on the AWS Cloud and allows customers to use it with either backup/recovery mainframe files or Windows files, or to set up connectivity for real-time, on-premises mainframe data replication to AWS. An enterprise with mission critical data in a mainframe environment can rapidly deploy databases globally within minutes, and with minimal administration requirements. U.S Government sites can simply choose the region “AWS GovCloud (US)” under “Pricing Information” when choosing and AMI.

_0_tcV_To_AWS_Cloud

There are three versions of the tcVISION AMI on the AWS Marketplace, and #1 and #3 require two-week trial license keys provide by Treehouse Software:

1. tcVISION Mainframe Batch Integration (MBI) for AWS – Bring Your Own License (Customers must contact Treehouse Software for license key to run the software): This AMI does not require an active connection to the mainframe, because the existing backup and recovery files from the mainframe, such as Db2 imagecopies, z/OS archive log files or IMS Unloads, Adabas unload, and PLOG files can be used.

2. tcVISION Distributed Database Integration (DDI) for AWS – Pay as You Go on AWS: This AMI license installation includes security keys for Amazon S3 access and a license to use one source (PostgreSQL, Oracle, MySQL, MariaDB; MSSQL on Windows OS only) and one target (AWS S3, AWS Aurora, RDS – PostgreSQL, Oracle, MySQL, MariaDB; MSSQL on Windows OS only).

3. tcVISION Enterprise Change Data Capture (CDC) Integration for AWS – Bring Your Own License (Customers must contact Treehouse Software for license key to run the software): This AMI allows transfer of mainframe data to AWS targets continuously and in real-time. Using this tcVISION AMI, a customer can deploy databases globally within minutes.


About the AWS Marketplace…

_0_AWS_Marketplace_Logo01

The AWS Marketplace is an online software store that helps customers find, buy, and immediately start using the software and services that run on AWS.


__TSI_LOGO

Visit the Treehouse Software website for more information on tcVISION, or contact us to discuss your needs.

Try out Mainframe Data Replication on the AWS Cloud with tcVISION Amazon Machine Images (AMIs)

Treehouse Software is pleased  to announce that the tcVISION Amazon Machine Images (AMIs) are now officially released on the AWS Marketplace. The tcVISION AMI automatically sets up the product on the AWS Cloud and allows customers to use it with either backup/recovery mainframe files or Windows files, or to set up connectivity for real-time, on-premises mainframe data replication to AWS. An enterprise with mission critical data in a mainframe environment can rapidly deploy databases globally within minutes, and with minimal administration requirements.

_0_tcV_To_AWS_Cloud

There are three versions of the tcVISION AMI on the AWS Marketplace, and #1 and #3 require two-week trial license keys provide by Treehouse Software:

1. tcVISION Mainframe Batch Integration (MBI) for AWS – Bring Your Own License (Customers must contact Treehouse Software for license key to run the software): This AMI does not require an active connection to the mainframe, because the existing backup and recovery files from the mainframe, such as Db2 imagecopies, z/OS archive log files or IMS Unloads, Adabas unload, and PLOG files can be used.

2. tcVISION Distributed Database Integration (DDI) for AWS – Pay as You Go on AWS: This AMI license installation includes security keys for Amazon S3 access and a license to use one source (PostgreSQL, Oracle, MySQL, MariaDB; MSSQL on Windows OS only) and one target (AWS S3, AWS Aurora, RDS – PostgreSQL, Oracle, MySQL, MariaDB; MSSQL on Windows OS only).

3. tcVISION Enterprise Change Data Capture (CDC) Integration for AWS – Bring Your Own License (Customers must contact Treehouse Software for license key to run the software): This AMI allows transfer of mainframe data to AWS targets continuously and in real-time. Using this tcVISION AMI, a customer can deploy databases globally within minutes.

tcVISION Offers a Wide Variety of Connectivity

_0_tcVISION_Connection_Overview01

tcVISION supports AWS Relational Database Service (RDS) databases, such as Aurora, PostgreSQL, MySQL, SQL Server, and Maria DB as targets, in addition to traditional Linux/Unix/Windows (LUW) targets such as Oracle, IBM Db2 LUW, Software AG Adabas LUW, IBM Informix, Sybase, Microsoft SQL Server, PostgreSQL, and ODBC.

tcVISION on-premises acquires large amounts of data in bulk or via change data capture methods, including in real time, from virtually any IBM mainframe data source (Software AG Adabas, IBM Db2, IBM VSAM, IBM IMS/DB, CA IDMS, CA Datacom, even sequential files), and transforms and delivers it to the AWS Cloud.

Users can easily model and map their data, and create links between data sources and target systems with tcVISION‘s GUI interface. tcVISION also has features to prevent looping and provide conflict detection for bidirectional data processing, allowing mainframe updates to be reflected on the AWS databases and changes on the AWS databases to be reflected back to the mainframe again.

About the AWS Marketplace…

_0_AWS_Marketplace_Logo01

The AWS Marketplace is an online software store that helps customers find, buy, and immediately start using the software and services that run on AWS.


__TSI_LOGO

Visit the Treehouse Software website for more information on tcVISION, or contact us to discuss your needs.

Treehouse Software Customers are Looking Upwards to Mainframe-to-Cloud Data Replication

The search is on for a mature, easy-to-implement Extract Transform and Load (ETL) solution for migrating mission critical data to the cloud.

Mainframe_to_Cloud

Treehouse Software’s tcVISION supports a vast array of integration scenarios throughout the enterprise, providing easy and fast data migration for mainframe application modernization projects, and enabling data replication between mainframe, Linux, Unix and Windows platforms. This innovative technology offers comprehensive abilities to identify and capture changes occurring in mainframe and relational databases, then publish the required information to an impressive variety of targets, both on-premise and cloud-based.

Mainframe-to-Cloud Case Use Example…

BAWAG P.S.K. is one of the largest banks in Austria, with more than 1.6 million private and business customers and is a well-known brand in the country. Their business strategy is oriented towards low risk and high efficiency.

BAWAG was looking to reduce the load on their IBM mainframe and as a result, reduce costs. The project involved offloading data from their core database system to a less expensive system, in real-time, and to provide read access from that system to the new infrastructure. The primary motivator for this data migration was the constantly increasing CPU costs on the mainframe caused by the growing transaction load of online banking, mobile banking, and the use of self service devices.

BAWAG ultimately migrated their online banking application to the cloud using tcVISION. Realtime Event-handling, Realtime Analytics, Realtime Fraud Prevention are only a few of the use cases that the bank’s solution currently covers.

BAWAG_Diagram

The bank decided to use tcVISION to migrate z/OS DB2 data into a Hadoop data lake (a storage repository that holds raw data in its native format). 20 Million transactions were made within 15 minutes.

Cost Reductions Seen Immediately

BAWAG is now seeing a 35-40 percent reduction of the MIPS consumption for online processing during business hours. After hours, consumption is less, because it is mainly batch processing on the mainframe. Currently, a volume of approximately 30 GB changed data (uncompressed) is replicated from DB2 per day.

In addition to the primary usage scenario, BAWAG can also cover additional use cases. This includes real-time-event handling and stream processing, analytics based upon real-time data as well as the possibility to report and analyze structured and unstructured data with excellent performance. The system can be inexpensively operated on Commodity Hardware and has no scalability limitations. Compared to the savings, the costs of replication (CPU consumption) of tcVISION are now very low.

Additionally, BAWAG plans to extend the use of tcVISION in the future, including implementation of real-time replication from ORACLE into the data lake.


Find out more about tcVISION — Enterprise ETL and Real-Time Data Replication Through Change Data Capture

tcVISION supports a vast array of integration scenarios throughout the enterprise, providing easy and fast data migration for mainframe application modernization projects and enabling bi-directional data replication between mainframe, Linux, Unix and Windows platforms. This innovative technology offers comprehensive abilities to identify and capture changes occurring in mainframe and relational databases, then publish the required information to an impressive variety of targets, both on-premise and Cloud-based.

_0_tcvision_connection_overview

tcVISION acquires data in bulk or via change data capture methods, including in real time, from virtually any IBM mainframe data source (Software AG Adabas, IBM DB2, IBM VSAM, IBM IMS/DB, CA IDMS, CA Datacom, even sequential files), and transform and deliver to virtually any target. In addition, the same product can extract and replicate data from a variety of non-mainframe sources, including Adabas LUW, Oracle Database, Microsoft SQL Server, IBM DB2 LUW and DB2 BLU, IBM Informix and PostgreSQL.


__TSI_LOGO

Visit the Treehouse Software website for more information on tcVISION, or contact us to discuss your needs.