High Availability Requirements for Mainframe Data Modernization — Running tcVISION in Global Availability Zones

by Joseph Brady, Director of Business Development / Cloud Alliance Lead at Treehouse Software, Inc.

Many customers embarking on Mainframe-to-Cloud data replication projects with Treehouse Software are looking at high availability (HA) as a key consideration in the planning process. The goal with HA is to ensure that systems are always functioning and accessible, with deployments located in various Availability Zones (AZs) worldwide. Having an HA architecture in place protects against data center, availability zone, server, network, and storage subsystem failures to keep businesses running without downtime or human intervention.

In this blog, we will give a high-level overview of tcVISION HA Architecture, using AWS as an example. However, HA basic principles are essentially the same across all Cloud platforms.

Example of the tcVISON HA Architecture on AWS

During tcVISION’s Change Data Capture (CDC) processing for Mainframe-to-Cloud data replication, HA must be maintained in the AWS environment. The Amazon Elastic Compute Cloud (Amazon EC2), which contains the tcVISION Manager, is part of an Auto Scaling Group that is spread across AZs with Amazon EC2 instance(s).

___tcVISION_AWS_HA_Architecture

Upon failure, the replacement Amazon EC2 instance tcVISION Manager is launched and communicates its IP address to the mainframe tcVISION Manager. The mainframe tcVISION Manager then starts communication with the replacement Amazon EC2 tcVISION Manager.

Once the Amazon EC2 tcVISION Manager is restarted, it continues processing at its next logical restart point, using a combination of the LUW and Restart files. LUW files contain committed data transactions not yet applied to the target database. Restart files contain a pointer to the last captured and committed transaction and queued uncommitted CDC data. Both file types are stored on a highly available data store, such as Amazon Elastic File System (EFS).

For production workloads, Treehouse Software recommends turning on Multi-AZ target and metadata databases.

To keep all the dynamic data in an HA architecture, tcVISION uses EFS, which provides a simple, scalable, fully managed elastic file system for use with AWS Cloud services and on-premises resources. It is built to scale on-demand to petabytes without disrupting applications, growing and shrinking automatically as you add and remove files, eliminating the need to provision and manage capacity to accommodate growth.


Treehouse Software can help organizations immediately start moving their mainframe data to the Cloud and take advantage of the most advanced, scalable, secure, and highly available technologies in the world with tcVISION

tcVISION_Overall_Diagram_General_Cloud

tcVISION supports a vast array of integration scenarios throughout the enterprise, providing easy and fast data migration for mainframe application modernization projects and enabling bi-directional data replication between mainframe, Cloud, Open Systems, Linux, Unix, and Windows platforms.

View the Unequalled List of Environments Supported by tcVISION Here


__TSI_LOGO

___AWS_Select_Partner_Badge ___Google_Cloud_Partner_Badge

Contact Treehouse Software for a Demo Today…

Just fill out the Treehouse Software Product Demonstration Request Form and a Treehouse representative will contact you to set up a time for your tcVISION demonstration. This will be a live, on-line demonstration that shows tcVISION replicating data from the mainframe to a Cloud target database.

Now, more than ever, enterprises with mainframes are looking to modernize their legacy systems

by Joseph Brady, Director of Business Development / Cloud Alliance Lead at Treehouse Software, Inc.

Rapidly changing global health, economic, and political conditions are making fast access to the most current information more important than ever for official agencies and the public.  As a result, modernizing information systems is taking center stage and top priority, especially for organizations with critical mainframe data residing on a variety of long-standing databases, often still updated by COBOL applications! These databases include Db2, VSAM, IMS/DB, Adabas, IDMS, Datacom, or even sequential files. Unlocking the value of this important data can be difficult, because the data can be utilized by numerous interlinked and dependent programs that have been in place for many years, and sometimes decades.

Many organizations are now looking for modernization solutions that allow their legacy mainframe environments to continue, while replicating data in real time on highly available Cloud-based platforms (AWS, Google Cloud, Microsoft Azure, etc.). With a “data-first” approach, immediate data replication to the Cloud is enabling government, healthcare, supply chain, financial, and a variety of public service organizations to meet spikes in demand for vital information, especially in times of crisis.

Treehouse Software can help organizations immediately start moving their mainframe data to the Cloud and take advantage of the most advanced technologies in the world with tcVISION

tcVISION_Overall_Diagram_General_Cloud

Whether an enterprise needs to take advantage of the latest Cloud services, such as big data analytics, artificial intelligence (AI), rapid global database deployments, high-level security, etc., or move data to a variety of newer Cloud or Open Systems databases, the transition doesn’t have to be a sudden big bang.

A Phased Approach

Treehouse Software has extensive mainframe experience and subject matter experts to help organizations incrementally replicate their mainframe data to the Cloud and other modern systems, while keeping both sides synchronized.

Treehouse Software’s expert technical representatives help customers develop a phased plan that includes installation and implementation of the tcVISION mainframe data modernization product, script customization, data replication mapping, high availability, security, monitoring, training, etc..

After defining the architecture, the production deployment phase begins with incremental sprint-like deployments. Additional files are then deployed into production regularly.

This phased plan enables tcVISION to synchronize critical mainframe data to a Cloud / Open Systems database. Bi-directional, real-time data synchronization allows changes on either platform to be reflected on the other platform (e.g., a change to a PostgreSQL table is reflected back on mainframe). The customer can then modernize their application on the cloud, open systems, etc. without disrupting the existing critical work on the legacy system.

Additionally, tcVISION customers see drastically reduced mainframe MIPS costs, and increased ability to quickly respond to business environment changes.

Enterprise ETL and Real-time and Bi-directional Data Replication Through Change Data Capture with tcVISION

tcVISION uses an intuitive Windows GUI interface for administration, mapping and modeling, script generation, and monitoring. The product focuses on changed data capture (CDC) when transferring information between mainframe data sources and modern databases and applications. Through an innovative technology, changes occurring in any mainframe application data are tracked and captured, and then published to a variety of targets.

tcVISION – Supported Sources and Targets

tcVISION supports a vast array of integration scenarios throughout the enterprise, providing easy and fast data migration for mainframe application modernization projects and enabling bi-directional data replication between mainframe, Cloud, Open Systems, Linux, Unix, and Windows platforms.

View the Unequalled List of Environments Supported by tcVISION Here


__TSI_LOGO

___AWS_Select_Partner_Badge ___Google_Cloud_Partner_Badge

Contact Treehouse Software for a Demo Today…

Just fill out the Treehouse Software Product Demonstration Request Form and a Treehouse representative will contact you to set up a time for your tcVISION demonstration. This will be a live, on-line demonstration that shows tcVISION replicating data from the mainframe to a Cloud target database.

Treehouse Software, Inc. Collaborates with Google Cloud to Offer Mainframe-to-Google Cloud Data Replication for Enterprise Transformation and Modernization

by Joseph Brady, Director of Business Development / Cloud Alliance Lead at Treehouse Software, Inc.

_0_Treehouse_And_Google_Cloud_Logos_H

Treehouse Software, Inc. is pleased to announce an agreement with Google Cloud as a technology partner in the Google Cloud Partner Advantage Program. As a technology partner, Treehouse Software Inc. will now offer enterprise customers a comprehensive Mainframe-to-Google Cloud data replication and migration solution. This relationship provides Google Cloud customers with Treehouse’s combination of decades worth of mainframe systems experience and comprehensive data replication capabilities, with Google Cloud’s platform.

The Google Cloud Enterprise Transformation Practice assists companies in migrating and modernizing workloads on Google Cloud’s global, secure, and reliable platform. Once an enterprise’s data is on Google Cloud, they can immediately take advantage of some of the most advanced artificial intelligence, machine learning, big data analytics, and data warehousing services in the world.

01_tcV_Arch_Google_Cloud

The same technology that supports Google’s global network protects data while meeting rigorous industry-specific compliance standards, and Treehouse Software’s tcVISION product moves or syncs mainframe data with real-time and bi-directional data replication. tcVISION’s GUI modeling and mapping, and ease of migrating data to Google Cloud, makes it an ideal choice for modernizing large mainframe environments.

“Through this exciting new collaboration with Google Cloud, Treehouse Software expands its mature and proven mainframe data delivery capabilities, and customers benefit from modernization of their data on one of the most popular and advanced Cloud platforms in the world”, said Joseph Brady, Director of Business Development and Cloud Alliance Lead at Treehouse Software.


__tsi_logo_400x200

Contact Treehouse Software Today…

Treehouse Software has been helping mainframe enterprises since 1982, and our extensive experience, deep knowledge, and wide-ranging capabilities in mainframe technologies makes us a valued partner and a trusted advisor to customers.

No matter where you want your mainframe data to go – the cloud, open systems, or any LUW target – tcVISION from Treehouse Software is your answer.

Just fill out the Treehouse Software Product Demonstration Request Form and a Treehouse representative will contact you to set up a time for your online tcVISION demonstration.

Don’t Jump in the Lake Without Treehouse Software! We Can Help Your Enterprise Safely Move Large Volumes of Mainframe Data to Centralized, Scalable, Cloud-Based Repositories

by Joseph Brady, Director of Business Development / Cloud Alliance Lead at Treehouse Software, Inc.

___JumpInTheLake

Many enterprises have relied on traditional data infrastructures for decades, but older data solutions can’t keep up with the volume and variety of data being collected today. This blog takes a look at building a data lake on Amazon Web Services (AWS), which allows you to store all of your data in one central repository.

What is a Data Lake?

A data lake is a centralized repository for storing structured and unstructured data at any scale. A customer can store data as-is, without having to first structure the data, and run different types of analytics—from dashboards and visualizations to big data processing, real-time analytics, and machine learning to guide better decisions.

___AWS_Data_Lake

Depending on the requirements, a typical organization will require both a data warehouse and a data lake as they serve different needs, and use cases.

A data warehouse is a database optimized to analyze relational data coming from transactional systems and line of business applications. The data structure, and schema are defined in advance to optimize for fast SQL queries, where the results are typically used for operational reporting and analysis. Data is cleaned, enriched, and transformed so it can act as the “single source of truth” that users can trust.

A data lake is different, because it stores relational data from line of business applications, and non-relational data from mobile apps, IoT devices, and social media. The structure of the data or schema is not defined when data is captured. This means you can store all of your data without careful design or the need to know what questions you might need answers for in the future. Different types of analytics on your data like SQL queries, big data analytics, full text search, real-time analytics, and machine learning can be used to uncover insights.

As organizations with data warehouses see the benefits of data lakes, they are evolving their warehouses to include data lakes, and enable diverse query capabilities, data science use-cases, and advanced capabilities for discovering new information models. Gartner names this evolution the “Data Management Solution for Analytics” or “DMSA.”

Data lakes built on Amazon S3 provide the foundation for analytics and innovation, and AWS Partner Network (APN) Partners have demonstrated success in helping enterprises evaluate and use the tools and best practices for collecting, storing, governing, and analyzing data.

Key data lake-enabling features of Amazon S3 include the following:

  • Decoupling of storage from compute and data processing – With Amazon S3, you can cost-effectively store all data types in their native formats. You can then launch as many or as few virtual servers as you need using Amazon Elastic Compute Cloud (EC2), and you can use AWS analytics tools to process your data. You can optimize your EC2 instances to provide the right ratios of CPU, memory, and bandwidth for best performance.
  • Centralized data architecture – Amazon S3 makes it easy to build a multi-tenant environment, where many users can bring their own data analytics tools to a common set of data. This improves both cost and data governance over that of traditional solutions, which require multiple copies of data to be distributed across multiple processing platforms.
  • Integration with clusterless and serverless AWS services – Use Amazon S3 with Amazon Athena, Amazon Redshift Spectrum, Amazon Rekognition, and AWS Glue to query and process data. Amazon S3 also integrates with AWS Lambda serverless computing to run code without provisioning or managing servers. With all of these capabilities, you only pay for the actual amounts of data you process or for the compute time that you consume.
  • Standardized APIs – Amazon S3 RESTful APIs are simple, easy to use, and supported by most major third-party independent software vendors (ISVs), including leading Apache Hadoop and analytics tool vendors. This allows customers to bring the tools they are most comfortable with and knowledgeable about to help them perform analytics on data in Amazon S3.

— Source: AWS


Getting to the Lake: Mainframe-to-AWS Data Replication with tcVISION…

An enterprise’s long-standing mainframe data can be residing on one, or a combination of  databases, including IBM Db2, IBM VSAM, IBM IMS/DB, Software AG Adabas, CA IDMS, CA Datacom, or even sequential files.  Treehouse Software’s tcVISION writes .csv or JSON to AWS S3, providing an optimal foundation for a data lake, because of its virtually unlimited scalability.

Here is a look at three options for data replication with tcVISION:

1. tcVISION Bulk Load of Mainframe Data – Initial load of the database where tables can be loaded as a parallel operation in one or more EC2 instances. tcVISION reads the database from the mainframe directly, and can FTP or use S3 to migrate unloads directly to the EC2 instance.

___tcVISION_AWS_Bulk_Load

2. tcVISION Enterprise Change Data Capture (CDC) Integration – A multiple platform solution for real-time, continuous data synchronization and replication based on log-based Change Data Capture technology and mainframe batch integration. It turns data exchange into a single-step operation as it includes a powerful repository for data transparency, data transformation, and apply processing logic for the targets. Transfer mainframe data to your AWS targets continuously and in real-time for Big Data, Analytics, Business Intelligence, ERP, CRM, or for application modernization or mainframe offload initiatives or mainframe migration.

___tcVISION_AWS_CDC

3. tcVISION Bi-directional Data ReplicationtcVISION allows bi-directional, real-time data synchronization of changes on either platform to be reflected on the other platform (e.g., a change to a PostgreSQL table is reflected back on mainframe). The customer can then modernize their application on the cloud, open systems, etc. without disrupting the existing critical work on the legacy system.

___tcVISION_AWS_BiDirect

The tcVISION solution focuses on CDC when transferring information between mainframe data sources and Cloud databases and applications. Through an innovative technology, changes occurring in any mainframe application data are tracked and captured, and then published to a variety of Cloud targets.


Further reading: tcVISION Mainframe-to-AWS data replication is featured on the AWS Partner Network Blog…

___tcVISION_AWS_HA_Architecture

Treehouse Software is an AWS Technology Partner, and AWS published a blog about tcVISION’s Mainframe-to-AWS data replication capabilities, including a technical overview, security, high availability, scalability, and a step-by-step example of the creation of tcVISION metadata and scripts for replicating mainframe Db2 z/OS data to Amazon Aurora.

Read the blog here: AWS Partner Network (APN) Blog: Real-Time Mainframe Data Replication to AWS with tcVISION from Treehouse Software.


__tsi_logo_400x200

Contact Treehouse Software Today…

Treehouse Software has been helping mainframe enterprises since 1982, and our extensive experience, deep knowledge, and wide-ranging capabilities in mainframe technologies makes us a valued partner and a trusted advisor to customers.

No matter where you want your mainframe data to go – the cloud, open systems, or any LUW target – tcVISION from Treehouse Software is your answer.

Just fill out the Treehouse Software Product Demonstration Request Form and a Treehouse representative will contact you to set up a time for your online tcVISION demonstration.

Enterprise Mainframe Customers are Realizing the Benefits of Replicating Data to Cloud-based Relational Databases

by Joseph Brady, Director of Business Development / AWS and Cloud Alliance Lead at Treehouse Software, Inc.

Treehouse Software has been helping enterprises mainframe customers since 1982, and in recent years, we have been developing a strong presence in the emerging Cloud market space relating to mainframe data migration. This blog takes a quick look at a couple of popular Treehouse-supported Cloud relational database systems…

Amazon Aurora relational database, a MySQL and PostgreSQL-compatible relational database built for the cloud, that combines the performance and availability of traditional enterprise databases with the simplicity and cost-effectiveness of open source databases:

Google Cloud SQL, a fully managed relational database service for MySQL, PostgreSQL, and SQL server. You can connect with nearly any application, anywhere in the world. Cloud SQL automates backups, replication, and failover to ensure your database is reliable, highly available, and flexible to your performance needs:

Treehouse Software Helps to Make the Mainframe Data Move Easy…

Many enterprises’ mainframe systems house vast amounts of data  encompassing historical, customer, inventory, logistics, and a myriad of other information types. Sales leaders at Cloud platform companies and systems integrators are engaging with Treehouse Software to take advantage of our unique skills and tcVISION Mainframe-to-Cloud data replication solution to help them tap into this potential goldmine of data that needs to be made available to new technologies.

tcVISION_Overall_Diagram_General_Cloud

With tcVISION, customers can replicate mission critical data to the Cloud, and immediately take advantage of the broadest and deepest set of capabilities, including artificial intelligence (AI), machine learning, Internet of things (IoT), predictive data analytics, high performance and security, high availability across global regions, scalability, and innovation. Imagine having the most advanced technologies available for data processing, interactive analytics, real-time analytics, operational analytics, dashboards, and data warehousing at your fingertips!

Where is your mission critical data residing?

tcVISION provides the means for customers to easily replicate relevant data from most mainframe data sources (IBM Db2, IBM VSAM, IBM IMS/DB, Software AG Adabas, CA IDMS, CA Datacom, or even sequential files) to Cloud targets, including AWS, Google Cloud, Microsoft Azure, and Oracle Cloud

Walkthrough of tcVISION Mainframe Data Replication to Cloud and Open Systems in 90 Seconds…


Further reading: tcVISION Mainframe-to-AWS data replication is featured on the AWS Partner Network Blog…

___tcVISION_AWS_HA_Architecture

AWS recently published a blog about tcVISION’s Mainframe-to-Cloud data replication capabilities:

AWS Partner Network (APN) Blog: Real-Time Mainframe Data Replication to AWS with tcVISION from Treehouse Software.


__tsi_logo_400x200

Contact Treehouse Software Today…

No matter where you want your mainframe data to go – the Cloud, Open Systems, or any LUW target – tcVISION from Treehouse Software is your answer.

Just fill out the Treehouse Software Product Demonstration Request Form and a Treehouse representative will contact you to set up a time for your online tcVISION demonstration.

The New 2020 IBM Z Solutions Directory Features a Wide Selection of Mainframe Tools and Services, Including Treehouse Software’s Data Integration Products

by Joseph Brady, Director of Business Development / Cloud Alliance Lead at Treehouse Software, Inc. 

2020_IBM_Systems_Solutions_Directory

Enterprises’ investments in IBM Z mainframe technology is significant, and the IBM Z Solutions Directory showcases some of the best hardware, accessories, software products, and services available to help customers maintain and expand the platform.

Treehouse Software encourages mainframe customers to explore the IBM Z Solutions Directory, where they will find neatly organized listings that help them quickly find the products and services they need. We are very pleased to have our products included, side-by-side, with most of the top mainframe solutions in the world in this valuable guide. 


__TSI_LOGO

More About Treehouse Software’s Mature and Proven Mainframe Enterprise Transformation Products…

Treehouse_Products_Diagram_General_Cloud.jpg

Treehouse Software has been developing, marketing, selling, and supporting mainframe software since 1982, and we are committed to helping customers easily access some of the most advanced Cloud and open systems technologies in the world, while maintaining their valuable legacy environments. 

Treehouse Software’s visionary leadership in the mainframe market has included pioneering Adabas-to-RDBMS ETL and CDC with tRelational/DPS in the mid-1990s.  Today, with the tcVISION product, Treehouse Software is a global leader in providing real-time and bi-directional data replication between a variety of mainframe and non-mainframe sources, including (Mainframe): VSAM, IMS, Db2, CA Datacom, Adabas, and CA IDMS; and (Non-mainframe): Amazon Web Services (AWS), Microsoft Azure, Google Cloud, Oracle Cloud, PostgreSQL, Microsoft SQL Server, IBM Db2 LUW and Db2 BLU, IBM Informix, Kafka, MongoDB, MariaDB, Hadoop, SAP Hana, and many more.

Despite the rapid pace of change in the IT landscape, Treehouse Software’s customer base can be assured that there remains a strong commitment to providing continued support and upgrades for the product suite.

Contact Treehouse Software for a Product Demo Today…

Just fill out the Treehouse Software Product Demonstration Request Form and a Treehouse representative will contact you to set up a time for your online product demonstration.

 

Who Says Mainframes and The Cloud Don’t Mix? Treehouse Software Collaborates with Tidal Migrations to Offer Comprehensive, Scalable Enterprise Mainframe-to-Cloud Migration

by Joseph Brady, Director of Business Development / AWS and Cloud Alliance Lead at Treehouse Software, Inc.

PITTSBURGH — Treehouse Software, Inc. is pleased to announce an agreement with Toronto-based Tidal Migrations to offer enterprise customers a complete Mainframe-to-Cloud data replication and migration solution that provides fast, easy, and secure access to the Cloud.  This alliance offers mainframe customers Treehouse’s unequalled combination of decades worth of mainframe systems experience and comprehensive data replication capabilities, and Tidal Migration’s leading platform for application-centric discovery and analysis to provide customers with the data-driven insights necessary to replatform and refactor applications for the Cloud.

_0_Treehouse_And_Tidal_Logos

When assessing an application portfolio for modernization, most organizations see a Mainframe system and quickly move on.  This should not be the case.  If looking to either modernize a mainframe application, or simply distribute a mainframe database to the cloud, customers can now analyze that application for both its technical complexity, as well as its business value, and start the voyage to the cloud.

Tidal Migrations provides the assessment and Treehouse Software’s tcVISION product can move or sync a mainframe database with either AWS or Azure.  What does that mean?  It means that customers can continue running their mainframe-based production workloads on the mainframe, while developing the re-architected application using the same data in the Cloud.

Treehouse Software’s tcVISION, is a powerful and mature software product designed for real-time and bi-directional data replication.  tcVISION’s GUI modeling and mapping, and ease of migrating data to the Cloud makes it an ideal choice for modernizing large mainframe environments.  tcVISION provides the quality of service required by enterprise data workloads for security, availability, and scalability.

“Our customers often left the mainframe applications out of their analysis of the applications in their portfolio thinking that transformation was not an option,” says David Colebatch, CEO of Tidal Migrations.  “Now these apps are treated like any other with Treehouse providing a straightforward path to empowering the cloud-transition.”

Try the Tidal Migrations Platform and Tools for free: https://get.tidalmg.com/

“Through this exciting new collaboration, Treehouse Software provides globally proven mainframe data delivery capabilities, and the customer benefits from modernization of their data while achieving Cloud readiness confidence ensured by the Tidal Migrations platform,” said Joseph Brady, Director of Business Development and AWS Alliance Lead at Treehouse Software.

Read about tcVISION on the AWS Partner Network Blog: https://aws.amazon.com/blogs/apn/real-time-mainframe-data-replication-to-aws-with-tcvision-from-treehouse-software/

About Treehouse Software, Inc.

Since 1982, Treehouse Software has been serving enterprises worldwide with industry-leading mainframe-related software products and outstanding technical support.  Treehouse is an AWS Technology Partner and is a global leader in providing solutions for real-time and bi-directional data replication between a variety of mainframe and non-mainframe sources, including (Mainframe): VSAM, IMS, Db2, CA Datacom, Adabas, and CA IDMS; and (Non-mainframe): Amazon RDS Aurora, Amazon MySQL/MariaDB, Amazon RDS PostgreSQL, Amazon RDS Oracle, Amazon RDS SQL Server, Amazon Kinesis, Amazon Redshift, Microsoft Azure, Oracle Cloud, Kafka, MongoDB, Hadoop, and many more.

http://www.treehouse.com

About Tidal Migrations

Our mission is to empower our customers’ application portfolio assessment with a business-first approach and our standardized framework.  This is underpinned by the Tidal Migrations platform and underlying tools; Tidal Tools and DNS Tools.  The platform captures all of the data from various discovery and assessment tools and provides a single-source-of-truth for managing the cloud voyage of each application in the portfolio, all the way from goal setting to transition execution in a collaborative format.  Tidal Migrations has partnerships with Amazon Web Services, Microsoft Azure and Google Cloud Platform.

https://tidalmigrations.com/


Further reading: tcVISION Mainframe-to-AWS data replication is featured on the AWS Partner Network Blog…

___tcVISION_AWS_HA_Architecture

AWS recently published a blog about tcVISION’s Mainframe-to-Cloud data replication capabilities:

AWS Partner Network (APN) Blog: Real-Time Mainframe Data Replication to AWS with tcVISION from Treehouse Software.


__tsi_logo_400x200

Contact Treehouse Software Today…

No matter where you want your mainframe data to go – the Cloud, Open Systems, or any LUW target – tcVISION from Treehouse Software is your answer.

Just fill out the Treehouse Software Product Demonstration Request Form and a Treehouse representative will contact you to set up a time for your online tcVISION demonstration.