Treehouse Software Video Demonstration: Data Synchronization Between IMS/DB z/OS and PostgreSQL Using tcVISION

by Joseph Brady, Director of Business Development / AWS and Cloud Alliance Lead at Treehouse Software, Inc.

tcVISION supports a vast array of integration scenarios throughout the enterprise, providing easy and fast data migration for mainframe application modernization projects and enabling real-time and bi-directional data replication between mainframe, Cloud, Open Systems, Linux, Unix, and Windows platforms. We are regularly adding instructional video demonstrations on the Treehouse Software YouTube Channel. This video installment demonstrates an initial load and bi-directional synchronization of data between IMS/DB on the Mainframe and PostgreSQL on a Windows server…

Visit the Treehouse Software YouTube Channel for Other Videos.


__TSI_LOGO

Contact Treehouse Software for a Demo Today…

No matter where you want your mainframe data to go – the cloud, open systems, or any LUW target – tcVISION from Treehouse Software is your answer. 

tcVISION_Overall_Diagram

Just fill out the Treehouse Software Product Demonstration Request Form and a Treehouse representative will contact you to set up a time for your online tcVISION demonstration.


Further reading: AWS Partner Network (APN) Blog: Real-Time Mainframe Data Replication to AWS with tcVISION from Treehouse Software

A real-world example of how Treehouse Software is helping enterprises with their Mainframe-to-Cloud / LUW / Open Systems data migration and replication initiatives…

by Joseph Brady, Director of Business Development for Treehouse Software

Many medium to large size companies are still investing in new mainframe systems, because they have been relying on them for decades to handle mission critical data transaction processing. For these companies, their mainframes are deeply entrenched, and have been rock-solid reliable over the years, allowing many users and applications to simultaneously access the same data without interfering with each other. Mainframes also perform large-scale and extremely fast transaction processing (thousands of transactions per second). Chances are, most transactions for which you use your debit or credit cards have a mainframe processing the data in the background.

There have been countless predictions of the demise of the mainframe over the years, but they have been proven wrong every time, and there’s no sign of extinction any time soon. Mainframes remain a vital part of IT infrastructures used by companies spanning a variety of industries around the world, including banking, insurance, healthcare, government, aviation, and retail.

Today, most companies that have their enterprise data stored on a mainframe system are discovering the advantages of newer cloud and open systems databases and services, including instantaneous global database deployments (e.g., Amazon Aurora), economics to scale, high availability, elasticity, security, testing at scale, disaster recovery, etc. Consequently, these companies are looking for an automated solution that allows real-time data replication between the two environments, and many are turning to Treehouse Software.


_0_Airline_Manitenance

Customer Scenario: A Look at a Large Airline’s Mainframe Data Replication Project

Treehouse Software has a major airline customer that is a long-time user of Software AG’s Adabas database on their mainframe system. Their desire was to move their data to more modern applications off of the mainframe. However, their mainframe contains vital airline maintenance and parts data that must always be highly available, so rather than performing a complete migration from the mainframe, the customer decided to utilize a data warehouse with a requirement of real-time data replication. This allows the mainframe legacy teams to maintain existing applications, while the modernization team develops applications on the newly created RDBMS. All teams determined that tcVISION real-time mainframe data replication was the perfect fit for meeting their goals.

How tcVISION Addressed the Customer Needs...

The high-level environment for the airline customer using tcVISION for data replication looks like this…

___Airline_tcV_Overview

  • Adabas: Mainframe data source containing business critical information replicated to the RDBMS.
  • Oracle: Open Platform RDBMS chosen by customer as replication target for both data warehouse and modernization project. The tcVISION Manager also uses Oracle as a repository for the metadata (field mappings).
  • tcVISION Manager: Software component deployed on both source and target systems. It is responsible for provisioning resources for:
    • Processing scripts
    • Metadata import
    • Scheduling
  • tcSCRIPT: Software component deployed on both source and target systems. It works in conjunction with the tcVISION Manager to:
    • Perform initial load of Adabas into Oracle
    • Ongoing near realtime CDC (Change Data Capture) and replication from Adabas to Oracle
    • tcSCRIPT processes data from:
      • Direct from the DBMS (initial load) or from DBMS extracts
      • Adabas Protection log (PLOG)
  • tcVISION Control Board: Software component deployed on a Windows machine which provides graphical user interface for a single point of control to administer the tcVISION environment:
    • Metadata import, creates metadata rules governing relationship between mainframe and open platform data structures
    • Replication rule maintenance
    • DDL creation
    • Creation of ETL and replication processes
    • Start, stop, and schedule replication processes

Customer’s Technical Requirement for tcVISION

The airline requires that the replication solution must support online and batch Adabas transactions and provide data replication between Adabas and Oracle. Additionally, their large databases contain millions of rows (e.g., > 50 million) that must be supported, as well as support for database change audit requirements (datetime and type of operation), transaction management, and notification of exception events.

There must also be support for configuration management between development, QA, and production.

Finally, the solution must address hardware and software failures on the mainframe, Linux, and database nodes.

Customer Outcomes

All requirements were met by tcVISION, which led to a successful project implementation.  Here is a look at the customer outcomes and benefits:

Business Outcome Customer Benefit
Data warehouse is always in sync with Adabas using tcVISION data replication Improved timeliness and reliability of reporting data
Reduced usage of mainframe MIPS Reduced cost
All data required for modernization project was successfully replicated to target environment Increased business efficiently and agility

Many more mainframe data migration and replication customer case studies can be read on the Treehouse Software Website.


__TSI_LOGO

Contact Treehouse Software for a Demo Today…

No matter where you want your mainframe data to go – the cloud, open systems, or any LUW target – tcVISION from Treehouse Software is your answer. 

_0_Treehouse_tcV_Cloud_OpenSystems

Just fill out the Treehouse Software Product Demonstration Request Form and a Treehouse representative will contact you to set up a time for your online tcVISION demonstration.


Further reading: AWS Partner Network (APN) Blog: Real-Time Mainframe Data Replication to AWS with tcVISION from Treehouse Software

Cloud Infrastructure Monitoring: Finding Issues and Solving Problems With Amazon CloudWatch

by Joseph Brady, Director of Business Development for Treehouse Software

At Treehouse Software, we specialize in helping customers’ legacy mainframe environment continue while replicating their data – in real time and bi-directionally – to an impressive variety of newer Cloud, LUW, and Open Systems databases. However, once “in the Cloud”, customers need the same visibility and understanding of what is happening with their data as they have in their on-premises data centers.

Unlike a traditional data center, with the AWS infrastructure environment, customers pay only for what they use, and the company is charged only for resource utilization.  Users can bring up EC2 virtual Windows or Linux instances for any length of time. For example, if the mainframe database bulk loads only take an hour to complete, the tcVISION EC2 instances can be brought up for the two hours needed, and shut down when the processing is finished.  AWS EC2 instances can be dynamically stopped and restarted while retaining its data on AWS Elastic Block Storage. This way, the business pays only for what is needed and the instance sizes (CPU, memory, and I/O bandwidth) can be optimized for the required mainframe data migration, or data replication process.

AWS resources, such as EC2 instances, storage, and databases can be rapidly provisioned and de-provisioned.  The allows customers to approach the architecture with an agile mind set.

Cloud Infrastructure Monitoring Made Easy…

This blog gives a high-level overview at Amazon CloudWatch, a Cloud infrastructure monitoring service that gives developers, system operators, site reliability engineers (SRE), and IT managers actionable insights to monitor applications, understand and respond to system-wide performance changes, optimize resource utilization, and obtain a unified view of operational health.

___Amazon_CloudWatch_Dashboard

CloudWatch collects monitoring and operational data in the form of logs, metrics, and events, providing you with a unified view of AWS resources, applications and services that run on AWS, and on-premises servers. You can use CloudWatch to set high resolution alarms, visualize logs and metrics side by side, take automated actions, troubleshoot issues, and discover insights to optimize your applications, and ensure they are running smoothly.

Some customers are satisfied with a basic monitoring that polls every five minutes, while others need more detailed monitoring and can choose polls that occur every minute.

Observing, Reporting, Alerting, and Acting

Amazon CloudWatch allows customers to record metrics for EC2 and other Amazon Cloud Services (e.g., EBS (Elastic Block Storage), S3 (Simple Service Storage), etc.) and display them in a graph on a monitoring dashboard. This provides visual notifications of what is going on, such as CPU per server, query time, number of transactions, and network usage.

Given the dynamic nature of AWS resources, proactive measures including the dynamic re-sizing of infrastructure resources can be automatically initiated. Amazon CloudWatch alarms can be sent to the customer, such as a warning that CPU usage is too high, and as a result, an auto scale trigger can be set up to launch another EC2 instance to address the load. Additionally, customers can set alarms to recover, reboot, or shut down EC2 instances if something out of the ordinary happens.

A shift from looking for failures, to finding answers…


__TSI_LOGO

Is your mission critical mainframe data residing on IBM Db2, IBM VSAM, IBM IMS/DB, Software AG Adabas, CA IDMS, CA Datacom, or even sequential files? Do you want to move that data to the Cloud?

Read More About tcVISION on the AWS Partner Network Blog…

Read More: AWS Partner Network (APN) Blog, “Real-Time Mainframe Data Replication to AWS with tcVISION from Treehouse Software”

Contact Treehouse Software for a Demo Today…

Just fill out the Treehouse Software Product Demonstration Request Form and a Treehouse representative will contact you to set up a time for your online tcVISION demonstration.

STAY AND GO… AT THE SAME TIME! Incrementally Replicate Your Mainframe Data to the Cloud and Other Modern Systems While Keeping Both Sides Synchronized

Is your mission critical mainframe data residing on IBM Db2, IBM VSAM, IBM IMS/DB, Software AG Adabas, CA IDMS, CA Datacom, or even sequential files? Are you looking for a solution that allows your legacy mainframe environment to continue while replicating data – in real time and bi-directionally – on a variety of newer Cloud, LUW, or Open Systems databases? Whether your enterprise wants to take advantage of the latest cloud services, such as analytics, artificial intelligence (AI), etc., or move your data to a variety of newer Cloud, LUW, or Open Systems databases, the transition doesn’t have to be a sudden big bang.

tcVISION_Overall_Diagram

tcVISION: Enterprise ETL and Real-time and Bi-directional Data Replication Through Change Data Capture

The globalization of markets, the increase of data volumes, 24×7 operations, changing business conditions and high demand for up-to-date information require new data transfer and exchange solutions for heterogeneous IT architectures.

The tcVISION solution focuses on changed data capture (CDC) when transferring information between mainframe data sources and modern databases and applications. Through an innovative technology, changes occurring in any mainframe application data are tracked and captured, and then published to a variety of targets.

tcVISION allows bi-directional, real-time data synchronization of changes on either platform to be reflected on the other platform (e.g., a change to a PostgreSQL table is reflected back on mainframe). The customer can then modernize their application on the cloud, open systems, etc. without disrupting the existing critical work on the legacy system.

tcVISION – Supported Sources and Targets

tcVISION supports a vast array of integration scenarios throughout the enterprise, providing easy and fast data migration for mainframe application modernization projects and enabling bi-directional data replication between mainframe, Cloud, Linux, Unix, and Windows platforms. This innovative technology offers comprehensive abilities to identify and capture changes occurring in mainframe and relational databases, then publish the required information to an impressive variety of targets, both on-premise and Cloud-based.

View the Unequalled List of Environments Supported by tcVISION Here


__TSI_LOGO

Contact Treehouse Software for a Demo Today…

Just fill out the Treehouse Software Product Demonstration Request Form and a Treehouse representative will contact you to set up a time for your tcVISION demonstration. This will be a live, on-line demonstration that shows tcVISION replicating data from the mainframe to a Cloud target database.

Treehouse Software’s Mainframe-to-AWS Data Replication Solution is Featured on the AWS Partner Network Blog

“We are very excited about the APN blog showcasing tcVISION’s Mainframe-to-AWS capabilities to such a substantial and relevant audience. The AWS partner and customer base not only has access to our solution via the tcVISION AMI in the AWS Marketplace, they can now use the tcVISION blog as a valuable educational and marketing tool!”

– Joseph Brady, Director of Business Development and AWS Alliance Lead at Treehouse Software

READ THE BLOG HERE


__TSI_LOGO

Since 1982, Treehouse Software has been serving enterprises worldwide with industry-leading software products and outstanding technical support. Today, Treehouse Software is a global leader in providing data migration, replication, and integration solutions for the most complex and demanding heterogeneous environments, as well as feature-rich, accelerated-ROI offerings for information delivery, business intelligence and analytics, and application modernization.

New! Log Based Change Data Capture (CDC) for IBM Db2 z/OS Without a Mainframe Agent

A permanent, active z/OS tcVISION agent is no longer required for the processing of Db2 z/OS Active Logs. This “agentless” connection analyzes the Db2 Active log and extracts the changed data using a Db2 User Defined Table (UDT) and a connection to Db2 z/OS via DRDA or a Db2-Client.

Flexible and efficient data exchange (synchronization/replication/migration) with tcVISION for IBM z-, distributed-, and cloud platforms:

  • Fast and efficient load of mass data
  • Lower latency time because of parallelization and real-time apply
  • Continuous log based CDC data streaming for real-time synchronization
  • Transparency because of comprehensive data mapping for structure analysis
  • Comfortable data transformation and data conversion
  • No programming efforts
  • Integrated database specific apply mechanisms to enter the data into the targets
  • Bidirectional synchronization (Master – Master replication) with integrated Loop prevention

__TSI_LOGO

We would be happy to present our data integration solution tcVISION for
IBM z-, distributed- and cloud-platforms and show solutions that meet your requirements. Visit the Treehouse Software website for more information on tcVISION, or contact us to discuss your needs.

Treehouse Software Customer Success: Element Fleet Management Corp. Real-time, Bi-directional Synchronization Between IBM Mainframe Datacom and PostgreSQL

Element_Building

As a leading global fleet management company, Element provides a comprehensive range of fleet services that span the total fleet lifecycle, helping customers optimize their strategies at every stage – from acquisition and financing to program management and vehicle remarketing. These services, together with exceptional tools, technologies and consulting, empower customers to realize extraordinary results.

Business Background

Element Fleet Management has over one million vehicles under management, and serves more than 2,800 customers. The company employs over 2,700 staff members across 12 offices. Transaction sizes range from $500,000 to $40 million. 50 countries are served through the Element-Arval Global Alliance. Top industries served by Element Fleet Management are agriculture, business services, chemical, construction, consumer products, education and non-profit, energy, food and beverage, insurance, manufacturing, pharmaceutical and healthcare, professional services, telecommunications, transportation, and utilities.

Business Issue

Much of Element’s mission critical mainframe data is stored in a legacy IBM mainframe database. The cost to maintain these legacy databases is high and they lack the features required for modernizing the data architecture. The data is utilized by an extensive number of interlinked programs dependent on this legacy data. Element required a solution that would allow the legacy environment to continue while having real time replicated data on a modern database/platform. This enables them to utilize modern programing and data tools to be competitive in their market.

Element_Diagram

Technology Solution

Treehouse software and the customer developed a phased plan to prove out and implement tcVISION. This started with a proof-of-concept to prove out the technology’s effectiveness and technical suitability. This was proceeded by architectural phase to define the architectural solution including, configuration management, environments and promotion, high availability, security, disaster recovery, monitoring, operations procedures, script customization, data replication mapping and training plans. After defining the architecture, the production deployment phase started with incremental sprint-like deployments. Additional files were deployed into production every few weeks.

This project enabled the tcVISION product to synchronize mission critical financial IBM mainframe Datacom data to a modern PostgreSQL database. Bi-directional, real-time data synchronization enables changes on either platform to be reflected on the other platform (e.g., a change to a PostgreSQL table is reflected on mainframe Datacom). This allows their business to modernize the application on PostgreSQL without disrupting the existing critical work on the legacy system.

NOTE: Many modern tools are using the PostgreSQL database, which greatly enhances business agility (e.g., other divisions within Element are already using Amazon Web Services (AWS), so having tcVISION in place now makes mainframe data delivery to the AWS cloud an easy option). See a step-by-step video of Mainframe-to-PostgreSQL on AWS here. 

Successful, real-time mainframe data replication to an open systems application allows web and mobile access and updates. Element indicated their satisfaction with the results and the solution, especially reduced mainframe MIPS costs, and enhanced business ability to respond to business environment changes.


Find out more about tcVISION — Enterprise ETL and Real-Time Data Replication Through Change Data Capture

tcVISION supports a vast array of integration scenarios throughout the enterprise, providing easy and fast data migration for mainframe application modernization projects and enabling bi-directional data replication between mainframe, Linux, Unix and Windows platforms. This innovative technology offers comprehensive abilities to identify and capture changes occurring in mainframe and relational databases, then publish the required information to an impressive variety of targets, both on-premise and Cloud-based.

tcVISION_Connection_Overview_Web01

tcVISION acquires data in bulk or via change data capture methods, including in real time, from virtually any IBM mainframe data source (Software AG Adabas, IBM Db2, IBM VSAM, IBM IMS/DB, CA IDMS, CA Datacom, even sequential files), and transform and deliver to virtually any target. In addition, the same product can extract and replicate data from a variety of non-mainframe sources, including PostgreSQL, Adabas LUW, Oracle Database, Microsoft SQL Server, IBM Db2 LUW and Db2 BLU, and IBM Informix.


__TSI_LOGO

Visit the Treehouse Software website for more information on tcVISION, or contact us to discuss your needs.