A real-world example of how Treehouse Software is helping enterprises with their Mainframe-to-Cloud / LUW / Open Systems data migration and replication initiatives…

by Joseph Brady, Director of Business Development for Treehouse Software

Many medium to large size companies are still investing in new mainframe systems, because they have been relying on them for decades to handle mission critical data transaction processing. For these companies, their mainframes are deeply entrenched, and have been rock-solid reliable over the years, allowing many users and applications to simultaneously access the same data without interfering with each other. Mainframes also perform large-scale and extremely fast transaction processing (thousands of transactions per second). Chances are, most transactions for which you use your debit or credit cards have a mainframe processing the data in the background.

There have been countless predictions of the demise of the mainframe over the years, but they have been proven wrong every time, and there’s no sign of extinction any time soon. Mainframes remain a vital part of IT infrastructures used by companies spanning a variety of industries around the world, including banking, insurance, healthcare, government, aviation, and retail.

Today, most companies that have their enterprise data stored on a mainframe system are discovering the advantages of newer cloud and open systems databases and services, including instantaneous global database deployments (e.g., Amazon Aurora), economics to scale, high availability, elasticity, security, testing at scale, disaster recovery, etc. Consequently, these companies are looking for an automated solution that allows real-time data replication between the two environments, and many are turing to Treehouse Software.


_0_Airline_Manitenance

Customer Scenario: A Look at a Large Airline’s Mainframe Data Replication Project

Treehouse Software has a major airline customer that is a long-time user of Software AG’s Adabas database on their mainframe system. Their desire was to move their data to more modern applications off of the mainframe. However, their mainframe contains vital airline maintenance and parts data that must always be highly available, so rather than trying to move off of their mainframe, the customer decided on utilizing a data warehouse with a requirement of real-time data replication. This allows the mainframe legacy teams to maintain existing applications, while the modernization team develops applications on the newly created RDBMS. All teams determined that tcVISION real-time mainframe data replication was the perfect fit for meeting their goals.

How tcVISION Addressed the Customer Needs...

The high-level environment for the airline customer using tcVISION for data replication looks like this…

___Airline_tcV_Overview

  • Adabas: Mainframe data source containing business critical information replicated to the RDBMS.
  • Oracle: Open Platform RDBMS chosen by customer as replication target for both data warehouse and modernization project. The tcVISION Manager also uses Oracle as a repository for the metadata (field mappings).
  • tcVISION Manager: Software component deployed on both source and target systems. It is responsible for provisioning resources for:
    • Processing scripts
    • Metadata import
    • Scheduling
  • tcSCRIPT: Software component deployed on both source and target systems. It works in conjunction with the tcVISION Manager to:
    • Perform initial load of Adabas into Oracle
    • Ongoing near realtime CDC (Change Data Capture) and replication from Adabas to Oracle
    • tcSCRIPT processes data from:
      • Direct from the DBMS (initial load) or from DBMS extracts
      • Adabas Protection log (PLOG)
  • tcVISION Control Board: Software component deployed on a Windows machine which provides graphical user interface for a single point of control to administer the tcVISION environment:
    • Metadata import, creates metadata rules governing relationship between mainframe and open platform data structures
    • Replication rule maintenance
    • DDL creation
    • Creation of ETL and replication processes
    • Start, stop, and schedule replication processes

Customer’s Technical Requirement for tcVISION

The airline requires that the replication solution must support online and batch Adabas transactions and provide data replication between Adabas and Oracle. Additionally, their large databases contain millions of rows (e.g., > 50 million) that must be supported, as well as support for database change audit requirements (datetime and type of operation), transaction management, and notification of exception events.

There must also be support for configuration management between development, QA, and production.

Finally, the solution must address hardware and software failures on the mainframe, Linux, and database nodes.

Customer Outcomes

All requirements were met by tcVISION, which led to a successful project implementation.  Here is a look at the customer outcomes and benefits:

Business Outcome Customer Benefit
Data warehouse is always in sync with Adabas using tcVISION data replication Improved timeliness and reliability of reporting data
Reduced usage of mainframe MIPS Reduced cost
All data required for modernization project was successfully replicated to target environment Increased business efficiently and agility

Many more mainframe data migration and replication customer case studies can be read on the Treehouse Software Website.


__TSI_LOGO

Contact Treehouse Software for a Demo Today…

No matter where you want your mainframe data to go – the cloud, open systems, or any LUW target – tcVISION from Treehouse Software is your answer. 

_0_Treehouse_tcV_Cloud_OpenSystems

Just fill out the Treehouse Software Product Demonstration Request Form and a Treehouse representative will contact you to set up a time for your online tcVISION demonstration.


Further reading: AWS Partner Network (APN) Blog: Real-Time Mainframe Data Replication to AWS with tcVISION from Treehouse Software

Treehouse Software’s tcVISION on the AWS Marketplace… AWS Architectural Considerations and Challenges

Andy Jones, Senior Technical Representative for Treehouse Software recently gave a presentation at the Pittsburgh AWS User Group Meetup that explores our experiences in bringing the tcVISION Mainframe-to-AWS Data Replication Solution to the AWS Marketplace.  Andy discussed issues that had to be addressed, such as High Availability and AWS Availability Zones, Autoscaling, Security, creating the tcVISON AMIs, etc. Here is his presentation:

Additionally, Treehouse Software’s tcVISION is Featured on the AWS Partner Network Blog. Read the Blog Here.


__tsi_logo_400x200

Treehouse Software is an AWS Technology Partner and a global leader in providing real-time and bi-directional data replication between a variety of mainframe and non-mainframe sources, including (Mainframe – z/OS and VSE): VSAM, IMS, Db2 z/OS, Adabas, CA Datacom, and CA IDMS; and (Non-mainframe): AWS, Microsoft Azure, PostgreSQL, Oracle, Microsoft SQL Server, IBM Db2 LUW and Db2 BLU, IBM Informix, Kafka, MongoDB, Hadoop, SAP Hana, and more.

Contact us today to discuss your project!

Treehouse Software’s Mainframe-to-AWS Data Replication Solution is Featured on the AWS Partner Network Blog

“We are very excited about the APN blog showcasing tcVISION’s Mainframe-to-AWS capabilities to such a substantial and relevant audience. The AWS partner and customer base not only has access to our solution via the tcVISION AMI in the AWS Marketplace, they can now use the tcVISION blog as a valuable educational and marketing tool!”

– Joseph Brady, Director of Business Development and AWS Alliance Lead at Treehouse Software

READ THE BLOG HERE


__TSI_LOGO

Since 1982, Treehouse Software has been serving enterprises worldwide with industry-leading software products and outstanding technical support. Today, Treehouse Software is a global leader in providing data migration, replication, and integration solutions for the most complex and demanding heterogeneous environments, as well as feature-rich, accelerated-ROI offerings for information delivery, business intelligence and analytics, and application modernization.

Mainframe Modernization: Extracting Business Value While Maintaining Critical Legacy Data

_0_Treehouse_tcV_Cloud_OpenSystems

Whether your enterprise wants to take advantage of the latest cloud services, such as analytics, artificial intelligence (AI), etc., or move your data to a variety of newer LUW or Open Systems databases, the transition doesn’t have to be a sudden big bang.

Application Rehost / Modernization Challenges

Much of an enterprise’s mission critical mainframe data is stored in legacy mainframe databases, and the cost to maintain these databases is high.  An added complication is that the data is utilized by many interlinked and dependent programs that have been in place for many years, and sometimes, decades. Unlocking the value of this legacy data is difficult due to many very different types of mainframe databases (e.g., Db2, Adabas, CA Datacom, CA IDMS, etc.).

Many customers are looking for a solution that allows their legacy environment to continue while replicating data in real time on a modern database/platform. This enables them to utilize modern programing and data tools in order to remain competitive in their markets.

One Step At A Time…

Treehouse Software has extensive experience in helping organizations incrementally replicate their mainframe data to the cloud and other modern systems, while keeping both sides synchronized.

Treehouse Software’s expert technical representatives help customers developed a phased plan that includes installation and implementation of the tcVISION mainframe data replication product. The plan then defines various parts of the solution, including:

  • configuration management
  • environments and promotion
  • high availability
  • security
  • disaster recovery
  • monitoring
  • operations procedures
  • script customization
  • data replication mapping
  • training

After defining the architecture, the production deployment phase begins with incremental sprint-like deployments. Additional files are then deployed into production every few weeks.

This phased plan enables the tcVISION product to synchronize mission critical mainframe data to any modern database. Bi-directional, real-time data synchronization allows changes on either platform to be reflected on the other platform (e.g., a change to a PostgreSQL table is reflected back on mainframe). The customer can then modernize their application on the cloud, open systems, etc. without disrupting the existing critical work on the legacy system.

Additionally, tcVISION customers see drastically reduced mainframe MIPS costs, and increased ability to quickly respond to business environment changes.


Find out more about tcVISION — Enterprise ETL and Real-Time Data Replication Through Change Data Capture (CDC)

tcVISION supports a vast array of integration scenarios throughout the enterprise, providing easy and fast data migration for mainframe application modernization projects and enabling bi-directional data replication between mainframe, Cloud, Open Systems, Linux, Unix, and Windows platforms. This innovative technology offers comprehensive abilities to identify and capture changes occurring in mainframe and relational databases, then publish the required information to an impressive variety of targets, both on-premise and Cloud-based.

tcVISION_Overall_Diagram

tcVISION acquires data in bulk or via change data capture methods, providing real-time and bi-directional data replication between a variety of mainframe and non-mainframe sources, including (Mainframe – z/OS and VSE): VSAM, IMS, Db2 z/OS, Adabas, CA Datacom, and CA IDMS; and (Non-mainframe): AWS, PostgreSQL, Oracle, Microsoft SQL Server, IBM Db2 LUW and Db2 BLU, IBM Informix, Kafka, MongoDB, Hadoop, SAP Hana, and more.


__TSI_LOGO

Visit the Treehouse Software website for more information on tcVISION, or contact us to discuss your needs.

You can also set up a live, online demonstration of tcVISION, where we will show data replication from a mainframe database to an AWS, LUW, or Open Systems target database. Schedule your demo today!

New! Log Based Change Data Capture (CDC) for IBM Db2 z/OS Without a Mainframe Agent

A permanent, active z/OS tcVISION agent is no longer required for the processing of Db2 z/OS Active Logs. This “agentless” connection analyzes the Db2 Active log and extracts the changed data using a Db2 User Defined Table (UDT) and a connection to Db2 z/OS via DRDA or a Db2-Client.

Flexible and efficient data exchange (synchronization/replication/migration) with tcVISION for IBM z-, distributed-, and cloud platforms:

  • Fast and efficient load of mass data
  • Lower latency time because of parallelization and real-time apply
  • Continuous log based CDC data streaming for real-time synchronization
  • Transparency because of comprehensive data mapping for structure analysis
  • Comfortable data transformation and data conversion
  • No programming efforts
  • Integrated database specific apply mechanisms to enter the data into the targets
  • Bidirectional synchronization (Master – Master replication) with integrated Loop prevention

__TSI_LOGO

We would be happy to present our data integration solution tcVISION for
IBM z-, distributed- and cloud-platforms and show solutions that meet your requirements. Visit the Treehouse Software website for more information on tcVISION, or contact us to discuss your needs.

Mainframe-to-Cloud and Open Systems Data Replication: tcVISION in 90 Seconds

Give us 90 seconds of your time, and we’ll quickly show you how tcVISION enables real-time and bi-directional Mainframe-to-Cloud and Open Systems data replication. Our video walk-through shows how tcVISION‘s GUI interface allows users to easily model and map data, and create links between data sources and target systems. tcVISION‘s intuitive interface supports simple to complex replication scenarios.


Find out more about tcVISION — Enterprise ETL and Real-Time Data Replication Through Change Data Capture

tcVISION supports a vast array of integration scenarios throughout the enterprise, providing easy and fast data migration for mainframe application modernization projects and enabling bi-directional data replication between mainframe, Cloud, Linux, Unix and Windows platforms. This innovative technology offers comprehensive abilities to identify and capture changes occurring in mainframe and relational databases, then publish the required information to an impressive variety of targets, both on-premise and Cloud-based.

tcVISION_Connection_Overview_Web01

tcVISION acquires data in bulk or via change data capture methods, including in real time, from virtually any IBM mainframe data source (Software AG Adabas, IBM Db2, IBM VSAM, IBM IMS/DB, CA IDMS, CA Datacom, even sequential files), and transform and deliver to virtually any target. In addition, the same product can extract and replicate data from a variety of non-mainframe sources, including Amazon Aurora, PostgreSQL, Adabas LUW, Oracle Database, Microsoft SQL Server, IBM Db2 LUW and Db2 BLU, and IBM Informix.


__TSI_LOGO

Visit the Treehouse Software website for more information on tcVISION, or contact us to discuss your needs.

Treehouse Software Sponsors June Pittsburgh Amazon Web Services (AWS) User Group Meetup

By Joseph Brady, Marketing Manager and AWS Alliance Lead for Treehouse Software

_0_Collage

Treehouse Software sponsored the June AWS User Group Meetup at AlphaLab in Pittsburgh. AlphaLab is a nationally ranked software accelerator in Pittsburgh. They help early-stage tech companies quickly figure out the best way to build and grow in a program with funding, early-stage technology companies with an extensive mentor network, educational sessions with industry leaders, and a rich entrepreneurial work environment within a nationally ranked accelerator program.

Food, drinks, and technical presentation were courtesy of Treehouse Software. The AlphaLab space was very nice and spacious, with a full kitchen and a large bar for everybody to hang out and talk while enjoying a great spread of food and drinks. This was an ideal setting for ice-breaking and socializing with attendees.

As is usual for the AWS User Group, the attendees ranged from students to consultants and DBAs, all wanting to learn about what can be done on the AWS Cloud.

After some food, drinks, and a bit of socializing, Jim Jen, Executive Director of AlphaLab started things off with a short AlphaLab welcome and introduction.

Next, Andy Jones, Senior Technical Representative for Treehouse Software presented “tcVISION Technical Overview and AWS Cloud Environment Replication Demonstration”. Andy told a little about Treehouse, our AWS partnership, and an overview of tcVISION with a mention of the tcVISION Amazon Machine Image (AMI) development work that is going on right now with support from a top AWS Solutions Architect. At the end of Andy’s presentation, interest was sufficient for him to give a tcVISION live demo, where he showed everybody tcVISION replicating data from the Treehouse mainframe to AWS Aurora in the Cloud.

Typical Treehouse Mainframe-to-AWS data replication scenario in a demo:

Demo_Example

We ended the evening with a little more eating, drinking, and socializing, and a mention that Treehouse Software will be exhibiting the tcVISION/AWS Solution at AWS re:Invent in November.

Thanks to everyone who attended, helped, and participated!


Find out more about tcVISION — Enterprise ETL and Real-Time Data Replication Through Change Data Capture

tcVISION supports a vast array of integration scenarios throughout the enterprise, providing easy and fast data migration for mainframe application modernization projects and enabling bi-directional data replication between mainframe, Linux, Unix and Windows platforms. This innovative technology offers comprehensive abilities to identify and capture changes occurring in mainframe and relational databases, then publish the required information to an impressive variety of targets, both on-premise and Cloud-based.

tcVISION_Connection_Overview_Web01

tcVISION acquires data in bulk or via change data capture methods, including in real time, from virtually any IBM mainframe data source (Software AG Adabas, IBM Db2, IBM VSAM, IBM IMS/DB, CA IDMS, CA Datacom, even sequential files), and transform and deliver to virtually any target. In addition, the same product can extract and replicate data to/from a variety of non-mainframe sources, including AWS, PostgreSQL, Adabas LUW, Oracle Database, Microsoft SQL Server, IBM Db2 LUW and Db2 BLU, and IBM Informix.


__TSI_LOGO

Visit the Treehouse Software website for more information on tcVISION, or contact us to discuss your needs.