Treehouse Software Video Demonstration: Data Synchronization Between IMS/DB z/OS and PostgreSQL Using tcVISION

by Joseph Brady, Director of Business Development / AWS and Cloud Alliance Lead at Treehouse Software, Inc.

tcVISION supports a vast array of integration scenarios throughout the enterprise, providing easy and fast data migration for mainframe application modernization projects and enabling real-time and bi-directional data replication between mainframe, Cloud, Open Systems, Linux, Unix, and Windows platforms. We are regularly adding instructional video demonstrations on the Treehouse Software YouTube Channel. This video installment demonstrates an initial load and bi-directional synchronization of data between IMS/DB on the Mainframe and PostgreSQL on a Windows server…

Visit the Treehouse Software YouTube Channel for Other Videos.


__TSI_LOGO

Contact Treehouse Software for a Demo Today…

No matter where you want your mainframe data to go – the cloud, open systems, or any LUW target – tcVISION from Treehouse Software is your answer. 

tcVISION_Overall_Diagram

Just fill out the Treehouse Software Product Demonstration Request Form and a Treehouse representative will contact you to set up a time for your online tcVISION demonstration.


Further reading: AWS Partner Network (APN) Blog: Real-Time Mainframe Data Replication to AWS with tcVISION from Treehouse Software

A real-world example of how Treehouse Software is helping enterprises with their Mainframe-to-Cloud / LUW / Open Systems data migration and replication initiatives…

by Joseph Brady, Director of Business Development for Treehouse Software

Many medium to large size companies are still investing in new mainframe systems, because they have been relying on them for decades to handle mission critical data transaction processing. For these companies, their mainframes are deeply entrenched, and have been rock-solid reliable over the years, allowing many users and applications to simultaneously access the same data without interfering with each other. Mainframes also perform large-scale and extremely fast transaction processing (thousands of transactions per second). Chances are, most transactions for which you use your debit or credit cards have a mainframe processing the data in the background.

There have been countless predictions of the demise of the mainframe over the years, but they have been proven wrong every time, and there’s no sign of extinction any time soon. Mainframes remain a vital part of IT infrastructures used by companies spanning a variety of industries around the world, including banking, insurance, healthcare, government, aviation, and retail.

Today, most companies that have their enterprise data stored on a mainframe system are discovering the advantages of newer cloud and open systems databases and services, including instantaneous global database deployments (e.g., Amazon Aurora), economics to scale, high availability, elasticity, security, testing at scale, disaster recovery, etc. Consequently, these companies are looking for an automated solution that allows real-time data replication between the two environments, and many are turning to Treehouse Software.


_0_Airline_Manitenance

Customer Scenario: A Look at a Large Airline’s Mainframe Data Replication Project

Treehouse Software has a major airline customer that is a long-time user of Software AG’s Adabas database on their mainframe system. Their desire was to move their data to more modern applications off of the mainframe. However, their mainframe contains vital airline maintenance and parts data that must always be highly available, so rather than performing a complete migration from the mainframe, the customer decided to utilize a data warehouse with a requirement of real-time data replication. This allows the mainframe legacy teams to maintain existing applications, while the modernization team develops applications on the newly created RDBMS. All teams determined that tcVISION real-time mainframe data replication was the perfect fit for meeting their goals.

How tcVISION Addressed the Customer Needs...

The high-level environment for the airline customer using tcVISION for data replication looks like this…

___Airline_tcV_Overview

  • Adabas: Mainframe data source containing business critical information replicated to the RDBMS.
  • Oracle: Open Platform RDBMS chosen by customer as replication target for both data warehouse and modernization project. The tcVISION Manager also uses Oracle as a repository for the metadata (field mappings).
  • tcVISION Manager: Software component deployed on both source and target systems. It is responsible for provisioning resources for:
    • Processing scripts
    • Metadata import
    • Scheduling
  • tcSCRIPT: Software component deployed on both source and target systems. It works in conjunction with the tcVISION Manager to:
    • Perform initial load of Adabas into Oracle
    • Ongoing near realtime CDC (Change Data Capture) and replication from Adabas to Oracle
    • tcSCRIPT processes data from:
      • Direct from the DBMS (initial load) or from DBMS extracts
      • Adabas Protection log (PLOG)
  • tcVISION Control Board: Software component deployed on a Windows machine which provides graphical user interface for a single point of control to administer the tcVISION environment:
    • Metadata import, creates metadata rules governing relationship between mainframe and open platform data structures
    • Replication rule maintenance
    • DDL creation
    • Creation of ETL and replication processes
    • Start, stop, and schedule replication processes

Customer’s Technical Requirement for tcVISION

The airline requires that the replication solution must support online and batch Adabas transactions and provide data replication between Adabas and Oracle. Additionally, their large databases contain millions of rows (e.g., > 50 million) that must be supported, as well as support for database change audit requirements (datetime and type of operation), transaction management, and notification of exception events.

There must also be support for configuration management between development, QA, and production.

Finally, the solution must address hardware and software failures on the mainframe, Linux, and database nodes.

Customer Outcomes

All requirements were met by tcVISION, which led to a successful project implementation.  Here is a look at the customer outcomes and benefits:

Business Outcome Customer Benefit
Data warehouse is always in sync with Adabas using tcVISION data replication Improved timeliness and reliability of reporting data
Reduced usage of mainframe MIPS Reduced cost
All data required for modernization project was successfully replicated to target environment Increased business efficiently and agility

Many more mainframe data migration and replication customer case studies can be read on the Treehouse Software Website.


__TSI_LOGO

Contact Treehouse Software for a Demo Today…

No matter where you want your mainframe data to go – the cloud, open systems, or any LUW target – tcVISION from Treehouse Software is your answer. 

_0_Treehouse_tcV_Cloud_OpenSystems

Just fill out the Treehouse Software Product Demonstration Request Form and a Treehouse representative will contact you to set up a time for your online tcVISION demonstration.


Further reading: AWS Partner Network (APN) Blog: Real-Time Mainframe Data Replication to AWS with tcVISION from Treehouse Software

Mainframe Modernization: Extracting Business Value While Maintaining Critical Legacy Data

_0_Treehouse_tcV_Cloud_OpenSystems

Whether your enterprise wants to take advantage of the latest cloud services, such as analytics, artificial intelligence (AI), etc., or move your data to a variety of newer LUW or Open Systems databases, the transition doesn’t have to be a sudden big bang.

Application Rehost / Modernization Challenges

Much of an enterprise’s mission critical mainframe data is stored in legacy mainframe databases, and the cost to maintain these databases is high.  An added complication is that the data is utilized by many interlinked and dependent programs that have been in place for many years, and sometimes, decades. Unlocking the value of this legacy data is difficult due to many very different types of mainframe databases (e.g., Db2, Adabas, CA Datacom, CA IDMS, etc.).

Many customers are looking for a solution that allows their legacy environment to continue while replicating data in real time on a modern database/platform. This enables them to utilize modern programing and data tools in order to remain competitive in their markets.

One Step At A Time…

Treehouse Software has extensive experience in helping organizations incrementally replicate their mainframe data to the cloud and other modern systems, while keeping both sides synchronized.

Treehouse Software’s expert technical representatives help customers developed a phased plan that includes installation and implementation of the tcVISION mainframe data replication product. The plan then defines various parts of the solution, including:

  • configuration management
  • environments and promotion
  • high availability
  • security
  • disaster recovery
  • monitoring
  • operations procedures
  • script customization
  • data replication mapping
  • training

After defining the architecture, the production deployment phase begins with incremental sprint-like deployments. Additional files are then deployed into production every few weeks.

This phased plan enables the tcVISION product to synchronize mission critical mainframe data to any modern database. Bi-directional, real-time data synchronization allows changes on either platform to be reflected on the other platform (e.g., a change to a PostgreSQL table is reflected back on mainframe). The customer can then modernize their application on the cloud, open systems, etc. without disrupting the existing critical work on the legacy system.

Additionally, tcVISION customers see drastically reduced mainframe MIPS costs, and increased ability to quickly respond to business environment changes.


Find out more about tcVISION — Enterprise ETL and Real-Time Data Replication Through Change Data Capture (CDC)

tcVISION supports a vast array of integration scenarios throughout the enterprise, providing easy and fast data migration for mainframe application modernization projects and enabling bi-directional data replication between mainframe, Cloud, Open Systems, Linux, Unix, and Windows platforms. This innovative technology offers comprehensive abilities to identify and capture changes occurring in mainframe and relational databases, then publish the required information to an impressive variety of targets, both on-premise and Cloud-based.

tcVISION_Overall_Diagram

tcVISION acquires data in bulk or via change data capture methods, providing real-time and bi-directional data replication between a variety of mainframe and non-mainframe sources, including (Mainframe – z/OS and VSE): VSAM, IMS, Db2 z/OS, Adabas, CA Datacom, and CA IDMS; and (Non-mainframe): AWS, PostgreSQL, Oracle, Microsoft SQL Server, IBM Db2 LUW and Db2 BLU, IBM Informix, Kafka, MongoDB, Hadoop, SAP Hana, and more.


__TSI_LOGO

Visit the Treehouse Software website for more information on tcVISION, or contact us to discuss your needs.

You can also set up a live, online demonstration of tcVISION, where we will show data replication from a mainframe database to an AWS, LUW, or Open Systems target database. Schedule your demo today!

Mainframe-to-Cloud and Open Systems Data Replication: tcVISION in 90 Seconds

Give us 90 seconds of your time, and we’ll quickly show you how tcVISION enables real-time and bi-directional Mainframe-to-Cloud and Open Systems data replication. Our video walk-through shows how tcVISION‘s GUI interface allows users to easily model and map data, and create links between data sources and target systems. tcVISION‘s intuitive interface supports simple to complex replication scenarios.


Find out more about tcVISION — Enterprise ETL and Real-Time Data Replication Through Change Data Capture

tcVISION supports a vast array of integration scenarios throughout the enterprise, providing easy and fast data migration for mainframe application modernization projects and enabling bi-directional data replication between mainframe, Cloud, Linux, Unix and Windows platforms. This innovative technology offers comprehensive abilities to identify and capture changes occurring in mainframe and relational databases, then publish the required information to an impressive variety of targets, both on-premise and Cloud-based.

tcVISION_Connection_Overview_Web01

tcVISION acquires data in bulk or via change data capture methods, including in real time, from virtually any IBM mainframe data source (Software AG Adabas, IBM Db2, IBM VSAM, IBM IMS/DB, CA IDMS, CA Datacom, even sequential files), and transform and deliver to virtually any target. In addition, the same product can extract and replicate data from a variety of non-mainframe sources, including Amazon Aurora, PostgreSQL, Adabas LUW, Oracle Database, Microsoft SQL Server, IBM Db2 LUW and Db2 BLU, and IBM Informix.


__TSI_LOGO

Visit the Treehouse Software website for more information on tcVISION, or contact us to discuss your needs.

Customer Success: tcVISION / Hadoop Integration

_tcVISION_Customer_Hadoop_Header

BAWAG P.S.K. is one of the largest and most profitable banks of Austria with more than 1.6 million private and business customers and a well known brand in the country. The business strategy is oriented towards low risk and high efficiency. Business segments are Retail Banking and Small Business, Corporate Lending and Investments and Treasury Services and Markets. The center of the BAWAG P.S.K. business strategy is the offering of easy to understand, transparent and first-rate products and services which meet the requirements of the customers.

The BAWAG P.S.K. Bank für Arbeit und Wirtschaft and Österreichische Postsparkasse Aktiengesellschaft ” (P.S.K.), Vienna, operates their IT on the z/OS operating system. The corporate data is stored in DB2 databases. ORACLE is the database platform for the Open System environments. In relationship with another project P.S.K already had a client component of tcVISION installed. Magister Markus Lechner, Head IT Applications: “tcVISION was already in use and we had good experiences as far as functionally and support is concerned. Because we were in the planning process for the implementation of another project, we included tcVISION in the list of software solutions. The goal of this project has been the reduction of the load on the IBM mainframe and as a result the reduction of costs. The intention was to offload data from our core database system to a less expensive system in real-time and to provide read access from that system to the new infrastructure. The reasons for this were constantly increasing CPU costs on the mainframe because of the growing transaction load of the Online Banking, Mobile Banking, and Self Service devices. A large percentage of the load was caused by Read-Only-Transactions.” Markus Lechner: “After the tcVISION presentation, we arranged a Proof Of Concept. The important aspects of the POC were not only the functionality of tcVISION within the project but we also wanted to see whether our expectations would be met related to performance and CPU consumption on the mainframe. In addition to tcVISION, we also evaluated another product. All of our expectations have been met to our full satisfaction during the POC and we made the decision to go ahead with tcVISION.”

After a short implementation period, the project is now in production for one year. Markus Lechner describes the project: “The primary objective of the project with tcVISION was the reduction of CPU load on the mainframe to reduce our costs. Our intention was to offload data from our core database system to a less expensive system in real-time and to provide read access from that system to the new infrastructure.

tcVISION_Hadoop

We use tcVISION for the realtime replication and we use Apache Hadoop as a cost efficient system for the storage of the data. In addition to the primary usage scenario we have the benefit to also cover additional use cases. This includes Real-time-EventHandling & Stream Processing, Analytics based upon real-time data as well as the possibility to report and analyze structured and unstructured data with excellent performance. The system can be inexpensively operated on Commodity Hardware and has no scalability limitations. Compared to the savings the costs of replication (CPU consumption) of tcVISION are very low. The support provided  was excellent during the implementation phase and also during the production phase. Inquiries by telephone or E-mail cause prompt reactions. Problems that came up during this period were solved as soon as possible even when the tcVISION software had to be extended.” There are additional plans to extend the use of tcVISION in the future. One is to implement real-time replication from ORACLE into the data lake.

Magister Markus Lechner draws a conclusion: “tcVISION enables us to significantly reduce our mainframe cost through a real-time replication to a less expensive environment. tcVISION performs a very economical log file based replication. In addition we are now in a position to implement numerous application cases based upon the replicated data which would have been too expensive and resource intensive on the mainframe. Realtime-Event-handling, Realtime-Analytics, Realtime-Fraud Prevention are only a few of the use cases that we currently cover.”


tcVISION

_0_tcVISION_Simple_Diagram

tcVISION enables bidirectional replication for DB2, Oracle, and SQL Server running on Linux/Unix/Windows, and synchronizes each data source, first by doing a bulk load from source(s) to target and then by replicating only changes— only committed changes—from source(s) to target. So there can never be ambiguity as to whether a query against the target database involves uncommitted data.

Read other tcVISON customer success stories here.


__TSI_LOGO

Visit the Treehouse Software website for more information on tcVISION, or contact us to discuss your needs.

Treehouse Software will be Exhibiting at CA World in November 2014

If you are attending CA World in Las Vegas in November, be sure to stop by the Treehouse Software booth and say hello!

We’ll be featuring our comprehensive and flexible portfolio of solutions for integration, replication, and migration of data between mainframe sources and any target, application or platform using ETL, CDC, SQL, XML and SOA technologies.

2014_CA_World

CA World ’14
November 9–12, 2014
Mandalay Bay Resort & Casino
Las Vegas, Nevada


Visitors to our exhibits will learn how Treehouse Software is currently providing several large organizations with ETL and real-time, bi-directional data replication using tcVISION. tcVISION provides easy and fast bi-directional data replication between mainframe, Linux, Unix, and Windows platforms.

tcVISION_Architecture


We will also showcase tcACCESS, which integrates mainframe data and applications with open systems and Windows.

tcACCESS_Diagram01


Meanwhile, if there is a mainframe data replication project in your future, contact Treehouse Software today.

Treehouse Software will present “Replicate Data in Real-time: Anytime, Anywhere – Live tcVISION Demonstration” at the 2014 WAVV Conference

Chris Rudolph, Senior Technical Representative for Treehouse Software will be presenting, “Replicate Data in Real-time: Anytime, Anywhere – Live tcVISION Demonstration” on Tuesday, April 15th at 11:00 AM, as part of WAVV’s vendor presentation series at the upcoming 2014 WAVV Conference, to be held April 13 – 16 at The Embassy Suites in Covington, KY.

Image

Chris will discuss how Treehouse Software is currently providing several large organizations with ETL and real-time, bi-directional data replication using tcVISION. tcVISION provides easy and fast bi-directional data replication between mainframe, Linux, Unix, and Windows platforms. Additionally, Chris will show a live demonstration of tcVISION in action.

About WAVV…

Image

WAVV is a user group promoting the interests of the users of the VSE, VM, and Linux operating systems. WAVV holds the annual conference, which consists of over 100 educational sessions as well as an exhibitor show where vendors of VSE, VM, and Linux related products show their wares and meet with customers.

More information on WAVV can be found on their website. http://www.wavv.org/