Replicating Enterprise Mainframe Data to Cloud-based SQL Databases with tcVISION

by Joseph Brady, Director of Business Development and Cloud Alliance Leader at Treehouse Software, Inc.

Treehouse Software has been helping enterprise mainframe customers since 1982, and in recent years, we have been developing a strong presence in the Mainframe-to-Cloud data replication market space. This blog takes a quick look at three of the most popular Treehouse-supported Cloud-bases SQL database services…

Amazon RDS, a collection of managed services that makes it simple to set up, operate, and scale databases in the Cloud. Users can control the type of database, as well as where data is stored. Specific database formats that are supported include Amazon Aurora, PostgreSQL, MySQL, MariaDB, Oracle Database, and SQL Server:

Google Cloud SQL, a fully managed relational database service for MySQL, PostgreSQL, and SQL server. You can connect with nearly any application, anywhere in the world. Cloud SQL automates backups, replication, and failover to ensure your database is reliable, highly available, and flexible to your performance needs:

Microsoft Azure SQL, a part of the Azure SQL family, Azure SQL Database is an always-up-to-date, fully managed relational database service built for the Cloud:


Wherever you want to target your mainframe data on the Cloud, Treehouse Software helps to make the process easy…

Treehouse Software is the worldwide distributor of tcVISION, the leading tool for using changed data capture (CDC) when transferring information between most mainframe data sources (IBM Db2, IBM VSAM, IBM IMS/DB, Software AG Adabas, CA IDMS, CA Datacom, or even sequential files) and Cloud and open systems-based databases and applications. Changes occurring in the mainframe application data are then tracked and captured, and published to a variety of targets.

tcVISION_Overall_Diagram_Cloud_OS

Additionally, tcVISION supports bi-directional data replication, where changes on either platform are reflected on the other platform (e.g., a change to a PostgreSQL table in the Cloud is reflected back on mainframe), allowing the customer to modernize their application on the Cloud or open systems without disrupting the existing critical work on the legacy system. tcVISION’s bi-directional replication writes directly to the mainframe database, thereby bypassing all mainframe business logic, so this architecture requires careful planning, as well as thorough and repeated testing.

Sales and technical leaders at the major Cloud platform companies, as well as systems integrators are engaging with Treehouse Software to take advantage of our tcVISION data replication solution to help them tap into the mainframe data that customers want to be made available on new technologies.


Further reading: tcVISION is featured on the AWS Partner Network Blog showing a walk-through of data replication between Mainframe DB2 z/OS and Amazon Aurora…

AWS Partner Network (APN) Blog: Real-Time Mainframe Data Replication to AWS with tcVISION from Treehouse Software.


__tsi_logo_400x200

Interested in seeing a live, online demo of tcVISION?

Just fill out the Treehouse Software tcVISION Demonstration Request Form and a Treehouse representative will contact you to set up a time for your online tcVISION demonstration.

Treehouse Software Customer Success: BMF uses tcVISION for Real-Time Data Replication Between Mainframe Adabas and PostgreSQL

BMF_Building

The Bundesministerium der Finanzen (BMF) is Germany’s Ministry of Finance and establishes sustainable fiscal policy that ensures financial empowerment of the federal budget. From tax policy via development of federal budget, to regulation of national and international financial markets – for these and other fiscal and economic questions of principle, the BMF creates strategies and concepts, and implements them. The Federal Tax Administration is part of BMF, and controls not only the cross-border goods traffic, but acts against illegal employment and other crimes. The tax administration also imposes consumer taxes (e.g., energy and tobacco tax, car tax, etc.). Financial relations between federation, countries, and communities are also coordinated by BMF.

Department II (federal budget) is part of the German government in charge of establishing the budget and financial planning of the federation. Throughout the year, it monitors execution of the budget for eventual intervention (e.g., with a budget freeze, or supplementary budget). After closing the fiscal year, the budget and balance sheet will be presented. The budget is a supplement of the budget act, legally binding.

The central service organization of BMF is the Informationstechnikzentrum Bund – ITZBund (Information technic center).

BUSINESS BACKGROUND

Drawing up the budget is a yearly, highly time consuming, and formalized business process. All departments are involved in nearly every sub-process, and budgeting and financial planning is supported by the application, “Haushaltsaufstellung / Budgetgeneration”. Using the generated reports, various addressees/receivers are supported (e.g., German Federal Government, German Federal Parliament, Federal Council of Germany, finance department in BMF, the employees in the departments, and the public).

Technically, the budget plan of the federation is based on technologies, including the IBM Mainframe with z/OS running Adabas and Natural.

The challenge was to provide an environment for employees in all departments that enables them to do their work quickly, easily, and efficiently. In the BMF, users must have an editorless, end-user driven, and real-time creation of ready-to-print products. An informative description of the workflow is shown on the website of the BMF.

The federal budget is available as download, or one can directly navigate through the data using the online application.

BUSINESS ISSUE

Some time ago, BMF decided to re-engineer the application for budget planning and port it to Open Source. To guarantee a seamless transition, the first step is propagation of data out of Adabas on z/OS to PostgreSQL, concluding with permanent synchronization.

The difficulties of this task are the complexities of setting up data definitions for the data structures in Natural and the propagation of data from Adabas on z/OS to PostgreSQL.

TECHNOLOGY SOLUTION: tcVISION

____Adabas_to_PostgreSQL_Diagram

After an analysis of the project, Treehouse Software proposed creating an extension to tcVISION’s change data capture (CDC) functionality for integration, so that tcVISION could enable BMF to continue using the implemented data definitions in a format suitable for the RDBMS.

The extension was developed within a few days, and a two-day on premise test demonstrated the solution fit the requirements of BMF.

BMF can now provide its data definitions from Natural LDA to the extension of tcVISION, and after the transformation, onto the PostgreSQL load process for processing. Another advantage of the tcVISION solution is that when needed, other targets can be integrated for propagation of data from the mainframe (e.g., Kafka, which BMF indicated is a future target environment).

Additionally, bi-directional propagation can be added in budget planning when BMF is ready.

Data structures are held in LDA, because this provides the advantages of higher flexibility in development and the adaption of new requirements to the data definitions. If definitions would have to be ported manually, in part, to PostgreSQL, it would have been a much bigger and error-prone effort.

Subsequent changes to Adabas structures can now use tcVISION’s newly developed extension to easily regenerate and load the correct definitions to the RDBMS, and tcVISION completely covers the customer’s requirements for special usage of *PEs and *MUs.

After thorough preparation and extensive testing, the solution was released to selected users first, then made available to all users.

* PEs and MUs are special Adabas formats for definition of tables. PE = Periodic Group, MU = Multiple Value Field.


__tsi_logo_400x200

Contact Treehouse Software for a Demo Today…

No matter where you want your mainframe data to go – the cloud, open systems, or any LUW target – tcVISION from Treehouse Software is your answer.

Just fill out the Treehouse Software Product Demonstration Request Form and a Treehouse representative will contact you to set up a time for your online tcVISION demonstration.


Further reading: Treehouse Software Customer Success – ETS: tcVISION for Real-Time Synchronization Between Mainframe IDMS and AWS RDS for PostgreSQL

Download the AWS and Treehouse Software Mainframe Data Replication Solution Brief

by Joseph Brady, Director of Business Development and Cloud Alliance Leader at Treehouse Software, Inc.

___AWS_tcVISION_Solution_Brief

Treehouse Software’s tcVISION data replication product provides connectivity between your mainframe and AWS, putting some of the world’s most advanced technologies at your fingertips. tcVISION is an innovative technology that provides real-time and bi-directional data replication between the mainframe and many AWS targets, including Amazon RDS Aurora, Amazon RDS PostgreSQL, Amazon RDS MySQL/MariaDB, Amazon RDS Oracle, Amazon RDS SQL Server, Amazon S3, Amazon Kinesis, Amazon Redshift, and more. By working with Treehouse Software and using AWS solutions, tools, programs, and databases, you can save time and automate processes. View and download the AWS tcVISION Solution Brief here.


__tsi_logo_400x200

Contact Treehouse Software for a tcVISION Demo Today…

No matter where you want your mainframe data to go – the Cloud, open systems, or any LUW target –tcVISION from Treehouse Software is your answer.

Just fill out the Treehouse Software Product Demonstration Request Form and a Treehouse representative will contact you to set up a time for your online tcVISION demonstration.

Let’s Go Shopping – Treehouse Software’s Grocery List for Customers Who are Planning Mainframe Data Replication on AWS

by Joseph Brady, Director of Business Development and Cloud Alliance Leader at Treehouse Software, Inc.

When we begin working with customers who have chosen Treehouse Software’s tcVISION mainframe data replication tool to synch data on AWS, many are just beginning to explore AWS. Some customers haven’t even chosen their desired target database(s) or service(s) yet. This blog focuses on helping customers identify the most popular tools and services needed when planning a Mainframe-to-AWS data replication project.

tcVISION‘s data replication connectivity to AWS puts some of the world’s most advanced technologies at customers’ fingertips. On the Mainframe side, the customers’ familiar on-premises environment with their mission critical data resides on various databases, such as IBM Db2, IBM VSAM, IBM IMS/DB, Software AG Adabas, CA IDMS, CA Datacom, or flat files. On the AWS side, there are over 200 fully featured Cloud-based products, including compute, storage, databases, analytics, networking, mobile, developer tools, management tools, IoT, security, and enterprise applications.  How can customers choose what’s right for them?

It’s like a big, virtual grocery store…

___AWS_Services_Grocery_Cart

As we all know, in a grocery store there are many items that appear to do the same thing, but closer inspection shows that certain products can meet specific needs. Here is a list of some of the most popular AWS products and services that we have seen our customers explore and implement for their mainframe data modernization projects:

Amazon EC2Amazon EC2’s simple web service interface allows you to obtain and configure capacity with minimal friction. It provides you with complete control of your computing resources and lets you run on Amazon’s proven computing environment. Amazon EC2 reduces the time required to obtain and boot new server instances to minutes, allowing you to quickly scale capacity, both up and down, as your computing requirements change. Amazon EC2 changes the economics of computing by allowing you to pay only for capacity that you actually use. Amazon EC2 provides developers the tools to build failure resilient applications and isolate them from common failure scenarios.

Amazon RDSAmazon Relational Database Service (Amazon RDS) makes it easy to set up, operate, and scale a relational database in the Cloud. It provides cost-efficient and resizable capacity while automating time-consuming administration tasks such as hardware provisioning, database setup, patching, and backups. It frees you to focus on your applications so you can give them the fast performance, high availability, security and compatibility they need. Amazon RDS is available on several database instance types – optimized for memory, performance or I/O – and provides you with six familiar database engines from which to choose, including Amazon AuroraPostgreSQLMySQLMariaDBOracle Database, and SQL Server.

Amazon S3 – Amazon Simple Storage Service (Amazon S3) is an object storage service that offers industry-leading scalability, data availability, security, and performance. This means customers of all sizes and industries can use it to store and protect any amount of data for a range of use cases, such as websites, mobile applications, backup and restore, archive, enterprise applications, IoT devices, and big data analytics.

Amazon S3 Bucket – An Amazon S3 Bucket is a resource that the user creates in an Amazon region, in which to upload data (photos, videos, documents, etc.).

Amazon CloudWatchAmazon CloudWatch is a powerful Cloud infrastructure monitoring service that gives developers, system operators, site reliability engineers (SRE), and IT managers actionable insights to monitor applications, understand and respond to system-wide performance changes, optimize resource utilization, and obtain a unified view of operational health. Given the dynamic nature of AWS resources, proactive measures including the dynamic re-sizing of infrastructure resources can be automatically initiated. Amazon CloudWatch alarms can be sent to the customer, such as a warning that CPU usage is too high, and as a result, an auto scale trigger can be set up to launch another EC2 instance to address the load. Additionally, customers can set alarms to recover, reboot, or shut down EC2 instances if something out of the ordinary happens.

AWS Direct ConnectAWS Direct Connect is a Cloud service solution that makes it easy to establish a dedicated, secure network connection from your on-premises computing environment to AWS. While in transit, your network traffic remains on the AWS global network and never touches the public internet.

Amazon KinesisAmazon Kinesis makes it easy to collect, process, and analyze real-time, streaming data so you can get timely insights and react quickly to new information. Amazon Kinesis offers key capabilities to cost-effectively process streaming data at any scale, along with the flexibility to choose the tools that best suit the requirements of your application. With Amazon Kinesis, you can ingest real-time data such as video, audio, application logs, website clickstreams, and IoT telemetry data for machine learning, analytics, and other applications. Amazon Kinesis enables you to process and analyze data as it arrives and respond instantly instead of having to wait until all your data is collected before the processing can begin.

AWS LambdaAWS Lambda is an event-driven, “serverless” computing platform provided by Amazon as a part of the Amazon Web Services. It is a computing service that runs code in response to events and automatically manages the computing resources required by that code.

AWS Machine LearningAWS Machine Learning Services offer the broadest and deepest set of machine learning services and supporting Cloud infrastructure, putting machine learning in the hands of every developer, data scientist and expert practitioner.

Amazon RedshiftAmazon Redshift is a popular and fastest growing Cloud data warehouse allowing customers to run and scale analytics in seconds on all of their data without having to manage a data warehouse infrastructure.


Video: tcVISION Mainframe-to-AWS data replication

tcVISION focuses on changed data capture (CDC) when transferring information between mainframe data sources and modern databases and applications. Through an innovative technology, changes occurring in any mainframe application data are tracked and captured, and then published on a variety of AWS targets. The product provides mainframe customers bi-directional, real-time data synchronization of changes on either platform to be reflected on the other platform (e.g., a change to a PostgreSQL table is reflected back on mainframe). The customer can then modernize their application on AWS without disrupting the existing critical work on the legacy system.

Treehouse Software was recently invited by AWS mainframe modernization technical teams to do a presentation and demonstration of tcVISION, our innovative Mainframe-to-Cloud data replication software product.

In this video, an introductory overview to Treehouse Software’s tcVISION is shown, along with a live demonstration of mainframe data replication on AWS RDS for PostgreSQL:


__tsi_logo_400x200

Contact Treehouse Software for a Demo Today…

No matter where you want your mainframe data to go – the Cloud, open systems, or any LUW target –tcVISION from Treehouse Software is your answer.

Just fill out the Treehouse Software Product Demonstration Request Form and a Treehouse representative will contact you to set up a time for your online tcVISION demonstration.

Enterprises with Vast Amounts of Data on Mainframe Systems are Perfectly Positioned to Take Advantage of Advanced Cloud-based Machine Learning and AI Technology

by Joseph Brady, Director of Business Development and Cloud Alliance Leader at Treehouse Software, Inc.

AI_02

Machine learning and artificial intelligence (AI) are not only revolutionizing the computing and business worlds, but the value proposition for Treehouse Software’s customer base who are replicating large amounts of mainframe data on the Cloud can be profound. Machine learning is proving to be a powerful force in improving customer experience, optimizing business operations, and accelerating innovation. This powerful, predictive technology helps improve customer engagement and conversion by creating personalized web experiences that are based on individual customer preferences and behaviors. Intelligent machine learning search services also boost business productivity and customer satisfaction by delivering accurate and useful information faster from various information sources across the organization. Additionally, business forecasting machine learning and AI tools can accurately predict demand and streamline supply-demand decisions by combining historical time series data with additional variables, such as product features, pricing, and holiday demand.

Treehouse Software is partnered with AWS, Google Cloud, and Microsoft, and has been in the mainframe market space since 1982. Our tcVISION product helps customers replicate their mainframe data, in real-time and bi-directionally, between a vast array of source databases and Cloud technologies. As soon as their mainframe data is made available within Cloud-based data stores, customers can use the wide variety of available machine learning and AI technologies.

Machine Learning and AI technologies are available at your fingertips… 

The dominant Cloud platforms are making incredible leaps in creating the most sophisticated AI tools available today — all literally at one’s fingertips. Never before has such powerful and useful technology been so easily available to so many, bringing the deepest set of machine learning services and supporting Cloud infrastructures instantly into the hands of developers, data scientists, etc. The following are a few examples of today’s most popular Cloud-based tools…

__AWS_On_White

Some examples of leading machine learning and AI product available on AWS:

  • Amazon SageMaker – A fully managed service that provides every developer and data scientist with the ability to build, train, and deploy ML models at scale.
  • AWS pre-trained AI Services – Provide ready-made intelligence for your applications and workflows.
  • More information on AWS AI and Machine Learning products

GoogleCloudPartner

Some examples of leading machine learning and AI product available on Google Cloud:

Microsoft

Some examples of leading machine learning and AI product available on Microsoft Azure:


The Journey Begins with Treehouse Software

__tsi_logo_400x200

Treehouse Software is here to help enterprise mainframe customers accelerate digital transformation and successfully leverage Hybrid Cloud initiatives on the IBM Z platform, storing sensitive data on a private cloud or local data center and simultaneously leveraging robust machine learning and AI resources on a managed public cloud.

tcVISION supports a vast array of integration scenarios throughout the enterprise, providing easy and fast data replication for mainframe application modernization projects. This innovative technology offers comprehensive abilities to identify and capture changes occurring in mainframe and relational databases, then publish the required information to an impressive variety of targets, both Cloud and on-premises.

tcVISION_Overall_Diagram_Cloud_OS

Just fill out the Treehouse Software Product Demonstration Request Form and a Treehouse representative will contact you to set up a time for your online tcVISION demonstration.


Further reading: tcVISION Mainframe-to-AWS data replication is featured on the AWS Partner Network Blog…

The AWS Partner blog talks about tcVISION’s Mainframe-to-AWS data replication capabilities, including a technical overview, security, high availability, scalability, and a step-by-step example of the creation of tcVISION metadata and scripts for replicating mainframe Db2 z/OS data on Amazon Aurora. Read the blog here: AWS Partner Network (APN) Blog: Real-Time Mainframe Data Replication to AWS with tcVISION from Treehouse Software.

Treehouse Software’s Differentiator: Enterprise Mainframe Expertise Since 1982

by Joseph Brady, Director of Business Development and Cloud Alliance Lead at Treehouse Software, Inc. 

Treehoue_Mainframe_Experience

This blog explores Treehouse Software‘s decades worth of experience in helping mainframe customers with innovative tools, services, and training. 

When Treehouse Software began in 1982, the business focused on software that was complementary to the Software AG mainframe product line (Adabas database management system and Natural programming language) in the areas of security, control, auditing, performance enhancement, etc.

In more recent years, Treehouse Software has become a global leader in providing solutions for real-time and bi-directional data replication between a variety of mainframe and non-mainframe sources, including (Mainframe): Adabas, Db2, VSAM, IMS, CA Datacom, and CA IDMS; and (Non-mainframe): Amazon Web Services (AWS), Google Cloud, Microsoft Azure, PostgreSQL, Kafka, Oracle, Microsoft SQL Server, IBM Db2 LUW and Db2 BLU, IBM Informix, MongoDB, Hadoop, and many more. Here is our list of supported data sources and targets.

Decades Worth of Mainframe Knowledge…

When asked by prospective customers, “What are your primary differentiators?”, we can be tempted to first talk about superior product features and capabilities, but in addition to our exceptional products, it is Treehouse Software’s depth of knowledge and experience in the mainframe world that is the real game changer.

Most mainframe users face critical data management challenges due to the complexity and proprietary nature of deeply entrenched databases on the platform. Our extensive experience, deep knowledge, and wide-ranging capabilities in mainframe technologies make the company a valued partner for third-party solution providers and a trusted advisor to customers.

Treehouse Software’s visionary leadership in this market has included pioneering Adabas-to-RDBMS ETL and CDC with tRelational/DPS in the mid-1990s.  Today, Treehouse Software stands alone in its product maturity, and capability, including expanded capabilities with the tcVISION product, which enables migration and synchronization of virtually any mainframe or non-mainframe database or data source.

Despite the rapid pace of change in the IT landscape, Treehouse Software’s customer base can be assured that there remains a strong commitment to providing continued support and upgrades for the product suite.

Treehouse Software provides tools and expertise for the riskiest and most-often overlooked parts of modernization and integration projects – data migration and integration.   Tapping into the vast experience of Treehouse’s technicians, and using proven products and services eliminates reliance on end-customer programming staff to write and maintain data extracts and middleware. Treehouse Software’s know-how reduces cost and mitigates risk in legacy modernization initiatives, where data migration and integration complexity is often underestimated, yet critical to success.

Our Mainframe Experts are Our Best Assets

We are fortunate to have a staff with a wealth of knowledge and skills that span not only Mainframe, but Cloud, LUW, and Open Systems technologies. Whether a customer wants to move data from their mainframe platform to other on-premises open systems or LUW databases, or to the Cloud (e.g., AWS, Google Cloud, Azure, etc.), Treehouse Software has the technical expertise and support needed to ensure successful project completion.

Treehouse Software‘s technicians have installed products and trained end-users in some of the largest mainframe sites around the world.  Mature, robust, and reliable, these products are also backed by our highly-rated 24X7 technical support.

The Treehouse Team Approach

TechniciansConnectivity

Treehouse Software has proven its ability to partner and work effectively as part of a larger team to solve client problems.  AWS, Google, Microsoft, Deloitte, Accenture, and other large vendors have selected our technology, services, and training for their mainframe data migration and application modernization practices.


__tsi_logo_400x200

Contact Treehouse Software for a Product Demo Today…

Just fill out the Treehouse Software Product Demonstration Request Form and a Treehouse representative will contact you to set up a time for your online product demonstration.

Shopping for an AWS Mainframe Data Replication Solution? Look no further than Treehouse Software’s tcVISION on the AWS Marketplace…

___AWS_Marketplace_tcVISION_AMIs

Using Treehouse Software’s tcVISION to replicate data between a mainframe database and AWS, an enterprise with mission critical data can rapidly deploy databases globally within minutes, and with minimal administration requirements. Supported mainframe databases include Db2, VSAM, IMS/DB, Adabas, IDMS, Datacom, or even sequential files. tcVISION is available on the AWS Marketplace for many global regions, including the AWS GovCloud (US) East and (US) West. 

There are three versions of the tcVISION Amazon Machine Image (AMI) on the AWS Marketplace:

1. tcVISION Enterprise Change Data Capture (CDC) Integration for AWS – Bring Your Own License (Customers must contact Treehouse Software for license key to run the software): This AMI allows transfer of mainframe data to AWS targets continuously and in real-time. Using this tcVISION AMI, a customer can deploy databases globally within minutes.

3. tcVISION Distributed Database Integration (DDI) for AWS – Pay as You Go on AWS: This AMI license installation includes security keys for Amazon S3 access and a license to use one source (PostgreSQL, Oracle, MySQL, MariaDB; MSSQL on Windows OS only) and one target (AWS S3, AWS Aurora, RDS – PostgreSQL, Oracle, MySQL, MariaDB; MSSQL on Windows OS only).

3. tcVISION Mainframe Batch Integration (MBI) for AWS – Bring Your Own License (Customers must contact Treehouse Software for license key to run the software): This AMI does not require an active connection to the mainframe, because the existing backup and recovery files from the mainframe, such as Db2 imagecopies, z/OS archive log files or IMS Unloads, Adabas unload, and PLOG files can be used.

Like what you see? Replicating mainframe data on AWS can happen within days during a tcVISION Proof of Concept (POC)…

An online tcVISION POC is approximately 10 business days, with the customer providing use case and goals for the POC. A Treehouse Software consultant will assist in downloading and installing tcVISION and conducting a limited-scope implementation of a tcVISION application. This application uses customer data and executes on customer facilities, usually in a non-production environment. A document is provided beforehand that outlines the requirements, use cases, and agenda for the POC.

By the end of the 10-day POC, customers can begin replicating mainframe data to their Cloud target database.  It can happen that fast!


Further Reading…

_0_AWS_Logo

Treehouse Software is an AWS Select Technology Partner, and the AWS Partner Network published a blog about tcVISION, our Mainframe-to-Cloud data replication product, which describes how tcVISION allows legacy mainframe environments to continue, while replicating data on highly available and secure Cloud platforms:

https://aws.amazon.com/blogs/apn/real-time-mainframe-data-replication-to-aws-with-tcvision-from-treehouse-software/


__TSI_LOGO

Visit the Treehouse Software website for more information on tcVISION, or contact us to discuss your needs.

Don’t Jump in the Lake Without Treehouse Software! We Can Help Your Enterprise Safely Move Large Volumes of Mainframe Data to Centralized, Scalable, Cloud-Based Repositories

by Joseph Brady, Director of Business Development / Cloud Alliance Lead at Treehouse Software, Inc.

___JumpInTheLake

Many enterprises have relied on traditional data infrastructures for decades, but older data solutions can’t keep up with the volume and variety of data being collected today. This blog takes a look at building a data lake on Amazon Web Services (AWS), which allows you to store all of your data in one central repository.

What is a Data Lake?

A data lake is a centralized repository for storing structured and unstructured data at any scale. A customer can store data as-is, without having to first structure the data, and run different types of analytics—from dashboards and visualizations to big data processing, real-time analytics, and machine learning to guide better decisions.

___AWS_Data_Lake

Depending on the requirements, a typical organization will require both a data warehouse and a data lake as they serve different needs, and use cases.

A data warehouse is a database optimized to analyze relational data coming from transactional systems and line of business applications. The data structure, and schema are defined in advance to optimize for fast SQL queries, where the results are typically used for operational reporting and analysis. Data is cleaned, enriched, and transformed so it can act as the “single source of truth” that users can trust.

A data lake is different, because it stores relational data from line of business applications, and non-relational data from mobile apps, IoT devices, and social media. The structure of the data or schema is not defined when data is captured. This means you can store all of your data without careful design or the need to know what questions you might need answers for in the future. Different types of analytics on your data like SQL queries, big data analytics, full text search, real-time analytics, and machine learning can be used to uncover insights.

As organizations with data warehouses see the benefits of data lakes, they are evolving their warehouses to include data lakes, and enable diverse query capabilities, data science use-cases, and advanced capabilities for discovering new information models. Gartner names this evolution the “Data Management Solution for Analytics” or “DMSA.”

Data lakes built on Amazon S3 provide the foundation for analytics and innovation, and AWS Partner Network (APN) Partners have demonstrated success in helping enterprises evaluate and use the tools and best practices for collecting, storing, governing, and analyzing data.

Key data lake-enabling features of Amazon S3 include the following:

  • Decoupling of storage from compute and data processing – With Amazon S3, you can cost-effectively store all data types in their native formats. You can then launch as many or as few virtual servers as you need using Amazon Elastic Compute Cloud (EC2), and you can use AWS analytics tools to process your data. You can optimize your EC2 instances to provide the right ratios of CPU, memory, and bandwidth for best performance.
  • Centralized data architecture – Amazon S3 makes it easy to build a multi-tenant environment, where many users can bring their own data analytics tools to a common set of data. This improves both cost and data governance over that of traditional solutions, which require multiple copies of data to be distributed across multiple processing platforms.
  • Integration with clusterless and serverless AWS services – Use Amazon S3 with Amazon Athena, Amazon Redshift Spectrum, Amazon Rekognition, and AWS Glue to query and process data. Amazon S3 also integrates with AWS Lambda serverless computing to run code without provisioning or managing servers. With all of these capabilities, you only pay for the actual amounts of data you process or for the compute time that you consume.
  • Standardized APIs – Amazon S3 RESTful APIs are simple, easy to use, and supported by most major third-party independent software vendors (ISVs), including leading Apache Hadoop and analytics tool vendors. This allows customers to bring the tools they are most comfortable with and knowledgeable about to help them perform analytics on data in Amazon S3.

— Source: AWS


Getting to the Lake: Mainframe-to-AWS Data Replication with tcVISION…

An enterprise’s long-standing mainframe data can be residing on one, or a combination of  databases, including IBM Db2, IBM VSAM, IBM IMS/DB, Software AG Adabas, CA IDMS, CA Datacom, or even sequential files.  Treehouse Software’s tcVISION writes .csv or JSON to AWS S3, providing an optimal foundation for a data lake, because of its virtually unlimited scalability.

Here is a look at three options for data replication with tcVISION:

1. tcVISION Bulk Load of Mainframe Data – Initial load of the database where tables can be loaded as a parallel operation in one or more EC2 instances. tcVISION reads the database from the mainframe directly, and can FTP or use S3 to migrate unloads directly to the EC2 instance.

___tcVISION_AWS_Bulk_Load

2. tcVISION Enterprise Change Data Capture (CDC) Integration – A multiple platform solution for real-time, continuous data synchronization and replication based on log-based Change Data Capture technology and mainframe batch integration. It turns data exchange into a single-step operation as it includes a powerful repository for data transparency, data transformation, and apply processing logic for the targets. Transfer mainframe data to your AWS targets continuously and in real-time for Big Data, Analytics, Business Intelligence, ERP, CRM, or for application modernization or mainframe offload initiatives or mainframe migration.

___tcVISION_AWS_CDC

3. tcVISION Bi-directional Data ReplicationtcVISION allows bi-directional, real-time data synchronization of changes on either platform to be reflected on the other platform (e.g., a change to a PostgreSQL table is reflected back on mainframe). The customer can then modernize their application on the cloud, open systems, etc. without disrupting the existing critical work on the legacy system.

___tcVISION_AWS_BiDirect

The tcVISION solution focuses on CDC when transferring information between mainframe data sources and Cloud databases and applications. Through an innovative technology, changes occurring in any mainframe application data are tracked and captured, and then published to a variety of Cloud targets.


Further reading: tcVISION Mainframe-to-AWS data replication is featured on the AWS Partner Network Blog…

___tcVISION_AWS_HA_Architecture

Treehouse Software is an AWS Technology Partner, and AWS published a blog about tcVISION’s Mainframe-to-AWS data replication capabilities, including a technical overview, security, high availability, scalability, and a step-by-step example of the creation of tcVISION metadata and scripts for replicating mainframe Db2 z/OS data to Amazon Aurora.

Read the blog here: AWS Partner Network (APN) Blog: Real-Time Mainframe Data Replication to AWS with tcVISION from Treehouse Software.


__tsi_logo_400x200

Contact Treehouse Software Today…

Treehouse Software has been helping mainframe enterprises since 1982, and our extensive experience, deep knowledge, and wide-ranging capabilities in mainframe technologies makes us a valued partner and a trusted advisor to customers.

No matter where you want your mainframe data to go – the cloud, open systems, or any LUW target – tcVISION from Treehouse Software is your answer.

Just fill out the Treehouse Software Product Demonstration Request Form and a Treehouse representative will contact you to set up a time for your online tcVISION demonstration.

Enterprise Mainframe Customers are Realizing the Benefits of Replicating Data to Cloud-based Relational Databases

by Joseph Brady, Director of Business Development / AWS and Cloud Alliance Lead at Treehouse Software, Inc.

Treehouse Software has been helping enterprises mainframe customers since 1982, and in recent years, we have been developing a strong presence in the emerging Cloud market space relating to mainframe data migration. This blog takes a quick look at a couple of popular Treehouse-supported Cloud relational database systems…

Amazon Aurora relational database, a MySQL and PostgreSQL-compatible relational database built for the cloud, that combines the performance and availability of traditional enterprise databases with the simplicity and cost-effectiveness of open source databases:

Google Cloud SQL, a fully managed relational database service for MySQL, PostgreSQL, and SQL server. You can connect with nearly any application, anywhere in the world. Cloud SQL automates backups, replication, and failover to ensure your database is reliable, highly available, and flexible to your performance needs:

Treehouse Software Helps to Make the Mainframe Data Move Easy…

Many enterprises’ mainframe systems house vast amounts of data  encompassing historical, customer, inventory, logistics, and a myriad of other information types. Sales leaders at Cloud platform companies and systems integrators are engaging with Treehouse Software to take advantage of our unique skills and tcVISION Mainframe-to-Cloud data replication solution to help them tap into this potential goldmine of data that needs to be made available to new technologies.

tcVISION_Overall_Diagram_General_Cloud

With tcVISION, customers can replicate mission critical data to the Cloud, and immediately take advantage of the broadest and deepest set of capabilities, including artificial intelligence (AI), machine learning, Internet of things (IoT), predictive data analytics, high performance and security, high availability across global regions, scalability, and innovation. Imagine having the most advanced technologies available for data processing, interactive analytics, real-time analytics, operational analytics, dashboards, and data warehousing at your fingertips!

Where is your mission critical data residing?

tcVISION provides the means for customers to easily replicate relevant data from most mainframe data sources (IBM Db2, IBM VSAM, IBM IMS/DB, Software AG Adabas, CA IDMS, CA Datacom, or even sequential files) to Cloud targets, including AWS, Google Cloud, Microsoft Azure, and Oracle Cloud

Walkthrough of tcVISION Mainframe Data Replication to Cloud and Open Systems in 90 Seconds…


Further reading: tcVISION Mainframe-to-AWS data replication is featured on the AWS Partner Network Blog…

___tcVISION_AWS_HA_Architecture

AWS recently published a blog about tcVISION’s Mainframe-to-Cloud data replication capabilities:

AWS Partner Network (APN) Blog: Real-Time Mainframe Data Replication to AWS with tcVISION from Treehouse Software.


__tsi_logo_400x200

Contact Treehouse Software Today…

No matter where you want your mainframe data to go – the Cloud, Open Systems, or any LUW target – tcVISION from Treehouse Software is your answer.

Just fill out the Treehouse Software Product Demonstration Request Form and a Treehouse representative will contact you to set up a time for your online tcVISION demonstration.

The New 2020 IBM Z Solutions Directory Features a Wide Selection of Mainframe Tools and Services, Including Treehouse Software’s Data Integration Products

by Joseph Brady, Director of Business Development / Cloud Alliance Lead at Treehouse Software, Inc. 

2020_IBM_Systems_Solutions_Directory

Enterprises’ investments in IBM Z mainframe technology is significant, and the IBM Z Solutions Directory showcases some of the best hardware, accessories, software products, and services available to help customers maintain and expand the platform.

Treehouse Software encourages mainframe customers to explore the IBM Z Solutions Directory, where they will find neatly organized listings that help them quickly find the products and services they need. We are very pleased to have our products included, side-by-side, with most of the top mainframe solutions in the world in this valuable guide. 


__TSI_LOGO

More About Treehouse Software’s Mature and Proven Mainframe Enterprise Transformation Products…

Treehouse_Products_Diagram_General_Cloud.jpg

Treehouse Software has been developing, marketing, selling, and supporting mainframe software since 1982, and we are committed to helping customers easily access some of the most advanced Cloud and open systems technologies in the world, while maintaining their valuable legacy environments. 

Treehouse Software’s visionary leadership in the mainframe market has included pioneering Adabas-to-RDBMS ETL and CDC with tRelational/DPS in the mid-1990s.  Today, with the tcVISION product, Treehouse Software is a global leader in providing real-time and bi-directional data replication between a variety of mainframe and non-mainframe sources, including (Mainframe): VSAM, IMS, Db2, CA Datacom, Adabas, and CA IDMS; and (Non-mainframe): Amazon Web Services (AWS), Microsoft Azure, Google Cloud, Oracle Cloud, PostgreSQL, Microsoft SQL Server, IBM Db2 LUW and Db2 BLU, IBM Informix, Kafka, MongoDB, MariaDB, Hadoop, SAP Hana, and many more.

Despite the rapid pace of change in the IT landscape, Treehouse Software’s customer base can be assured that there remains a strong commitment to providing continued support and upgrades for the product suite.

Contact Treehouse Software for a Product Demo Today…

Just fill out the Treehouse Software Product Demonstration Request Form and a Treehouse representative will contact you to set up a time for your online product demonstration.