Treehouse Software is Helping Government Agencies with Mainframe Adabas Data Take Advantage of Cutting Edge Cloud-based Technologies

by Joseph Brady, Director of Business Development / Cloud Alliance Lead at Treehouse Software, Inc.

___Gov_IT_Cloud

Many government agencies have large volumes of mission critical and historical data stored in a variety of legacy mainframe databases (for this blog, we are focusing on Adabas). These government agencies combine a broad range human service programs, including employment assistance and job training, child and adult protection, child support enforcement, cash assistance, and services for the developmentally disabled, all of which constantly require accurate, up-to-date, and secure data.

To support the needs of clients, government agencies are generally broken into multiple divisions, including the division that Treehouse Software works with the most — Technology Services. The Technology Services divisions provide technical and systems services for the development, maintenance, and enhancement of automated business systems. They also ensure that the production and sub-production databases are running smoothly and efficiently by performing necessary maintenance of the databases.

Rapidly changing national health and economic conditions are making fast access to the most current information more important than ever for government agencies and the public.  As a result, a top priority for Technology Services divisions is modernizing critical data residing on long-standing mainframe databases. Unlocking the value of this important data can be difficult, because the data can be utilized by numerous interlinked and dependent programs that have been in place for many years, and sometimes decades.

Many Treehouse government customers are now looking for modernization solutions that allow their legacy mainframe environments to continue, while replicating data in real time on highly available Cloud-based platforms, such as AWS, Google Cloud, and Microsoft Azure. tcVISION from Treehouse Software allows a “data-first” approach, whereby immediate data replication to the Cloud helps government agencies begin strategies to meet spikes in demand for vital information, especially in times of crisis.

Just what is it about Adabas?

Adabas is a mainframe database that is still heavily used by government sites throughout the U.S. and the world. Having specialized in tools and services complementary to Adabas/Natural applications since 1982, Treehouse has successfully encountered and addressed many unique issues within the Adabas environment. This excerpt from a Treehouse technical document outlines three primary issues with Adabas/Natural that must be considered:

  1. Adabas has no concept of “transaction isolation”, in that a program may read a record that another program has updated, in its updated state, even though the update has not been committed.  This means that programmatically reading a live Adabas database—one that is available to update users—will almost inevitably lead to erroneous extraction of data.  Record modifications (updates, inserts and deletes) that are extracted, and subsequently backed out, will be represented incorrectly—or not at all—in the target. Because of this, at Treehouse we say “the only safe data source is a static data source”—not the live database.
  2. Many legacy Adabas applications make use of “record typing”, i.e., multiple logical tables stored in a single Adabas file.  Often, each must be extracted to a separate table in the target RDBMS.  The classic example is that of the “code-lookup file”.  Most shops have a single file containing state codes, employee codes, product-type codes, etc.  Records belonging to a given “code table” may be distinguished by the presence of a value in a particular index (descriptor or superdescriptor in ADABAS parlance), or by a range of specific values.  Thus, the extraction process must be able to dynamically assign data content from a given record to different target tables depending on the data content itself.
  3. Adabas is most often used in conjunction with Software AG’s Natural 4GL, and “conveniently” provides for unique datatypes (“D” and “T”) that appear to be merely packed-decimal integers on the surface, but that represent date or date-time values when interpreted using Software AG’s proprietary Natural-oriented algorithm. The most appropriate way to migrate such datatypes is to recognize them and map them to the corresponding native RDBMS datatype (e.g., Oracle DATE) in conjunction with a transformation that decodes the Natural value and formats it to match the target datatype.

For discovery and analysis of legacy source data structures, tcVISION’s modeling and mapping facilities view and capture logical Adabas structures, as documented in Software AG’s PREDICT data dictionary, as well as physical structures as described in Adabas Field Definition Tables (FDTs).  Note that PREDICT is a “passive” data dictionary—there is no requirement that the logical and physical representations agree, so it is necessary to scrutinize both to ensure that the source structures are accurately modeled.

Furthermore, tcVISION generates specification and implementation of appropriate mappings and transformations for converting Adabas datatypes and structures to corresponding RDBMS datatypes and structures, including automatic handling of the proprietary “D” and “T” source datatypes.

There are three ways tcVISION can access Adabas data:

  1. ETL – read the active database nucleus
  2. ETL – read datasets containing unloaded Adabas files created by the ADAULD utility
  3. CDC – read the active and archived PLOGs datasets

It is important to note that the schema, mappings and transformations that result from metadata import can be tailored to any specific requirements after the fact.  It is even possible to import an existing RDBMS schema and retrofit it, via drag-and-drop, to the source Adabas elements.

Using the tcVISION Control Board, a Windows GUI interface, the most complex transformations can be specified. Source fields can be combined into a single column, decomposed into separate columns, and be subject to calculations, database lookups, string operations and even programmatic manipulation. Furthermore, mapping rules can be implemented to specify that data content from a source Adabas record be mapped to one or more target RDBMS tables—each with its own different structure, as desired—based on the data content itself. Target tables can even be populated from more than one source file.

tcVISION supports complex replication scenarios…

tcVISION_Complex_Replication_Scenarios

tcVISION GUI Control Board functions as a central point of administration…

tcVISION_Control_Board

Automatically apply target schema within the Control Board…

tcVISION_Target_Schema

It is impossible to discuss all the features and capabilities of tcVISION within a high-level overview.  Given the maturity, wealth of functionality and relative low cost of tcVISION, as compared to the effort, complexity and risk entailed in a “Do-It-Yourself”, solution there is no reason why a legacy renewal project should run aground on data migration.

tcVISION’s minimal footprint on the mainframe…

Customers are very happy with tcVISION‘s “staged processing” methodology, where the only processing occurring on the mainframe was the capture of changes from Adabas PLOGs. The bulk of the processing occurs on the target platform, minimizing tcVISION’s footprint on the mainframe as seen in this diagram…

tcVISION_Staged_Processing

The user defines on which platform stage their processing should be done. Do as little as possible on the mainframe: Stage 0 – capture data and send data (internal format) to target, and process data up to Stage 3 in receiving environment.

Moving forward with tcVISION…

Treehouse Software has been helping local, state, and federal government agencies with Adabas and Natural in the areas of data migration, security, control, auditing, performance enhancement, etc. for decades. Over the years, Treehouse has expanded its capabilities to address new requirements for modernizing legacy mainframe Adabas databases on various Cloud platforms. By using Treehouse Software’s tcVISION Mainframe-to-Cloud data replication product, our government customers are able to immediately utilize some of the most advanced Cloud tools and services in the world.

tcVISION enables government agencies to synchronize mainframe Adabas data with various highly available and secure Cloud databases, data warehouses. etc.. Additionally, bi-directional, real-time data synchronization will enable changes on either platform to be reflected on the other platform (e.g., a change to a PostgreSQL table is reflected back on the mainframe database). This allows governments to modernize  applications on Cloud platforms without disrupting the existing critical work on the legacy system, and modern tools can now be used in the new environment, greatly enhancing agility.

Replicating mainframe data on the Cloud can happen within days during a tcVISION Proof of Concept (POC)…

tcVISION_Overall_Diagram_General_Cloud01

An online tcVISION POC is approximately 10 business days, with the customer providing use case and goals for the POC. A Treehouse Software consultant will assist in downloading and installing tcVISION and conducting a limited-scope implementation of a tcVISION application. This application uses customer data and executes on customer facilities, usually in a non-production environment. A document is provided beforehand that outlines the requirements, use cases, and agenda for the POC.

By the end of the 10-day POC, customers can begin replicating mainframe data to their Cloud target database.  It can happen that fast!

Further Reading…

_0_AWS_Logo

Treehouse Software is an AWS Technology Partner, and the AWS Partner Network published a blog about tcVISION, our Mainframe-to-Cloud data replication product, which describes how tcVISION allows legacy mainframe environments to continue, while replicating data on highly available and secure Cloud platforms:

https://aws.amazon.com/blogs/apn/real-time-mainframe-data-replication-to-aws-with-tcvision-from-treehouse-software/


__TSI_LOGO

Contact Treehouse Software for a tcVISION Demo Today…

Simply fill out our Product Demonstration Request Form and a Treehouse representative will be contacting you to set up a time for your requested demonstration.

Replicate Data Between Mainframes and Cloud APIs for MongoDB with Treehouse Software’s tcVISION

by Joseph Brady, Director of Business Development / Cloud Alliance Lead at Treehouse Software, Inc.

Treehouse Software is helping enterprises with mainframe data explore modernizing with various Cloud APIs for MongoDB using tcVISION, our Mainframe-to-Cloud data replication product.

The MongoDB Atlas Database as a Service (DBaaS) is present across all major Cloud platforms (AWS, Azure, and Google). Automated infrastructure provisioning, setup, and deployment are fully automated with MongoDB Atlas.

Select a Cloud provider, region, instance size, memory, and additional configurations in the Cluster Builder or via the API and be on your way…

Video Demo: Moving Mainframe Data to MongoDB with tcVISION

Our video demonstrates integrating logically connected data to a document structure in MongoDB. This video shows how to transfer Db2 z/OS Mainframe Data To MongoDB using tcVISION…

Replicating mainframe data on the Cloud can happen within days during a tcVISION Proof of Concept (POC)…

tcVISION_Overall_Diagram_General_Cloud

An online tcVISION POC is approximately 5-10 business days, with the customer providing use cases, goals, and a representative sample of data for the POC. A Treehouse Software consultant will assist in downloading and installing tcVISION and conducting a limited-scope implementation of a tcVISION application. This application uses customer data and executes on customer facilities, usually in a non-production environment. A document is provided beforehand that outlines the requirements and agenda for the POC.

By the end of the 10-day POC, customers can begin replicating mainframe data to their Cloud target database.  It can happen that fast!

Further Reading…

_0_AWS_Logo

Treehouse Software is an AWS technology partner, and the AWS Partner Network published a blog about tcVISION, our Mainframe-to-Cloud data replication product, which describes how tcVISION allows legacy mainframe environments to continue, while replicating data on highly available and secure Cloud platforms:

https://aws.amazon.com/blogs/apn/real-time-mainframe-data-replication-to-aws-with-tcvision-from-treehouse-software/


__TSI_LOGO

Contact Treehouse Software for a tcVISION Demo Today…

Simply fill out our Product Demonstration Request Form and a Treehouse representative will be contacting you to set up a time for your requested demonstration.

Treehouse Software is Helping Higher Education Customers Modernize Long-standing Mainframe Data on the Cloud

by Joseph Brady, Director of Business Development / Cloud Alliance Lead at Treehouse Software, Inc.

___Higher_Ed_Data

The Business Issue

Many higher education institutions have large volumes of mission critical and historical data stored in legacy mainframe databases (Db2, Adabas, IMS, IDMS, Datacom, VSAM, etc.). The cost to maintain these databases is high and they lack the features required for modernizing the data architecture. Additionally, the data is utilized by an extensive number of interlinked programs dependent on this legacy data.

Colleges and universities are searching for a solution that allows them to unlock their mainframe data within a Cloud-based data store, such as Amazon Simple Storage Service (Amazon S3), where they can use a wide array of analytics and machine learning services for easy access to all relevant data, without compromising security or governance.

Once mainframe data is on AWS, an institution can innovate quickly by creating new functions with Cloud speed, such as mobile users via Amazon API Gateway, or voice devices such as Amazon Alexa.

Additionally, data security is one of the biggest challenges facing most higher education organizations. Beyond the certifications and best practices that are part of having data reside on the AWS Cloud platform, there are also many security features and services designed to help an organization stay compliant with industry best practices and regulations.

The Solution: Mainframe-to-Cloud Data Replication 

Treehouse Software recently helped a large university with a requirement for a solution that allows their legacy mainframe database to continue while replicating data in real time on AWS. By using Treehouse Software’s tcVISION Mainframe-to-Cloud data replication product, the university was able to immediately utilize some of the most advanced Cloud tools and services in the world.

___tcVISION_AWS_Overall_Architecture

tcVISION enables the university to synchronize mainframe data to Amazon RDS for PostgreSQL. Furthermore, bi-directional, real-time data synchronization will enable changes on either platform to be reflected on the other platform (e.g., a change to a PostgreSQL table is reflected back on the mainframe database). This allows the university to modernize the application on PostgreSQL without disrupting the existing critical work on the legacy system, and modern tools can now be used in the PostgreSQL environment, greatly enhancing business agility.

Moving Forward…

Having on-demand, Cloud-based services available can now help IT teams build secure environments for mission-critical applications for the University, freeing them to focus on student success and plan for growth or increased seasonal demand.

tcVISION provides the quality of service required by enterprise data workloads for security, availability, and scalability, and university staff and students can look forward to quickly and affordably accessing Cloud compute, storage, and application services.

Replicating mainframe data on the Cloud can happen within days during a tcVISION Proof of Concept (POC)…

tcVISION_Overall_Diagram_General_Cloud

An online tcVISION POC is approximately 5-10 business days, with the customer providing use case and goals for the POC. A Treehouse Software consultant will assist in downloading and installing tcVISION and conducting a limited-scope implementation of a tcVISION application. This application uses customer data and executes on customer facilities, usually in a non-production environment. A document is provided beforehand that outlines the requirements and agenda for the POC.

By the end of the 10-day POC, customers can begin replicating mainframe data to their Cloud target database.  It can happen that fast!

Further Reading…

_0_AWS_Logo

Treehouse Software is an AWS technology partner, and the AWS Partner Network published a blog about tcVISION, our Mainframe-to-Cloud data replication product, which describes how tcVISION allows legacy mainframe environments to continue, while replicating data on highly available and secure Cloud platforms:

https://aws.amazon.com/blogs/apn/real-time-mainframe-data-replication-to-aws-with-tcvision-from-treehouse-software/


__TSI_LOGO

Contact Treehouse Software for a tcVISION Demo Today…

Simply fill out our Product Demonstration Request Form and a Treehouse representative will be contacting you to set up a time for your requested demonstration.

Customers are discovering that they can quickly begin replicating their mainframe data to the Cloud during tcVISION Proof of Concepts (POCs)

by Joseph Brady, Director of Business Development / Cloud Alliance Lead at Treehouse Software, Inc.

___Data_Flow_Cloud

Modernizing long-standing mainframe systems has become a strategic imperative at many government, education, healthcare, financial, and retail organizations. As a result, these organizations are looking for solutions that allow their legacy environments to continue, while replicating data, in real time, on Cloud-based platforms, such as AWS, Microsoft Azure, Google Cloud, etc. This “data first” approach allows organizations to quickly take advantage of advanced Cloud technologies, such as big data analytics, artificial intelligence (AI), rapid global database deployments, high-level security, etc., while keeping the mainframe and Cloud sides synchronized.

With new IT modernization initiatives in the forefront, Treehouse Software is seeing a significant upswing in requests for online demonstrations and POCs of tcVISION, our Mainframe-to-Cloud data replication product.

You can start moving your mainframe data to the Cloud within days during a tcVISION POC…

tcVISION_Overall_Diagram_General_Cloud

An online tcVISION POC is approximately 5-10 business days, with the customer providing use case and goals for the POC. A Treehouse Software consultant will assist in downloading and installing tcVISION, and conduct a limited-scope implementation of a tcVISION application. This application uses customer data and executes on customer facilities, usually in a non-production environment. A document is provided beforehand that outlines the requirements and agenda for the POC.

By the end of the 10-day POC, customers can begin replicating mainframe data to their Cloud target database.  It can happen that fast!


__TSI_LOGO

Contact Treehouse Software for a tcVISION Demo Today…

Simply fill out our Product Demonstration Request Form and a Treehouse representative will be contacting you to set up a time for your requested demonstration.

High Availability Requirements for Mainframe Data Modernization — Running tcVISION in Global Availability Zones

by Joseph Brady, Director of Business Development / Cloud Alliance Lead at Treehouse Software, Inc.

Many customers embarking on Mainframe-to-Cloud data replication projects with Treehouse Software are looking at high availability (HA) as a key consideration in the planning process. The goal with HA is to ensure that systems are always functioning and accessible, with deployments located in various Availability Zones (AZs) worldwide. Having an HA architecture in place protects against data center, availability zone, server, network, and storage subsystem failures to keep businesses running without downtime or human intervention.

In this blog, we will give a high-level overview of tcVISION HA Architecture, using AWS as an example. However, HA basic principles are essentially the same across all Cloud platforms.

Example of the tcVISON HA Architecture on AWS

During tcVISION’s Change Data Capture (CDC) processing for Mainframe-to-Cloud data replication, HA must be maintained in the AWS environment. The Amazon Elastic Compute Cloud (Amazon EC2), which contains the tcVISION Manager, is part of an Auto Scaling Group that is spread across AZs with Amazon EC2 instance(s).

___tcVISION_AWS_HA_Architecture

Upon failure, the replacement Amazon EC2 instance tcVISION Manager is launched and communicates its IP address to the mainframe tcVISION Manager. The mainframe tcVISION Manager then starts communication with the replacement Amazon EC2 tcVISION Manager.

Once the Amazon EC2 tcVISION Manager is restarted, it continues processing at its next logical restart point, using a combination of the LUW and Restart files. LUW files contain committed data transactions not yet applied to the target database. Restart files contain a pointer to the last captured and committed transaction and queued uncommitted CDC data. Both file types are stored on a highly available data store, such as Amazon Elastic File System (EFS).

For production workloads, Treehouse Software recommends turning on Multi-AZ target and metadata databases.

To keep all the dynamic data in an HA architecture, tcVISION uses EFS, which provides a simple, scalable, fully managed elastic file system for use with AWS Cloud services and on-premises resources. It is built to scale on-demand to petabytes without disrupting applications, growing and shrinking automatically as you add and remove files, eliminating the need to provision and manage capacity to accommodate growth.


Treehouse Software can help organizations immediately start moving their mainframe data to the Cloud and take advantage of the most advanced, scalable, secure, and highly available technologies in the world with tcVISION

tcVISION_Overall_Diagram_General_Cloud

tcVISION supports a vast array of integration scenarios throughout the enterprise, providing easy and fast data migration for mainframe application modernization projects and enabling bi-directional data replication between mainframe, Cloud, Open Systems, Linux, Unix, and Windows platforms.

View the Unequalled List of Environments Supported by tcVISION Here


__TSI_LOGO

___AWS_Select_Partner_Badge ___Google_Cloud_Partner_Badge

Contact Treehouse Software for a Demo Today…

Just fill out the Treehouse Software Product Demonstration Request Form and a Treehouse representative will contact you to set up a time for your tcVISION demonstration. This will be a live, on-line demonstration that shows tcVISION replicating data from the mainframe to a Cloud target database.

Now, more than ever, enterprises with mainframes are looking to modernize their legacy systems

by Joseph Brady, Director of Business Development / Cloud Alliance Lead at Treehouse Software, Inc.

Rapidly changing global health, economic, and political conditions are making fast access to the most current information more important than ever for official agencies and the public.  As a result, modernizing information systems is taking center stage and top priority, especially for organizations with critical mainframe data residing on a variety of long-standing databases, often still updated by COBOL applications! These databases include Db2, VSAM, IMS/DB, Adabas, IDMS, Datacom, or even sequential files. Unlocking the value of this important data can be difficult, because the data can be utilized by numerous interlinked and dependent programs that have been in place for many years, and sometimes decades.

Many organizations are now looking for modernization solutions that allow their legacy mainframe environments to continue, while replicating data in real time on highly available Cloud-based platforms (AWS, Google Cloud, Microsoft Azure, etc.). With a “data-first” approach, immediate data replication to the Cloud is enabling government, healthcare, supply chain, financial, and a variety of public service organizations to meet spikes in demand for vital information, especially in times of crisis.

Treehouse Software can help organizations immediately start moving their mainframe data to the Cloud and take advantage of the most advanced technologies in the world with tcVISION

tcVISION_Overall_Diagram_General_Cloud

Whether an enterprise needs to take advantage of the latest Cloud services, such as big data analytics, artificial intelligence (AI), rapid global database deployments, high-level security, etc., or move data to a variety of newer Cloud or Open Systems databases, the transition doesn’t have to be a sudden big bang.

A Phased Approach

Treehouse Software has extensive mainframe experience and subject matter experts to help organizations incrementally replicate their mainframe data to the Cloud and other modern systems, while keeping both sides synchronized.

Treehouse Software’s expert technical representatives help customers develop a phased plan that includes installation and implementation of the tcVISION mainframe data modernization product, script customization, data replication mapping, high availability, security, monitoring, training, etc..

After defining the architecture, the production deployment phase begins with incremental sprint-like deployments. Additional files are then deployed into production regularly.

This phased plan enables tcVISION to synchronize critical mainframe data to a Cloud / Open Systems database. Bi-directional, real-time data synchronization allows changes on either platform to be reflected on the other platform (e.g., a change to a PostgreSQL table is reflected back on mainframe). The customer can then modernize their application on the cloud, open systems, etc. without disrupting the existing critical work on the legacy system.

Additionally, tcVISION customers see drastically reduced mainframe MIPS costs, and increased ability to quickly respond to business environment changes.

Enterprise ETL and Real-time and Bi-directional Data Replication Through Change Data Capture with tcVISION

tcVISION uses an intuitive Windows GUI interface for administration, mapping and modeling, script generation, and monitoring. The product focuses on changed data capture (CDC) when transferring information between mainframe data sources and modern databases and applications. Through an innovative technology, changes occurring in any mainframe application data are tracked and captured, and then published to a variety of targets.

tcVISION – Supported Sources and Targets

tcVISION supports a vast array of integration scenarios throughout the enterprise, providing easy and fast data migration for mainframe application modernization projects and enabling bi-directional data replication between mainframe, Cloud, Open Systems, Linux, Unix, and Windows platforms.

View the Unequalled List of Environments Supported by tcVISION Here


__TSI_LOGO

___AWS_Select_Partner_Badge ___Google_Cloud_Partner_Badge

Contact Treehouse Software for a Demo Today…

Just fill out the Treehouse Software Product Demonstration Request Form and a Treehouse representative will contact you to set up a time for your tcVISION demonstration. This will be a live, on-line demonstration that shows tcVISION replicating data from the mainframe to a Cloud target database.

Treehouse Software, Inc. Collaborates with Google Cloud to Offer Mainframe-to-Google Cloud Data Replication for Enterprise Transformation and Modernization

by Joseph Brady, Director of Business Development / Cloud Alliance Lead at Treehouse Software, Inc.

_0_Treehouse_And_Google_Cloud_Logos_H

Treehouse Software, Inc. is pleased to announce an agreement with Google Cloud as a technology partner in the Google Cloud Partner Advantage Program. As a technology partner, Treehouse Software Inc. will now offer enterprise customers a comprehensive Mainframe-to-Google Cloud data replication and migration solution. This relationship provides Google Cloud customers with Treehouse’s combination of decades worth of mainframe systems experience and comprehensive data replication capabilities, with Google Cloud’s platform.

The Google Cloud Enterprise Transformation Practice assists companies in migrating and modernizing workloads on Google Cloud’s global, secure, and reliable platform. Once an enterprise’s data is on Google Cloud, they can immediately take advantage of some of the most advanced artificial intelligence, machine learning, big data analytics, and data warehousing services in the world.

01_tcV_Arch_Google_Cloud

The same technology that supports Google’s global network protects data while meeting rigorous industry-specific compliance standards, and Treehouse Software’s tcVISION product moves or syncs mainframe data with real-time and bi-directional data replication. tcVISION’s GUI modeling and mapping, and ease of migrating data to Google Cloud, makes it an ideal choice for modernizing large mainframe environments.

“Through this exciting new collaboration with Google Cloud, Treehouse Software expands its mature and proven mainframe data delivery capabilities, and customers benefit from modernization of their data on one of the most popular and advanced Cloud platforms in the world”, said Joseph Brady, Director of Business Development and Cloud Alliance Lead at Treehouse Software.


__tsi_logo_400x200

Contact Treehouse Software Today…

Treehouse Software has been helping mainframe enterprises since 1982, and our extensive experience, deep knowledge, and wide-ranging capabilities in mainframe technologies makes us a valued partner and a trusted advisor to customers.

No matter where you want your mainframe data to go – the cloud, open systems, or any LUW target – tcVISION from Treehouse Software is your answer.

Just fill out the Treehouse Software Product Demonstration Request Form and a Treehouse representative will contact you to set up a time for your online tcVISION demonstration.

Don’t Jump in the Lake Without Treehouse Software! We Can Help Your Enterprise Safely Move Large Volumes of Mainframe Data to Centralized, Scalable, Cloud-Based Repositories

by Joseph Brady, Director of Business Development / Cloud Alliance Lead at Treehouse Software, Inc.

___JumpInTheLake

Many enterprises have relied on traditional data infrastructures for decades, but older data solutions can’t keep up with the volume and variety of data being collected today. This blog takes a look at building a data lake on Amazon Web Services (AWS), which allows you to store all of your data in one central repository.

What is a Data Lake?

A data lake is a centralized repository for storing structured and unstructured data at any scale. A customer can store data as-is, without having to first structure the data, and run different types of analytics—from dashboards and visualizations to big data processing, real-time analytics, and machine learning to guide better decisions.

___AWS_Data_Lake

Depending on the requirements, a typical organization will require both a data warehouse and a data lake as they serve different needs, and use cases.

A data warehouse is a database optimized to analyze relational data coming from transactional systems and line of business applications. The data structure, and schema are defined in advance to optimize for fast SQL queries, where the results are typically used for operational reporting and analysis. Data is cleaned, enriched, and transformed so it can act as the “single source of truth” that users can trust.

A data lake is different, because it stores relational data from line of business applications, and non-relational data from mobile apps, IoT devices, and social media. The structure of the data or schema is not defined when data is captured. This means you can store all of your data without careful design or the need to know what questions you might need answers for in the future. Different types of analytics on your data like SQL queries, big data analytics, full text search, real-time analytics, and machine learning can be used to uncover insights.

As organizations with data warehouses see the benefits of data lakes, they are evolving their warehouses to include data lakes, and enable diverse query capabilities, data science use-cases, and advanced capabilities for discovering new information models. Gartner names this evolution the “Data Management Solution for Analytics” or “DMSA.”

Data lakes built on Amazon S3 provide the foundation for analytics and innovation, and AWS Partner Network (APN) Partners have demonstrated success in helping enterprises evaluate and use the tools and best practices for collecting, storing, governing, and analyzing data.

Key data lake-enabling features of Amazon S3 include the following:

  • Decoupling of storage from compute and data processing – With Amazon S3, you can cost-effectively store all data types in their native formats. You can then launch as many or as few virtual servers as you need using Amazon Elastic Compute Cloud (EC2), and you can use AWS analytics tools to process your data. You can optimize your EC2 instances to provide the right ratios of CPU, memory, and bandwidth for best performance.
  • Centralized data architecture – Amazon S3 makes it easy to build a multi-tenant environment, where many users can bring their own data analytics tools to a common set of data. This improves both cost and data governance over that of traditional solutions, which require multiple copies of data to be distributed across multiple processing platforms.
  • Integration with clusterless and serverless AWS services – Use Amazon S3 with Amazon Athena, Amazon Redshift Spectrum, Amazon Rekognition, and AWS Glue to query and process data. Amazon S3 also integrates with AWS Lambda serverless computing to run code without provisioning or managing servers. With all of these capabilities, you only pay for the actual amounts of data you process or for the compute time that you consume.
  • Standardized APIs – Amazon S3 RESTful APIs are simple, easy to use, and supported by most major third-party independent software vendors (ISVs), including leading Apache Hadoop and analytics tool vendors. This allows customers to bring the tools they are most comfortable with and knowledgeable about to help them perform analytics on data in Amazon S3.

— Source: AWS


Getting to the Lake: Mainframe-to-AWS Data Replication with tcVISION…

An enterprise’s long-standing mainframe data can be residing on one, or a combination of  databases, including IBM Db2, IBM VSAM, IBM IMS/DB, Software AG Adabas, CA IDMS, CA Datacom, or even sequential files.  Treehouse Software’s tcVISION writes .csv or JSON to AWS S3, providing an optimal foundation for a data lake, because of its virtually unlimited scalability.

Here is a look at three options for data replication with tcVISION:

1. tcVISION Bulk Load of Mainframe Data – Initial load of the database where tables can be loaded as a parallel operation in one or more EC2 instances. tcVISION reads the database from the mainframe directly, and can FTP or use S3 to migrate unloads directly to the EC2 instance.

___tcVISION_AWS_Bulk_Load

2. tcVISION Enterprise Change Data Capture (CDC) Integration – A multiple platform solution for real-time, continuous data synchronization and replication based on log-based Change Data Capture technology and mainframe batch integration. It turns data exchange into a single-step operation as it includes a powerful repository for data transparency, data transformation, and apply processing logic for the targets. Transfer mainframe data to your AWS targets continuously and in real-time for Big Data, Analytics, Business Intelligence, ERP, CRM, or for application modernization or mainframe offload initiatives or mainframe migration.

___tcVISION_AWS_CDC

3. tcVISION Bi-directional Data ReplicationtcVISION allows bi-directional, real-time data synchronization of changes on either platform to be reflected on the other platform (e.g., a change to a PostgreSQL table is reflected back on mainframe). The customer can then modernize their application on the cloud, open systems, etc. without disrupting the existing critical work on the legacy system.

___tcVISION_AWS_BiDirect

The tcVISION solution focuses on CDC when transferring information between mainframe data sources and Cloud databases and applications. Through an innovative technology, changes occurring in any mainframe application data are tracked and captured, and then published to a variety of Cloud targets.


Further reading: tcVISION Mainframe-to-AWS data replication is featured on the AWS Partner Network Blog…

___tcVISION_AWS_HA_Architecture

Treehouse Software is an AWS Technology Partner, and AWS published a blog about tcVISION’s Mainframe-to-AWS data replication capabilities, including a technical overview, security, high availability, scalability, and a step-by-step example of the creation of tcVISION metadata and scripts for replicating mainframe Db2 z/OS data to Amazon Aurora.

Read the blog here: AWS Partner Network (APN) Blog: Real-Time Mainframe Data Replication to AWS with tcVISION from Treehouse Software.


__tsi_logo_400x200

Contact Treehouse Software Today…

Treehouse Software has been helping mainframe enterprises since 1982, and our extensive experience, deep knowledge, and wide-ranging capabilities in mainframe technologies makes us a valued partner and a trusted advisor to customers.

No matter where you want your mainframe data to go – the cloud, open systems, or any LUW target – tcVISION from Treehouse Software is your answer.

Just fill out the Treehouse Software Product Demonstration Request Form and a Treehouse representative will contact you to set up a time for your online tcVISION demonstration.

Enterprise Mainframe Customers are Realizing the Benefits of Replicating Data to Cloud-based Relational Databases

by Joseph Brady, Director of Business Development / AWS and Cloud Alliance Lead at Treehouse Software, Inc.

Treehouse Software has been helping enterprises mainframe customers since 1982, and in recent years, we have been developing a strong presence in the emerging Cloud market space relating to mainframe data migration. This blog takes a quick look at a couple of popular Treehouse-supported Cloud relational database systems…

Amazon Aurora relational database, a MySQL and PostgreSQL-compatible relational database built for the cloud, that combines the performance and availability of traditional enterprise databases with the simplicity and cost-effectiveness of open source databases:

Google Cloud SQL, a fully managed relational database service for MySQL, PostgreSQL, and SQL server. You can connect with nearly any application, anywhere in the world. Cloud SQL automates backups, replication, and failover to ensure your database is reliable, highly available, and flexible to your performance needs:

Treehouse Software Helps to Make the Mainframe Data Move Easy…

Many enterprises’ mainframe systems house vast amounts of data  encompassing historical, customer, inventory, logistics, and a myriad of other information types. Sales leaders at Cloud platform companies and systems integrators are engaging with Treehouse Software to take advantage of our unique skills and tcVISION Mainframe-to-Cloud data replication solution to help them tap into this potential goldmine of data that needs to be made available to new technologies.

tcVISION_Overall_Diagram_General_Cloud

With tcVISION, customers can replicate mission critical data to the Cloud, and immediately take advantage of the broadest and deepest set of capabilities, including artificial intelligence (AI), machine learning, Internet of things (IoT), predictive data analytics, high performance and security, high availability across global regions, scalability, and innovation. Imagine having the most advanced technologies available for data processing, interactive analytics, real-time analytics, operational analytics, dashboards, and data warehousing at your fingertips!

Where is your mission critical data residing?

tcVISION provides the means for customers to easily replicate relevant data from most mainframe data sources (IBM Db2, IBM VSAM, IBM IMS/DB, Software AG Adabas, CA IDMS, CA Datacom, or even sequential files) to Cloud targets, including AWS, Google Cloud, Microsoft Azure, and Oracle Cloud

Walkthrough of tcVISION Mainframe Data Replication to Cloud and Open Systems in 90 Seconds…


Further reading: tcVISION Mainframe-to-AWS data replication is featured on the AWS Partner Network Blog…

___tcVISION_AWS_HA_Architecture

AWS recently published a blog about tcVISION’s Mainframe-to-Cloud data replication capabilities:

AWS Partner Network (APN) Blog: Real-Time Mainframe Data Replication to AWS with tcVISION from Treehouse Software.


__tsi_logo_400x200

Contact Treehouse Software Today…

No matter where you want your mainframe data to go – the Cloud, Open Systems, or any LUW target – tcVISION from Treehouse Software is your answer.

Just fill out the Treehouse Software Product Demonstration Request Form and a Treehouse representative will contact you to set up a time for your online tcVISION demonstration.

The New 2020 IBM Z Solutions Directory Features a Wide Selection of Mainframe Tools and Services, Including Treehouse Software’s Data Integration Products

by Joseph Brady, Director of Business Development / Cloud Alliance Lead at Treehouse Software, Inc. 

2020_IBM_Systems_Solutions_Directory

Enterprises’ investments in IBM Z mainframe technology is significant, and the IBM Z Solutions Directory showcases some of the best hardware, accessories, software products, and services available to help customers maintain and expand the platform.

Treehouse Software encourages mainframe customers to explore the IBM Z Solutions Directory, where they will find neatly organized listings that help them quickly find the products and services they need. We are very pleased to have our products included, side-by-side, with most of the top mainframe solutions in the world in this valuable guide. 


__TSI_LOGO

More About Treehouse Software’s Mature and Proven Mainframe Enterprise Transformation Products…

Treehouse_Products_Diagram_General_Cloud.jpg

Treehouse Software has been developing, marketing, selling, and supporting mainframe software since 1982, and we are committed to helping customers easily access some of the most advanced Cloud and open systems technologies in the world, while maintaining their valuable legacy environments. 

Treehouse Software’s visionary leadership in the mainframe market has included pioneering Adabas-to-RDBMS ETL and CDC with tRelational/DPS in the mid-1990s.  Today, with the tcVISION product, Treehouse Software is a global leader in providing real-time and bi-directional data replication between a variety of mainframe and non-mainframe sources, including (Mainframe): VSAM, IMS, Db2, CA Datacom, Adabas, and CA IDMS; and (Non-mainframe): Amazon Web Services (AWS), Microsoft Azure, Google Cloud, Oracle Cloud, PostgreSQL, Microsoft SQL Server, IBM Db2 LUW and Db2 BLU, IBM Informix, Kafka, MongoDB, MariaDB, Hadoop, SAP Hana, and many more.

Despite the rapid pace of change in the IT landscape, Treehouse Software’s customer base can be assured that there remains a strong commitment to providing continued support and upgrades for the product suite.

Contact Treehouse Software for a Product Demo Today…

Just fill out the Treehouse Software Product Demonstration Request Form and a Treehouse representative will contact you to set up a time for your online product demonstration.