Cloud Infrastructure Monitoring: Finding Issues and Solving Problems With Amazon CloudWatch

by Joseph Brady, Director of Business Development for Treehouse Software

At Treehouse Software, we specialize in helping customers’ legacy mainframe environment continue while replicating their data – in real time and bi-directionally – to an impressive variety of newer Cloud, LUW, and Open Systems databases. However, once “in the Cloud”, customers need the same visibility and understanding of what is happening with their data as they have in their on-premises data centers.

Unlike a traditional data center, with the AWS infrastructure environment, customers pay only for what they use, and the company is charged only for resource utilization.  Users can bring up EC2 virtual Windows or Linux instances for any length of time. For example, if the mainframe database bulk loads only take an hour to complete, the tcVISION EC2 instances can be brought up for the two hours needed, and shut down when the processing is finished.  AWS EC2 instances can be dynamically stopped and restarted while retaining its data on AWS Elastic Block Storage. This way, the business pays only for what is needed and the instance sizes (CPU, memory, and I/O bandwidth) can be optimized for the required mainframe data migration, or data replication process.

AWS resources, such as EC2 instances, storage, and databases can be rapidly provisioned and de-provisioned.  The allows customers to approach the architecture with an agile mind set.

Cloud Infrastructure Monitoring Made Easy…

This blog gives a high-level overview at Amazon CloudWatch, a Cloud infrastructure monitoring service that gives developers, system operators, site reliability engineers (SRE), and IT managers actionable insights to monitor applications, understand and respond to system-wide performance changes, optimize resource utilization, and obtain a unified view of operational health.

___Amazon_CloudWatch_Dashboard

CloudWatch collects monitoring and operational data in the form of logs, metrics, and events, providing you with a unified view of AWS resources, applications and services that run on AWS, and on-premises servers. You can use CloudWatch to set high resolution alarms, visualize logs and metrics side by side, take automated actions, troubleshoot issues, and discover insights to optimize your applications, and ensure they are running smoothly.

Some customers are satisfied with a basic monitoring that polls every five minutes, while others need more detailed monitoring and can choose polls that occur every minute.

Observing, Reporting, Alerting, and Acting

Amazon CloudWatch allows customers to record metrics for EC2 and other Amazon Cloud Services (e.g., EBS (Elastic Block Storage), S3 (Simple Service Storage), etc.) and display them in a graph on a monitoring dashboard. This provides visual notifications of what is going on, such as CPU per server, query time, number of transactions, and network usage.

Given the dynamic nature of AWS resources, proactive measures including the dynamic re-sizing of infrastructure resources can be automatically initiated. Amazon CloudWatch alarms can be sent to the customer, such as a warning that CPU usage is too high, and as a result, an auto scale trigger can be set up to launch another EC2 instance to address the load. Additionally, customers can set alarms to recover, reboot, or shut down EC2 instances if something out of the ordinary happens.

A shift from looking for failures, to finding answers…


__TSI_LOGO

Is your mission critical mainframe data residing on IBM Db2, IBM VSAM, IBM IMS/DB, Software AG Adabas, CA IDMS, CA Datacom, or even sequential files? Do you want to move that data to the Cloud?

Read More About tcVISION on the AWS Partner Network Blog…

Read More: AWS Partner Network (APN) Blog, “Real-Time Mainframe Data Replication to AWS with tcVISION from Treehouse Software”

Contact Treehouse Software for a Demo Today…

Just fill out the Treehouse Software Product Demonstration Request Form and a Treehouse representative will contact you to set up a time for your online tcVISION demonstration.

STAY AND GO… AT THE SAME TIME! Incrementally Replicate Your Mainframe Data to the Cloud and Other Modern Systems While Keeping Both Sides Synchronized

Is your mission critical mainframe data residing on IBM Db2, IBM VSAM, IBM IMS/DB, Software AG Adabas, CA IDMS, CA Datacom, or even sequential files? Are you looking for a solution that allows your legacy mainframe environment to continue while replicating data – in real time and bi-directionally – on a variety of newer Cloud, LUW, or Open Systems databases? Whether your enterprise wants to take advantage of the latest cloud services, such as analytics, artificial intelligence (AI), etc., or move your data to a variety of newer Cloud, LUW, or Open Systems databases, the transition doesn’t have to be a sudden big bang.

tcVISION_Overall_Diagram

tcVISION: Enterprise ETL and Real-time and Bi-directional Data Replication Through Change Data Capture

The globalization of markets, the increase of data volumes, 24×7 operations, changing business conditions and high demand for up-to-date information require new data transfer and exchange solutions for heterogeneous IT architectures.

The tcVISION solution focuses on changed data capture (CDC) when transferring information between mainframe data sources and modern databases and applications. Through an innovative technology, changes occurring in any mainframe application data are tracked and captured, and then published to a variety of targets.

tcVISION allows bi-directional, real-time data synchronization of changes on either platform to be reflected on the other platform (e.g., a change to a PostgreSQL table is reflected back on mainframe). The customer can then modernize their application on the cloud, open systems, etc. without disrupting the existing critical work on the legacy system.

tcVISION – Supported Sources and Targets

tcVISION supports a vast array of integration scenarios throughout the enterprise, providing easy and fast data migration for mainframe application modernization projects and enabling bi-directional data replication between mainframe, Cloud, Linux, Unix, and Windows platforms. This innovative technology offers comprehensive abilities to identify and capture changes occurring in mainframe and relational databases, then publish the required information to an impressive variety of targets, both on-premise and Cloud-based.

View the Unequalled List of Environments Supported by tcVISION Here


__TSI_LOGO

Contact Treehouse Software for a Demo Today…

Just fill out the Treehouse Software Product Demonstration Request Form and a Treehouse representative will contact you to set up a time for your tcVISION demonstration. This will be a live, on-line demonstration that shows tcVISION replicating data from the mainframe to a Cloud target database.

Treehouse Software’s tcVISION on the AWS Marketplace… AWS Architectural Considerations and Challenges

Andy Jones, Senior Technical Representative for Treehouse Software recently gave a presentation at the Pittsburgh AWS User Group Meetup that explores our experiences in bringing the tcVISION Mainframe-to-AWS Data Replication Solution to the AWS Marketplace.  Andy discussed issues that had to be addressed, such as High Availability and AWS Availability Zones, Autoscaling, Security, creating the tcVISON AMIs, etc. Here is his presentation:

Additionally, Treehouse Software’s tcVISION is Featured on the AWS Partner Network Blog. Read the Blog Here.


__tsi_logo_400x200

Treehouse Software is an AWS Technology Partner and a global leader in providing real-time and bi-directional data replication between a variety of mainframe and non-mainframe sources, including (Mainframe – z/OS and VSE): VSAM, IMS, Db2 z/OS, Adabas, CA Datacom, and CA IDMS; and (Non-mainframe): AWS, Microsoft Azure, PostgreSQL, Oracle, Microsoft SQL Server, IBM Db2 LUW and Db2 BLU, IBM Informix, Kafka, MongoDB, Hadoop, SAP Hana, and more.

Contact us today to discuss your project!

Treehouse Software’s Mainframe-to-AWS Data Replication Solution is Featured on the AWS Partner Network Blog

“We are very excited about the APN blog showcasing tcVISION’s Mainframe-to-AWS capabilities to such a substantial and relevant audience. The AWS partner and customer base not only has access to our solution via the tcVISION AMI in the AWS Marketplace, they can now use the tcVISION blog as a valuable educational and marketing tool!”

– Joseph Brady, Director of Business Development and AWS Alliance Lead at Treehouse Software

READ THE BLOG HERE


__TSI_LOGO

Since 1982, Treehouse Software has been serving enterprises worldwide with industry-leading software products and outstanding technical support. Today, Treehouse Software is a global leader in providing data migration, replication, and integration solutions for the most complex and demanding heterogeneous environments, as well as feature-rich, accelerated-ROI offerings for information delivery, business intelligence and analytics, and application modernization.

U.S. Government Customers Can Now Use Treehouse Software’s tcVISION Mainframe Data Replication on the AWS GovCloud

Treehouse Software’s tcVISION Mainframe-to-AWS data replication product is now available in the AWS GovCloud (US) Region of the AWS Marketplace.

The AWS GovCloud (US) Region is designed to host sensitive data, regulated workloads, and address the most stringent U.S. government security and compliance requirements.

The AWS GovCloud (US) is available to government customers, organizations in government-regulated industries, and other private entities that meet AWS GovCloud (US) requirements.

AWS GovCloud (US) gives government customers and their partners the flexibility to architect secure cloud solutions that comply with: the FedRAMP High baseline, the DOJ’s Criminal Justice Information Systems (CJIS) Security Policy, U.S. International Traffic in Arms Regulations (ITAR), Export Administration Regulations (EAR), Department of Defense (DoD) Cloud Computing Security Requirements Guide (SRG) for Impact Levels 2, 4 and 5, FIPS 140-2, IRS-1075, and other compliance regimes.

From Personally Identifiable Information (PII), sensitive patient medical records, and financial data to law enforcement data, export controlled data and other forms of CUI, AWS GovCloud (US) Regions can help customers address compliance at every stage of their cloud journey.


_0_AWS_Marketplace_Logo01

The tcVISION Amazon Machine Images (AMIs) are available on the AWS Marketplace. A tcVISION AMI automatically sets up the product on the AWS Cloud and allows customers to use it with either backup/recovery mainframe files or Windows files, or to set up connectivity for real-time, on-premises mainframe data replication to AWS. An enterprise with mission critical data in a mainframe environment can rapidly deploy databases globally within minutes, and with minimal administration requirements. U.S Government sites can simply choose the region “AWS GovCloud (US)” under “Pricing Information” when choosing and AMI.

_0_tcV_To_AWS_Cloud

There are three versions of the tcVISION AMI on the AWS Marketplace, and #1 and #3 require two-week trial license keys provide by Treehouse Software:

1. tcVISION Mainframe Batch Integration (MBI) for AWS – Bring Your Own License (Customers must contact Treehouse Software for license key to run the software): This AMI does not require an active connection to the mainframe, because the existing backup and recovery files from the mainframe, such as Db2 imagecopies, z/OS archive log files or IMS Unloads, Adabas unload, and PLOG files can be used.

2. tcVISION Distributed Database Integration (DDI) for AWS – Pay as You Go on AWS: This AMI license installation includes security keys for Amazon S3 access and a license to use one source (PostgreSQL, Oracle, MySQL, MariaDB; MSSQL on Windows OS only) and one target (AWS S3, AWS Aurora, RDS – PostgreSQL, Oracle, MySQL, MariaDB; MSSQL on Windows OS only).

3. tcVISION Enterprise Change Data Capture (CDC) Integration for AWS – Bring Your Own License (Customers must contact Treehouse Software for license key to run the software): This AMI allows transfer of mainframe data to AWS targets continuously and in real-time. Using this tcVISION AMI, a customer can deploy databases globally within minutes.


About the AWS Marketplace…

_0_AWS_Marketplace_Logo01

The AWS Marketplace is an online software store that helps customers find, buy, and immediately start using the software and services that run on AWS.


__TSI_LOGO

Visit the Treehouse Software website for more information on tcVISION, or contact us to discuss your needs.

Join Us: Treehouse Software is Sponsoring the Pittsburgh Amazon Web Services (AWS) User Group April Meetup at Bakery Square

AWS_Meetup

Treehouse Software’s, “AWS Architectural Considerations and Challenges When Bringing a Product to the AWS Marketplace” will be presented by Andy Jones, Senior Technical Representative and AWS Certified Solutions Architect for Treehouse Software.

Treehouse Software will also be providing food and drinks for the Meetup.

Date/Time: Tuesday, April 9, 2019 • 7:00 PM to 9:00 PM

Place: Bakery Square – UPMC Enterprises • 6425 Penn Ave. #200 · Pittsburgh, PA

Agenda:

  • 07:00 – 07:15 => Grab food, beverage, and a seat
  • 07:15 – 07:20 => Introductions from Nathan Menge (AWS Pittsburgh User Group Organizer)
  • 07:20 – 08:30 => Topic: “AWS Architectural Considerations and Challenges When Bringing a Product to the AWS Marketplace” – Presentation by Andy Jones, Senior Technical Representative and AWS Certified Solutions Architect for Treehouse Software
  • 08:30 – 09:00 => Q&A with Speaker

Register to attend here:

April meetup

Tuesday, Apr 9, 2019, 7:00 PM

UPMC Enterprises
6425 Penn Ave #200 Pittsburgh, PA

9 Members Attending

Basic agenda 07:00 – 07:15 => Grab food, beverage, and a seat 07:15 – 07:20 => Introductions from Nate 07:20 – 08:30 => Topic: “AWS Architectural Considerations and Challenges When Bringing a Product to the AWS Marketplace” – Presentation by Andy Jones, Senior Technical Representative and AWS Certified Solutions Architect for Treehouse Software 08:…

Check out this Meetup →

Mainframe Modernization: Extracting Business Value While Maintaining Critical Legacy Data

_0_Treehouse_tcV_Cloud_OpenSystems

Whether your enterprise wants to take advantage of the latest cloud services, such as analytics, artificial intelligence (AI), etc., or move your data to a variety of newer LUW or Open Systems databases, the transition doesn’t have to be a sudden big bang.

Application Rehost / Modernization Challenges

Much of an enterprise’s mission critical mainframe data is stored in legacy mainframe databases, and the cost to maintain these databases is high.  An added complication is that the data is utilized by many interlinked and dependent programs that have been in place for many years, and sometimes, decades. Unlocking the value of this legacy data is difficult due to many very different types of mainframe databases (e.g., Db2, Adabas, CA Datacom, CA IDMS, etc.).

Many customers are looking for a solution that allows their legacy environment to continue while replicating data in real time on a modern database/platform. This enables them to utilize modern programing and data tools in order to remain competitive in their markets.

One Step At A Time…

Treehouse Software has extensive experience in helping organizations incrementally replicate their mainframe data to the cloud and other modern systems, while keeping both sides synchronized.

Treehouse Software’s expert technical representatives help customers developed a phased plan that includes installation and implementation of the tcVISION mainframe data replication product. The plan then defines various parts of the solution, including:

  • configuration management
  • environments and promotion
  • high availability
  • security
  • disaster recovery
  • monitoring
  • operations procedures
  • script customization
  • data replication mapping
  • training

After defining the architecture, the production deployment phase begins with incremental sprint-like deployments. Additional files are then deployed into production every few weeks.

This phased plan enables the tcVISION product to synchronize mission critical mainframe data to any modern database. Bi-directional, real-time data synchronization allows changes on either platform to be reflected on the other platform (e.g., a change to a PostgreSQL table is reflected back on mainframe). The customer can then modernize their application on the cloud, open systems, etc. without disrupting the existing critical work on the legacy system.

Additionally, tcVISION customers see drastically reduced mainframe MIPS costs, and increased ability to quickly respond to business environment changes.


Find out more about tcVISION — Enterprise ETL and Real-Time Data Replication Through Change Data Capture (CDC)

tcVISION supports a vast array of integration scenarios throughout the enterprise, providing easy and fast data migration for mainframe application modernization projects and enabling bi-directional data replication between mainframe, Cloud, Open Systems, Linux, Unix, and Windows platforms. This innovative technology offers comprehensive abilities to identify and capture changes occurring in mainframe and relational databases, then publish the required information to an impressive variety of targets, both on-premise and Cloud-based.

tcVISION_Overall_Diagram

tcVISION acquires data in bulk or via change data capture methods, providing real-time and bi-directional data replication between a variety of mainframe and non-mainframe sources, including (Mainframe – z/OS and VSE): VSAM, IMS, Db2 z/OS, Adabas, CA Datacom, and CA IDMS; and (Non-mainframe): AWS, PostgreSQL, Oracle, Microsoft SQL Server, IBM Db2 LUW and Db2 BLU, IBM Informix, Kafka, MongoDB, Hadoop, SAP Hana, and more.


__TSI_LOGO

Visit the Treehouse Software website for more information on tcVISION, or contact us to discuss your needs.

You can also set up a live, online demonstration of tcVISION, where we will show data replication from a mainframe database to an AWS, LUW, or Open Systems target database. Schedule your demo today!