PRODUCT SPOTLIGHT: tcVISION v6 Overview and Updates

tcVISONv6

Several exciting new features and updates are now in tcVISION v6, including new output targets Adabas LUW, DB2 BLU, EXASOL, Hadoop,and MongoDB. Additionally, new input sources include z/OS VSAM Logstream (CICS and Coupling Facility / Shared VSAM),z/OS VSAM Batch Extension, z/OS DBMS to Logstream, CA IDMS v17, CA Datacom CDC, IMS Active Log and SMF data.

Another feature recently announced is the tcVISION “Direct Loader” for BULK_LOAD processing. The function does not require output to a sequential file, and the loader utility for the target DBMS is called via API with data passed directly. Direct loader supports PostGreSQL, Microsoft SQL Server and DB2 LUW / DB2 BLU. The advantage of using the Direct Loader is the elimination of disk access in writing and reading the sequential loader data file. File output is still supported (e.g., where loader data is to be distributed to other machines).

Finally, as mentioned in a previous Treehouse Blog, with tcVISION v6 comes the newly enhanced web statistics functionality and web server. Any standard web browser can access this server (Internet Explorer, Firefox, Opera, Chrome, Safari, etc.)

This valuable feature enables users to view data from the tcVISION Manager Monitor, and statistical and operational information from the tcVISION Manager network.


Find out more about tcVISION — Enterprise ETL and Real-Time Data Replication Through Change Data Capture

tcVISION provides easy and fast data migration for mainframe application modernization projects and enables bi-directional data replication between mainframe, Linux, Unix and Windows platforms.

_0_tcVISION_Simple_Diagram

Visit the Treehouse Software website for more information on tcVISION, or contact us to discuss your needs.

Customer Success: tcVISION / Hadoop Integration

_tcVISION_Customer_Hadoop_Header

BAWAG P.S.K. is one of the largest and most profitable banks of Austria with more than 1.6 million private and business customers and a well known brand in the country. The business strategy is oriented towards low risk and high efficiency. Business segments are Retail Banking and Small Business, Corporate Lending and Investments and Treasury Services and Markets. The center of the BAWAG P.S.K. business strategy is the offering of easy to understand, transparent and first-rate products and services which meet the requirements of the customers.

The BAWAG P.S.K. Bank für Arbeit und Wirtschaft and Österreichische Postsparkasse Aktiengesellschaft ” (P.S.K.), Vienna, operates their IT on the z/OS operating system. The corporate data is stored in DB2 databases. ORACLE is the database platform for the Open System environments. In relationship with another project P.S.K already had a client component of tcVISION installed. Magister Markus Lechner, Head IT Applications: “tcVISION was already in use and we had good experiences as far as functionally and support is concerned. Because we were in the planning process for the implementation of another project, we included tcVISION in the list of software solutions. The goal of this project has been the reduction of the load on the IBM mainframe and as a result the reduction of costs. The intention was to offload data from our core database system to a less expensive system in real-time and to provide read access from that system to the new infrastructure. The reasons for this were constantly increasing CPU costs on the mainframe because of the growing transaction load of the Online Banking, Mobile Banking, and Self Service devices. A large percentage of the load was caused by Read-Only-Transactions.” Markus Lechner: “After the tcVISION presentation, we arranged a Proof Of Concept. The important aspects of the POC were not only the functionality of tcVISION within the project but we also wanted to see whether our expectations would be met related to performance and CPU consumption on the mainframe. In addition to tcVISION, we also evaluated another product. All of our expectations have been met to our full satisfaction during the POC and we made the decision to go ahead with tcVISION.”

After a short implementation period, the project is now in production for one year. Markus Lechner describes the project: “The primary objective of the project with tcVISION was the reduction of CPU load on the mainframe to reduce our costs. Our intention was to offload data from our core database system to a less expensive system in real-time and to provide read access from that system to the new infrastructure.

tcVISION_Hadoop

We use tcVISION for the realtime replication and we use Apache Hadoop as a cost efficient system for the storage of the data. In addition to the primary usage scenario we have the benefit to also cover additional use cases. This includes Real-time-EventHandling & Stream Processing, Analytics based upon real-time data as well as the possibility to report and analyze structured and unstructured data with excellent performance. The system can be inexpensively operated on Commodity Hardware and has no scalability limitations. Compared to the savings the costs of replication (CPU consumption) of tcVISION are very low. The support provided  was excellent during the implementation phase and also during the production phase. Inquiries by telephone or E-mail cause prompt reactions. Problems that came up during this period were solved as soon as possible even when the tcVISION software had to be extended.” There are additional plans to extend the use of tcVISION in the future. One is to implement real-time replication from ORACLE into the data lake.

Magister Markus Lechner draws a conclusion: “tcVISION enables us to significantly reduce our mainframe cost through a real-time replication to a less expensive environment. tcVISION performs a very economical log file based replication. In addition we are now in a position to implement numerous application cases based upon the replicated data which would have been too expensive and resource intensive on the mainframe. Realtime-Event-handling, Realtime-Analytics, Realtime-Fraud Prevention are only a few of the use cases that we currently cover.”


tcVISION

_0_tcVISION_Simple_Diagram

tcVISION enables bidirectional replication for DB2, Oracle, and SQL Server running on Linux/Unix/Windows, and synchronizes each data source, first by doing a bulk load from source(s) to target and then by replicating only changes— only committed changes—from source(s) to target. So there can never be ambiguity as to whether a query against the target database involves uncommitted data.

Read other tcVISON customer success stories here.


__TSI_LOGO

Visit the Treehouse Software website for more information on tcVISION, or contact us to discuss your needs.

Mainframe CDC from Treehouse Software

The globalization of markets, increase of data volumes, and high demand for up-to-date information require new data transfer and exchange solutions for heterogeneous IT architectures, and as many customers have discovered, Treehouse Software has the right product (or combination of products) to meet any conceivable mainframe data migration, replication, or integration requirement. To meet many of these needs, Treehouse Software’s proven and mature tcVISION product moves data – as little as possible – as much as necessary. tcVISION is an innovative software solution that processes changed data in real time, in intervals, or event based.

ChangeDataCapture

The tcVISION solution focuses on changed data capture (CDC) when transferring information between mainframe data sources and LUW databases and applications. Changes occurring in any mainframe application data are tracked and captured, and then published to a variety of RDBMS and other targets.

_0_tcVISION_Simple_Diagram

tcVISION enables bidirectional replication for DB2, Oracle, and SQL Server running on Linux/Unix/Windows, and synchronizes each data source, first by doing a bulk load from source(s) to target and then by replicating only changes— only committed changes—from source(s) to target. So there can never be ambiguity as to whether a query against the target database involves uncommitted data.

Read some tcVISON customer success stories here.


Visit the Treehouse Software website for more information on tcVISION, or contact us to discuss your needs.

 

TREETIP: tcVISION’s Enhanced Web Statistics Functionality

by Joseph Brady, Manager of Marketing and Technical Documentation at Treehouse Software, Inc.

tcVISIONv6_Logo

With version 6 of tcVISION (Treehouse Software’s product for transferring information between mainframe data sources and LUW databases and applications), a newly enhanced web statistics functionality and web server have been introduced. Any standard web browser can access this server (Internet Explorer, Firefox, Opera, Chrome, Safari, etc.).

This valuable feature enables users to oversee data from the tcVISION Manager Monitor, and statistical and operational information from the tcVISION Manager network. The Manager Monitor displays diagrams in a large, scalable window that shows “running” transfers and “not running” processes, and a diagram that shows statistical data.

The following screen shot shows how the tcVISION web statistics can be displayed to the user…

tcVISION_Web_Stats001

An easy-to-use menu allows complete control of, and access to, all processes within the tcVISION Manager Monitor…

_0_tcVISION_Webstats002

  • “Scripts” shows running processes, completed processes, and not running processes.
  • “Server messages” shows the server messages.
  • “Manager network” shows all Managers of connected Manager Networks.
  • “Statistics” shows a selection of Managers and corresponding scripts from the monitoring database. A selection list with different diagram types is available and a button to save chosen diagrams and their selected settings.
  • “Profiles” shows the profiles of the monitoring database.
  • “Manager” shows the name, the version, the revision and the operating system of the observing Managers.

Find out more about tcVISION — Enterprise ETL and Real-Time Data Replication Through Change Data Capture

tcVISION provides easy and fast data migration for mainframe application modernization projects and enables bi-directional data replication between mainframe, Linux, Unix and Windows platforms.

_0_tcVISION_Simple_Diagram

Visit the Treehouse Software website for more information on tcVISION, or contact us to discuss your needs.

TREETIP: Did You Know About tRelational’s Schema Auto-Generation Feature?

by Joseph Brady, Manager of Marketing and Technical Documentation at Treehouse Software, Inc.

tRelational, the data analysis, modeling, and mapping component of Treehouse Software’s Adabas-to-RDBMS product set provides three options for developing RDBMS data models and mapping ADABAS fields to RDBMS columns:

Option 1: Auto-generation

Option 2: Importation of existing RDBMS schema elements

Option 3: Detailed definition and manipulation of schema and mapping elements using tRelational

The Auto-generation function can be an extremely useful productivity aid. By simply invoking this function and specifying an Adabas file structure, a fully-functional corresponding RDBMS schema (Tables, Columns, Primary Keys, Foreign Key relationships and constraints) and appropriate mappings are created virtually instantaneously. The table and column names, datatypes, lengths, and mappings/transformations are all automatically tailored specifically for the RDBMS product, platform, and version–the user need not be an expert in the RDBMS.

tRelational’s schema auto-generation simply requires specification of an Adabas file structure and associated options…

tRe_AutoGen

The auto-generated model can be immediately used to generate both RDBMS DDL and parameters for the Data Propagation System (DPS) component. Within minutes of identifying the desired Adabas file or files to tRelational, the physical RDBMS schema can be implemented on the target platform and DPS can begin materializing and propagating data to load into the tables.

It is important to note that these modeling options complement each other and can be used in combination to meet any requirements. Auto-generated schema elements can be completely customized “after the fact”, as can imported elements. Auto-generation can be used at the file level to generate complete tables and table contents at the field level, making it easy to then manually define and map one or more columns within a table, or even to denormalize MU/PE structures into a set of discrete columns.


About Treehouse Software’s tRelational / DPS Product Set

tReDPSMainDiagram01

tRelational / DPS is a robust product set that provides modeling and data transfer of legacy Adabas data into modern RDBMS-based platforms for Internet/Intranet/Business Intelligence applications. Treehouse Software designed these products to meet the demands of large, complex environments requiring product maturity, productivity, feature-richness, efficiency and high performance.

The tRelational component provides complete analysis, modeling and mapping of Adabas files and data elements to the target RDBMS tables and columns. DPS (Data Propagation System) performs Extract, Transformation, and Load (ETL) functions for the initial bulk RDBMS load and incremental Change Data Capture (CDC) batch processing to synchronize Adabas updates with the target RDBMS.

Visit the Treehouse Software website for more information on tRelational / DPS, or contact us to discuss your needs.

Treehouse Software Products and Professional Services for Adabas / Natural Help with ALLETE’s Mainframe Retirement

by Mike Kuechenberg, Senior Technical Representative at Treehouse Software, Inc. __Allete

Since 2010, Treehouse Software consultants have provided product training and Professional Services for the planned retirement of the mainframe environment at ALLETE.

Here’s a look at three parts of the project in which Treehouse was involved:

tRelational / DPS

In order to replicate Adabas data to Oracle, ALLETE licensed Treehouse’s tRelational / DPS product set. After some initial training by Treehouse Professional Services, ALLETE staff were able to model and map Adabas files to Oracle schemata using tRelational, and to deploy DPS jobs to materialize (ETL) and propagate (CDC) the Adabas data into Oracle. This continued until the final cutover to the new systems. Just before the mainframe was decommissioned, some additional Adabas files were materialized by Treehouse Professional Services for archival purposes.

DBA Consulting

Treehouse Professional Services took over the DBA responsibilities for ALLETE starting in September 2010. The responsibilities included Software AG product upgrades, daily checks on available database space and file extents, and requests from ALLETE staff like file restores, field maintenance, and any other request requiring DBA involvement.

Systems Support

Additionally, Treehouse Professional Services assumed responsibility for ALLETE’s mainframe systems programming activities. Tasks included monthly IPLs to the system, applying licenses to products, handling system error situations, defining new DASD, upgrading IBM and third-party products, providing periodic SOX reports, and handling other requests from ALLETE staff.

Conclusion of a Successful Engagement

As this five-year Treehouse Software / ALLETE partnership ends, we wish our friends all the best as they move forward with their new systems and strategies.

“During the time our companies have been working together, Treehouse personnel were always responsive and are experts in their fields. Thanks for the flexibility and great support over the years.”

Eric Peterson, Manager, IT Infrastructure, ITS Systems, ALLETE Inc.


About Treehouse Software Professional Services _0_Consulting_Services002

Treehouse Professional Services offer a proven, cost-effective alternative to full-time in-house systems programmers, system administrators and DBAs. Using our team of experts and monitoring techniques, Treehouse offers world-class, on-site and remote system support and DBA service at affordable prices. Treehouse Professional Services offer various levels of system monitoring and administration. Our team will monitor critical factors within your Software AG environment, apply preventive maintenance for your systems and databases, and keep your software up-to-date. We even provide z/OS systems programming services! We are strongly committed to our customers’ success and we deliver the highest quality DBA and support solutions.

Visit the Treehouse Software website for more information on Treehouse Professional Services, or contact us to discuss your needs.


About Treehouse Software’s tRelational / DPS Product Set tReDPSMainDiagram01

tRelational / DPS is a robust product set that provides modeling and data transfer of legacy ADABAS data into modern RDBMS-based platforms for Internet/Intranet/Business Intelligence applications. Treehouse Software designed these products to meet the demands of large, complex environments requiring product maturity, productivity, feature-richness, efficiency and high performance.

The tRelational component provides complete analysis, modeling and mapping of ADABAS files and data elements to the target RDBMS tables and columns. DPS (Data Propagation System) performs Extract, Transformation, and Load (ETL) functions for the initial bulk RDBMS load and incremental Change Data Capture (CDC) batch processing to synchronize ADABAS updates with the target RDBMS.

Visit the Treehouse Software website for more information on tRelational / DPS, or contact us to discuss your needs.

Request a Free, Online Demo of Treehouse Software’s Mainframe Real-Time and Bidirectional Data Replication / Integration Products

Did you know that Treehouse Software offers online demonstrations of the most complete and flexible portfolio of solutions available anywhere for real-time, bidirectional data replication and integration between mainframe and LUW data sources?

You can see how Treehouse Software’s popular tcACCESS and tcVISION products efficiently and cost-effectively use ETL, CDC, SQL, XML, and SOA technologies for data replication / integration, in an interactive demonstration with our skilled technical experts.

Integrate mainframe data and applications with LUW data sources…

tcACCESS is a comprehensive software solution that enables two-way integration between IBM mainframe systems and client/server, Web and SOA technologies — without the need for mainframe knowledge or programming effort. A proven platform that facilitates SQL-based integration of mainframe data sources and programs into LUW applications, tcACCESS uses industry standards such as SQL, ODBC, JDBC, and .NET. SQL queries to access mainframe data can be easily created using drag and drop techniques — no programming required.

tcACCESS_Diagram01

tcACCESS is a modular software solution. It consists of a base system that can either be implemented as a CICS transaction or as a VTAM application. The base system provides its own communication modules. The heart of the system is the tcACCESS SQL Engine which allows access to mainframe data sources using SQL statements. tcACCESS offers Listener components on the mainframe and on the client, as well as scheduling and security functions. Batch processors automate the information exchange processes between distributed applications.

Enable ETL and bi-directional data replication between mainframe and LUW platforms…

tcVISION allows the exchange of data between heterogeneous databases, from legacy non-relational mainframe sources to standard RDBMSs, in batch or real-time, via CDC (change data capture). With tcVISION, complex replication scenarios can be implemented with ease–including bi-directional “master/master” replication requirements.

tcVISION_simple

tcVISION considerably simplifies mainframe data exchange processes. The structure of the existing mainframe data is analyzed by tcVISION processors, then automatically and natively mapped to the target. The data mapping information is presented in a user-friendly and transparent format – even for users with no mainframe knowledge.

See for yourself, right at your desk…

DemoRequest

Tell us about your challenges. If you have a project where our mainframe data replication and integration products could be of assistance, our skilled sales and technical staff would be happy to set up a free, online demo. Simply fill out our short Treehouse Software Demo Request Form.

Treehouse Participates in CA IDMS and CA Datacom Technical Conferences

By Wayne Lashley, Chief Business Development Officer for Treehouse Software

Recently I, and others from Treehouse, had the pleasure of attending the CA IDMS Technical Conference in Framingham, MA, as well as the CA Datacom Technical Conference in Plano, TX. Both of these were free events organized by the IUA and CADRE (the IDMS and Datacom user associations), with event hosting and assistance provided by CA Technologies, to provide customers with an opportunity for training, product briefings and technical discussions with product management, product development and with other customers.

I have to commend the IUA, CADRE and CA for their initiative and efforts in putting on these events. With the changes made to the content and focus of CA World in 2014, IDMS and Datacom customers had limited opportunities to learn about product roadmaps and to interact with product representatives. The technical conferences were well-organized, offered excellent technical content—including a full day of condensed product training for both novices and advanced technicians—and even included some social time.

CA_Datacom_Event

Above: CA Datacom Event

In representing a vendor to these CA customer groups—we have a number of Datacom and IDMS customers using tcACCESS and tcVISION—, I was especially appreciative of the opportunity to get more involved in the community and to have our own technical people benefit from the training and interaction.

I was impressed with the level and quality of resourcing that CA is putting into its development and support teams. Both product groups have adopted Agile methodology for delivering, in a timely way, product capabilities and features that customers “want and will use”. Furthermore, with emerging functionality in IDMS (DB), IDMS/DC, ADS, Datacom and Ideal, there was ample demonstration that CA is embracing modern standards and trends such as SQL, Web services and Big Data.

CA_IDMS_Event

Above: CA IDMS Event

Readers from IDMS and Datacom shops that were unaware of, or unable to attend, the technical conferences should note that the success demonstrated by the recent events is likely to result in similar technical conferences being scheduled for the future. I encourage you to take advantage of them!

Treehouse Software – Your Mainframe / LUW Data Integration Partner

To learn more about tcACCESS and tcVISION, or to request a demonstration, Contact Treehouse Software today.

tcVISION TREETIP: Navigating The Repository Editor

When modeling and mapping a new metadata structure, tcVISION’s powerful Repository Editor is used to define and modify Input and Output Objects. The rich features within the Editor allow users to:

  • import new objects
  • copy or create new objects
  • import metadata for input and/or output objects
  • define target DBMSs
  • specify input and/or output objects for import
  • define DMBS-specific options
  • define target object names
  • replace/supersede existing object metadata

To assist new and even experienced tcVISION users, we’ve put together the following screen shots to give a quick overview of the Repository Editor’s functionality buttons / icons used for setting up modeling and mapping of sources and targets.

Here is an example of what the tcVISION Repository Editor looks like:

_0_tcVISION_RepositoryEditor01

Repository Editor icon definitions: Input objects

_0_tcVISION_RepositoryEditor02Input

Repository Editor icon definitions: Output objects

_0_tcVISION_RepositoryEditor02output

Repository editor right click menu options

_0_tcVISION_RepositoryEditor03OutputOptions

Repository editor extended output target options

_0_tcVISION_RepositoryEditor03RightClick


Enterprise ETL and Real-Time Data Replication Through Change Data Capture

tcVISION_Architecture

tcVISION provides real-time data replication through change data capture, and allows easy and fast data migration for mainframe application modernization projects. Enterprises looking for a product that enables bi-directional heterogeneous data replication between mainframe, Linux, Unix, and Windows platforms need look no further than to tcVISION from Treehouse Software.

To learn more about tcVISION, or to request a demonstration, contact Treehouse Software today.

Treehouse Software will be Exhibiting at SHARE and CA World

If you are attending SHARE in Pittsburgh in August, or CA World in Las Vegas in November, be sure to stop by the Treehouse Software booth and say hello!

We’ll be featuring our comprehensive and flexible portfolio of solutions for integration, replication, and migration of data between mainframe sources and any target, application or platform using ETL, CDC, SQL, XML and SOA technologies.

2014_SHARE

SHARE Technology Exchange Expo
Visit us at Booth #522 | August 3-8
David L. Lawrence Convention Center
Pittsburgh, PA


 

2014_CA_World

CA World ’14
November 9–12, 2014
Mandalay Bay Resort & Casino
Las Vegas, Nevada


Visitors to our exhibits will learn how Treehouse Software is currently providing several large organizations with ETL and real-time, bi-directional data replication using tcVISION. tcVISION provides easy and fast bi-directional data replication between mainframe, Linux, Unix, and Windows platforms.

tcVISION_Architecture


We will also showcase tcACCESS, which integrates mainframe data and applications with open systems and Windows.

tcACCESS_Diagram01