tRelational / DPS Adabas-to-Oracle Success in South Africa

by Hans-Peter Will, Senior Technical Representative and Joseph Brady, Manager of Marketing and Technical Documentation at Treehouse Software, Inc.

Recently, Hans-Peter Will, Senior Technical Representative for Treehouse Software, traveled to South Africa to assist our partner Bateleur Software (pty) Ltd. with setting up a large public-sector customer’s data replication implementation using our Adabas-to-RDBMS tool set, tRelational / DPS (Data Propagation System).

Arriving in Johannesburg, Peter met with representatives from Bateleur and the IT Organization, where the key players discussed how tRelational / DPS was going to be used in the project. The customer initially wanted to populate sample data into Oracle, so Peter configured tRelational / DPS to process one of the smaller Adabas files to generate some data. He also recommended running an analysis with tRelational to determine whether the file contained a unique key. Peter took this opportunity to show the customer what other benefits they could realize out of the analysis information. Interestingly, they used a personnel file for analysis, and Peter was immediately able to show that 23 of the records had no gender entry and 180 of records had no surname. The customer was very pleased to see these revelations in the first analysis, and looked forward to identifying other data quality issues before commencing data replication.

Customer Replication Scenario with Treehouse Software Product Set…

_0_tReDPS_Replication_Scenario

The next step was to build the target structure in accordance with the Oracle DBA’s requirements. The DBA had specified that all columns were to be defined as VARCHAR2, except the date information. After the first model was completed, DDL and DPS parameters were generated and a quick materialization of data accomplished the desired result.

At the subsequent kickoff meeting, Peter provided a complete tRelational / DPS overview and discussed the target structure with the attendees and the Oracle DBA. The rest of the day was spent doing Adabas file implementations, analysis and modeling.

Setup was then completed for transferring extracted and transformed Adabas data into the customer’s Windows environment. Adabas Vista is used, so that one logical Adabas file was actually split into two files stored on different Adabas databases, and the customer wanted to combine them into the same target table in Oracle. While there was no unique descriptor, it was discovered that three fields in combination would make a unique key, enabling the model to be created to combine data from the separate physical files into a single Oracle table.

The team proceeded with file implementation, modeling, mapping, DPS executions, and resolving data issues. Various issues that were encountered, like invalid tab characters within the data, negative personnel numbers, duplicates in unique keys (maintained by the application) and the need to add an extra column to the output. These issues were resolved quickly by the customer’s staff.

Within a day, all the files were materialized and the PLOG copy process was modified so that from that point forward, every PLOG copy would automatically be processed through DPS Propagation to update the RDBMS on the target Windows machine.

The next day, Peter was asked by the customer, “How many of the files have been processed so far?”. Peter was pleased to report that every file was processed and was propagating successfully. The happy customer remarked that they never had a project that was completed this far ahead of the deadline.

Throughout the project, Peter never personally laid hands on a customer keyboard, but instead sat with staff, effectively training them and handing over comprehensive knowledge of tRelational / DPS. The customer was very excited to learn that their personnel can now easily use the product set to do any remaining work on their own.

A few days later, we received an e-mail from Bateleur:

“I had a very pleasant meeting with the customer today. They used tRelational to reject the non-unique keys, reran the Materialization, and reran DPS plus update into Oracle. The month-end update of Oracle that was taking nearly three days to complete, now takes five Minutes! Everyone delighted!”

Bjørn (Sam) Selmer-Olsen, Managing Director, Bateleur Software (pty) Ltd


About Treehouse Software’s tRelational / DPS Product Set

tReDPS_DIAGRAM

tRelational / DPS is a robust product set that provides modeling and data transfer of legacy Adabas data into modern RDBMS-based platforms for Internet/Intranet/Business Intelligence applications. Treehouse Software designed these products to meet the demands of large, complex environments requiring product maturity, productivity, feature-richness, efficiency and high performance.

The tRelational component provides complete analysis, modeling and mapping of Adabas files and data elements to the target RDBMS tables and columns. DPS (Data Propagation System) performs Extract, Transformation, and Load (ETL) functions for the initial bulk RDBMS load and incremental Change Data Capture (CDC) batch processing to synchronize Adabas updates with the target RDBMS.

Visit the Treehouse Software website for more information on tRelational / DPS, or contact us to discuss your needs.

Subscribe to Treehouse Software’s Monthly eBulletin…

___ConstantContact_eBulletin

Stay in the loop with all of the happenings at Treehouse Software by signing up for Treehouse Software’s monthly eBulletin! You’ll receive tips and tricks for Treehouse products, news, and interesting mainframe-related articles from around the web. SUBSCRIBE HERE.

TREETIP: Did You Know About tRelational’s Schema Auto-Generation Feature?

by Joseph Brady, Manager of Marketing and Technical Documentation at Treehouse Software, Inc.

tRelational, the data analysis, modeling, and mapping component of Treehouse Software’s Adabas-to-RDBMS product set provides three options for developing RDBMS data models and mapping ADABAS fields to RDBMS columns:

Option 1: Auto-generation

Option 2: Importation of existing RDBMS schema elements

Option 3: Detailed definition and manipulation of schema and mapping elements using tRelational

The Auto-generation function can be an extremely useful productivity aid. By simply invoking this function and specifying an Adabas file structure, a fully-functional corresponding RDBMS schema (Tables, Columns, Primary Keys, Foreign Key relationships and constraints) and appropriate mappings are created virtually instantaneously. The table and column names, datatypes, lengths, and mappings/transformations are all automatically tailored specifically for the RDBMS product, platform, and version–the user need not be an expert in the RDBMS.

tRelational’s schema auto-generation simply requires specification of an Adabas file structure and associated options…

tRe_AutoGen

The auto-generated model can be immediately used to generate both RDBMS DDL and parameters for the Data Propagation System (DPS) component. Within minutes of identifying the desired Adabas file or files to tRelational, the physical RDBMS schema can be implemented on the target platform and DPS can begin materializing and propagating data to load into the tables.

It is important to note that these modeling options complement each other and can be used in combination to meet any requirements. Auto-generated schema elements can be completely customized “after the fact”, as can imported elements. Auto-generation can be used at the file level to generate complete tables and table contents at the field level, making it easy to then manually define and map one or more columns within a table, or even to denormalize MU/PE structures into a set of discrete columns.


About Treehouse Software’s tRelational / DPS Product Set

tReDPSMainDiagram01

tRelational / DPS is a robust product set that provides modeling and data transfer of legacy Adabas data into modern RDBMS-based platforms for Internet/Intranet/Business Intelligence applications. Treehouse Software designed these products to meet the demands of large, complex environments requiring product maturity, productivity, feature-richness, efficiency and high performance.

The tRelational component provides complete analysis, modeling and mapping of Adabas files and data elements to the target RDBMS tables and columns. DPS (Data Propagation System) performs Extract, Transformation, and Load (ETL) functions for the initial bulk RDBMS load and incremental Change Data Capture (CDC) batch processing to synchronize Adabas updates with the target RDBMS.

Visit the Treehouse Software website for more information on tRelational / DPS, or contact us to discuss your needs.

Treehouse Software Products and Professional Services for Adabas / Natural Help with ALLETE’s Mainframe Retirement

by Mike Kuechenberg, Senior Technical Representative at Treehouse Software, Inc. __Allete

Since 2010, Treehouse Software consultants have provided product training and Professional Services for the planned retirement of the mainframe environment at ALLETE.

Here’s a look at three parts of the project in which Treehouse was involved:

tRelational / DPS

In order to replicate Adabas data to Oracle, ALLETE licensed Treehouse’s tRelational / DPS product set. After some initial training by Treehouse Professional Services, ALLETE staff were able to model and map Adabas files to Oracle schemata using tRelational, and to deploy DPS jobs to materialize (ETL) and propagate (CDC) the Adabas data into Oracle. This continued until the final cutover to the new systems. Just before the mainframe was decommissioned, some additional Adabas files were materialized by Treehouse Professional Services for archival purposes.

DBA Consulting

Treehouse Professional Services took over the DBA responsibilities for ALLETE starting in September 2010. The responsibilities included Software AG product upgrades, daily checks on available database space and file extents, and requests from ALLETE staff like file restores, field maintenance, and any other request requiring DBA involvement.

Systems Support

Additionally, Treehouse Professional Services assumed responsibility for ALLETE’s mainframe systems programming activities. Tasks included monthly IPLs to the system, applying licenses to products, handling system error situations, defining new DASD, upgrading IBM and third-party products, providing periodic SOX reports, and handling other requests from ALLETE staff.

Conclusion of a Successful Engagement

As this five-year Treehouse Software / ALLETE partnership ends, we wish our friends all the best as they move forward with their new systems and strategies.

“During the time our companies have been working together, Treehouse personnel were always responsive and are experts in their fields. Thanks for the flexibility and great support over the years.”

Eric Peterson, Manager, IT Infrastructure, ITS Systems, ALLETE Inc.


About Treehouse Software Professional Services _0_Consulting_Services002

Treehouse Professional Services offer a proven, cost-effective alternative to full-time in-house systems programmers, system administrators and DBAs. Using our team of experts and monitoring techniques, Treehouse offers world-class, on-site and remote system support and DBA service at affordable prices. Treehouse Professional Services offer various levels of system monitoring and administration. Our team will monitor critical factors within your Software AG environment, apply preventive maintenance for your systems and databases, and keep your software up-to-date. We even provide z/OS systems programming services! We are strongly committed to our customers’ success and we deliver the highest quality DBA and support solutions.

Visit the Treehouse Software website for more information on Treehouse Professional Services, or contact us to discuss your needs.


About Treehouse Software’s tRelational / DPS Product Set tReDPSMainDiagram01

tRelational / DPS is a robust product set that provides modeling and data transfer of legacy ADABAS data into modern RDBMS-based platforms for Internet/Intranet/Business Intelligence applications. Treehouse Software designed these products to meet the demands of large, complex environments requiring product maturity, productivity, feature-richness, efficiency and high performance.

The tRelational component provides complete analysis, modeling and mapping of ADABAS files and data elements to the target RDBMS tables and columns. DPS (Data Propagation System) performs Extract, Transformation, and Load (ETL) functions for the initial bulk RDBMS load and incremental Change Data Capture (CDC) batch processing to synchronize ADABAS updates with the target RDBMS.

Visit the Treehouse Software website for more information on tRelational / DPS, or contact us to discuss your needs.

Software AG TechEd 2015

by Wayne Lashley, Chief Business Development Officer for Treehouse Software

Recently, four of us from Treehouse SoftwareMitch Doricich, Mike Kuechenberg, Chris Rudolph and myself—attended Software AG’s TechEd 2015, which took place on April 21-22, 2015 at the Chicago O’Hare Hyatt Regency Hotel. We were joined by over 180 other attendees, including about 60 representing Adabas/Natural sites.

The event was organized into separate tracks for Adabas/Natural, webMethods, ARIS and Alfabet, but the morning general sessions were for all attendees.

Tim Fortier of Software AG acted as the emcee for the two-day event. There were general presentations and keynotes by various Software AG directors and executives, including Mike Schumpert, Gerd Schneider, Mighael Botha, Cynthia Stegall, Kurt Hansen and Ricardo Leitão, on topics like the Internet of Things (IoT), Software AG’s TECHCommunities, innovation, training and support.

Besides the general sessions, the Treehouse team attended the Adabas/Natural breakout sessions. These included presentations by a number of familiar figures from Software AG, including Joe Gentry, Karlheinz Kronauer, Patrick Gould, Eric Wood, Becky Albin and Bruce Beaman, covering Adabas and Natural (and add-on products) roadmaps and futures, and new products and capabilities in the analytics, mobile and integration spaces.

Customer presentations were provided by the Geoff Wells and Don Ellis from the State of Minnesota describing tremendous CPU savings using the zIIP Enabler for Natural, and also detailing their early experiences with the new Event Analytics for Adabas, by Amarish Pathak from AAFMAA on integrating Adabas/Natural/EntireX with mobile applications, and by Manny Klonaris from Verizon on Adabas Vista.

I found the Event Analytics for Adabas solution to be particularly compelling in today’s world of stringent security, audit and privacy requirements. Becky remarked that it could be called “Event Analytics for Anything”, because the data/events to be analyzed could involve virtually any source. Treehouse TRIM customers could be taking advantage of this solution today for their Adabas data, and analytics based on different data sources could be enabled through other Treehouse products and services.

A featured component of the event was Becky giving a Master’s Class on Adabas v8.3. Mike and Chris, the Treehouse technical guys, were logged in to the Treehouse mainframe during the class so that they could follow along on our own system while Becky went through her material. The numerous other DBAs in the room also got great insight into the features and capabilities of this latest Adabas release.

_0_Treehouse_Software_TechEd_2015_Presentation

In addition, I had the privilege of giving a presentation on behalf of Treehouse, speaking about how Treehouse can help maximize and revitalize Adabas/Natural through our products and services. I want to say a big thanks to Thadd Jenkins from Southwest Airlines, who provided a very gratifying testimonial about the long and mutually-beneficial relationship between Treehouse and Southwest.

My presentation is available for download here.

TechEd 2015 was hugely beneficial for the attendees to meet and mingle with Software AG experts, management and with other customers. For readers who were unable to make it this year, another TechEd is likely to be scheduled for 2016, based on the roundtable discussion and customer feedback. I encourage all customers to sign up for this free conference.

Our thanks to Software AG for organizing a very successful TechEd 2015, and for enabling Treehouse to participate in it.

A Job Well-Done by Treehouse Software Consulting Services for Swiss Reinsurance Company, Ltd.

SwissRe_Logo

Since 2002, Treehouse Software consultants have provided DBA services for the Software AG (SAG) mainframe environment at Swiss Reinsurance Company, Ltd. (Swiss Re). Treehouse services included all SAG product support and upgrades for ADABAS, NATURAL, NATURAL Security, PREDICT, and COM-PLETE.

Additionally, Treehouse consultants installed the TRIM ADABAS and NATURAL Performance Monitor product to help in monitoring ADABAS and NATURAL usage, and the tRelational / DPS product set was used for converting and archiving Swiss Re’s ADABAS data as the new Oracle-based systems were implemented.

As this chapter of the long-time Treehouse Software / Swiss Re partnership has drawn to a close, we express our gratitude for having such a good and loyal customer, and we appreciate their sentiments towards us:

“Thank you for your professional and prompt DBA and support services to Swiss Re for the last many years. You have kept our systems on the most current level of software upgrades, helped us to successfully migrate our mainframe from in-house facilities to an outside provider, as well as migrate from the Toronto system to a global platform-based L&H system, and finally provided archival data extracts for the total decommissioning of the Toronto system.

At all stages we have received excellent and cost-effective services from Treehouse.

We sincerely thank each one of you for helping us achieve our goals. Best wishes for the future.”

Sheila Gupta
Vice President, Information Technology
Swiss Reinsurance Company Ltd.


About Treehouse Software Consulting Services

At Treehouse Software, our business is mainframe systems software and services. We know that organizations using mainframe systems for their business operations are feeling the pressure to be more efficient and to contribute to overall enterprise cost savings, and we’re here to help.

Customers can take advantage of Treehouse’s decades of experience in mainframe optimization, systems security, control, auditing, performance enhancement, etc. Our Mainframe Consulting and Remote DBA Services can be a life-saver when dwindling financial and human resources make it difficult to maintain past levels of IT services for an organization.

Treehouse Software’s expert consultants can provide ADABAS/NATURAL performance analysis, environment tuning, and optimization; development, training and implementation services involving any Software AG technology; help with special routines or user exits for ADABAS/NATURAL; product installation, upgrades, and training; data transfer and integration; and DBA services.

Contact Treehouse Software for more information on our Consulting Services.

Download The New Treehouse Software White Paper on Fault-tolerant Data Sharing Between Applications and Databases

Image

Hot Topic or Hot Potato? 

Our informative new white paper, written by Wayne Lashley, Chief Business Development Officer for Treehouse Software, delves into the issues of why a well- architected, comprehensive, robust and scalable replication solution is the key to enabling legacy databases to exchange data reliably and effectively throughout the enterprise. This makes it possible for IT and business users to access corporate data regardless of where it resides. Furthermore, effective enterprise replication can be combined with other techniques to overcome technology constraints and maximize IT effectiveness.

To download this and other free white papers from Treehouse Software, visit our White Papers web page.