Treehouse Software Sponsors June Pittsburgh Amazon Web Services (AWS) User Group Meetup

By Joseph Brady, Marketing Manager and AWS Alliance Lead for Treehouse Software

_0_Collage

Treehouse Software sponsored the June AWS User Group Meetup at AlphaLab in Pittsburgh. AlphaLab is a nationally ranked software accelerator in Pittsburgh. They help early-stage tech companies quickly figure out the best way to build and grow in a program with funding, early-stage technology companies with an extensive mentor network, educational sessions with industry leaders, and a rich entrepreneurial work environment within a nationally ranked accelerator program.

Food, drinks, and technical presentation were courtesy of Treehouse Software. The AlphaLab space was very nice and spacious, with a full kitchen and a large bar for everybody to hang out and talk while enjoying a great spread of food and drinks. This was an ideal setting for ice-breaking and socializing with attendees.

As is usual for the AWS User Group, the attendees ranged from students to consultants and DBAs, all wanting to learn about what can be done on the AWS Cloud.

After some food, drinks, and a bit of socializing, Jim Jen, Executive Director of AlphaLab started things off with a short AlphaLab welcome and introduction.

Next, Andy Jones, Senior Technical Representative for Treehouse Software presented “tcVISION Technical Overview and AWS Cloud Environment Replication Demonstration”. Andy told a little about Treehouse, our AWS partnership, and an overview of tcVISION with a mention of the tcVISION Amazon Machine Image (AMI) development work that is going on right now with support from a top AWS Solutions Architect. At the end of Andy’s presentation, interest was sufficient for him to give a tcVISION live demo, where he showed everybody tcVISION replicating data from the Treehouse mainframe to AWS Aurora in the Cloud.

Typical Treehouse Mainframe-to-AWS data replication scenario in a demo:

Demo_Example

We ended the evening with a little more eating, drinking, and socializing, and a mention that Treehouse Software will be exhibiting the tcVISION/AWS Solution at AWS re:Invent in November.

Thanks to everyone who attended, helped, and participated!


Find out more about tcVISION — Enterprise ETL and Real-Time Data Replication Through Change Data Capture

tcVISION supports a vast array of integration scenarios throughout the enterprise, providing easy and fast data migration for mainframe application modernization projects and enabling bi-directional data replication between mainframe, Linux, Unix and Windows platforms. This innovative technology offers comprehensive abilities to identify and capture changes occurring in mainframe and relational databases, then publish the required information to an impressive variety of targets, both on-premise and Cloud-based.

tcVISION_Connection_Overview_Web01

tcVISION acquires data in bulk or via change data capture methods, including in real time, from virtually any IBM mainframe data source (Software AG Adabas, IBM Db2, IBM VSAM, IBM IMS/DB, CA IDMS, CA Datacom, even sequential files), and transform and deliver to virtually any target. In addition, the same product can extract and replicate data to/from a variety of non-mainframe sources, including AWS, PostgreSQL, Adabas LUW, Oracle Database, Microsoft SQL Server, IBM Db2 LUW and Db2 BLU, and IBM Informix.


__TSI_LOGO

Visit the Treehouse Software website for more information on tcVISION, or contact us to discuss your needs.

 

 

Treehouse Software Customer Success: Element Fleet Management Corp. Real-time, Bi-directional Synchronization Between IBM Mainframe Datacom and PostgreSQL

Element_Building

As a leading global fleet management company, Element provides a comprehensive range of fleet services that span the total fleet lifecycle, helping customers optimize their strategies at every stage – from acquisition and financing to program management and vehicle remarketing. These services, together with exceptional tools, technologies and consulting, empower customers to realize extraordinary results.

Business Background

Element Fleet Management has over one million vehicles under management, and serves more than 2,800 customers. The company employs over 2,700 staff members across 12 offices. Transaction sizes range from $500,000 to $40 million. 50 countries are served through the Element-Arval Global Alliance. Top industries served by Element Fleet Management are agriculture, business services, chemical, construction, consumer products, education and non-profit, energy, food and beverage, insurance, manufacturing, pharmaceutical and healthcare, professional services, telecommunications, transportation, and utilities.

Business Issue

Much of Element’s mission critical mainframe data is stored in a legacy IBM mainframe database. The cost to maintain these legacy databases is high and they lack the features required for modernizing the data architecture. The data is utilized by an extensive number of interlinked programs dependent on this legacy data. Element required a solution that would allow the legacy environment to continue while having real time replicated data on a modern database/platform. This enables them to utilize modern programing and data tools to be competitive in their market.

Element_Diagram

Technology Solution

Treehouse software and the customer developed a phased plan to prove out and implement tcVISION. This started with a proof-of-concept to prove out the technology’s effectiveness and technical suitability. This was proceeded by architectural phase to define the architectural solution including, configuration management, environments and promotion, high availability, security, disaster recovery, monitoring, operations procedures, script customization, data replication mapping and training plans. After defining the architecture, the production deployment phase started with incremental sprint-like deployments. Additional files were deployed into production every few weeks.

This project enabled the tcVISION product to synchronize mission critical financial IBM mainframe Datacom data to a modern PostgreSQL database. Bi-directional, real-time data synchronization enables changes on either platform to be reflected on the other platform (e.g., a change to a PostgreSQL table is reflected on mainframe Datacom). This allows their business to modernize the application on PostgreSQL without disrupting the existing critical work on the legacy system.

NOTE: Many modern tools are using the PostgreSQL database, which greatly enhances business agility (e.g., other divisions within Element are already using Amazon Web Services (AWS), so having tcVISION in place now makes mainframe data delivery to the AWS cloud an easy option). See a step-by-step video of Mainframe-to-PostgreSQL on AWS here. 

Successful, real-time mainframe data replication to an open systems application allows web and mobile access and updates. Element indicated their satisfaction with the results and the solution, especially reduced mainframe MIPS costs, and enhanced business ability to respond to business environment changes.


Find out more about tcVISION — Enterprise ETL and Real-Time Data Replication Through Change Data Capture

tcVISION supports a vast array of integration scenarios throughout the enterprise, providing easy and fast data migration for mainframe application modernization projects and enabling bi-directional data replication between mainframe, Linux, Unix and Windows platforms. This innovative technology offers comprehensive abilities to identify and capture changes occurring in mainframe and relational databases, then publish the required information to an impressive variety of targets, both on-premise and Cloud-based.

tcVISION_Connection_Overview_Web01

tcVISION acquires data in bulk or via change data capture methods, including in real time, from virtually any IBM mainframe data source (Software AG Adabas, IBM Db2, IBM VSAM, IBM IMS/DB, CA IDMS, CA Datacom, even sequential files), and transform and deliver to virtually any target. In addition, the same product can extract and replicate data from a variety of non-mainframe sources, including PostgreSQL, Adabas LUW, Oracle Database, Microsoft SQL Server, IBM Db2 LUW and Db2 BLU, and IBM Informix.


__TSI_LOGO

Visit the Treehouse Software website for more information on tcVISION, or contact us to discuss your needs.

 

Want to See a Live, Online Demonstration of Mainframe-to-Amazon Web Services (AWS) Data Replication using Treehouse Software’s tcVISION?

tcVISION is a powerful and comprehensive solution for real-time, bi-directional replication of mainframe data to AWS. tcVISION’s GUI modeling and mapping, and ease of migrating data to AWS makes it an ideal choice for modernizing large mainframe environments. Additionally, tcVISION can synchronize mission critical data from a mainframe system on AWS. Real-time, bi-directional data synchronization enables changes on either system to be reflected on the other system (e.g., a change to a PostgreSQL table on AWS is reflected on the mainframe database). This allows businesses to modernize an application on AWS without disrupting the existing critical work on the legacy system.

Contact Treehouse Software today for a live, online session that demonstrates real-time replication of mainframe data to Amazon RDS instances!

Example of a Treehouse Software Mainframe-to-AWS Data Replication Demo Environment…

Slide1

tcVISION Technology

tcVISION‘s support for AWS as a target is fully integrated alongside traditional Linux/Unix/Windows (LUW) targets such as PostgreSQL, Oracle Database, IBM DB2 LUW, Software AG Adabas LUW, IBM Informix, Sybase, Microsoft SQL Server, and ODBC.

tcVISION_Connection_Overview_Web01

tcVISION considerably simplifies mainframe data exchange processes. The structure of the existing mainframe data is analyzed by tcVISION processors, then automatically mapped to a target data mapping. The data mapping information is presented in a user-friendly and transparent format – even for users with no mainframe knowledge.

The mapping information is saved in a meta data repository hosted on a relational database, and can easily be made available to other applications. The Windows-based Control Board of tcVISION provides an easy-to-use facility to administer the data flow. tcVISION provides a variety of interfaces to allow seamless integration with ETL or EAI solutions.


__tsi_logo_400x200

Since 1982, Treehouse Software, Inc. has been serving enterprises worldwide with industry-leading software products and outstanding technical support.  Today, Treehouse Software is a global leader in providing data migration, replication, and integration solutions for the most complex and demanding heterogeneous environments, as well as feature-rich, accelerated-ROI offerings for information delivery, business intelligence and analytics, and application modernization.

 

 

Treehouse Software Collaborates with Amazon Web Services (AWS) to Offer Comprehensive Enterprise Mainframe-to-AWS Data Replication

Press Contact: Joe Brady (+1.724.759.7070 x110; jbrady@treehouse.com)

Pittsburgh, PA; Treehouse Software, Inc., of Sewickley, PA is pleased to announce an agreement with Amazon Web Services (AWS) to offer enterprise customers a complete Mainframe-to-AWS data replication solution to provide them with fast and easy access to the cloud.

tcVISION_Mainframe_To_AWS_635

Treehouse Software’s tcVISION is a powerful and mature software product designed for real-time, bi-directional replication of mainframe data to AWS. tcVISION’s GUI modeling and mapping, and ease of migrating data to AWS makes it an ideal choice for modernizing large mainframe environments.

Additionally, tcVISION can synchronize mission critical data from a mainframe system on AWS.  Real-time, bi-directional data synchronization enables changes on either system to be reflected on the other system (e.g., a change to a PostgreSQL table on AWS is reflected on the mainframe database). This allows businesses to modernize an application on AWS without disrupting the existing critical work on the legacy system.

“Through this exciting new collaboration, Treehouse Software and AWS are working together to offer customers with mainframe systems a straightforward solution for enhancing their business agility,” said George Szakach, President of Treehouse Software. “We provide our proven mainframe data delivery capabilities, and the customer benefits from modernization of their data within the flexible, scalable, pay-as-you-go offering on AWS.”

Video – How does tcVISION replicate mainframe data to AWS?


About Treehouse Software, Inc.

__tsi_logo_400x200

Since 1982, Treehouse Software, Inc. has been serving enterprises worldwide with industry-leading software products and outstanding technical support.  Today, Treehouse Software is a global leader in providing data migration, replication, and integration solutions for the most complex and demanding heterogeneous environments, as well as feature-rich, accelerated-ROI offerings for information delivery, business intelligence and analytics, and application modernization.

Where Do You Want to Go?

Enterprise ETL and Real-Time, Bidirectional Data Replication Between Virtually Any Source and Target.

Mainframe_to_Cloud

Planning a data replication project between mainframe, Linux, Unix, and Windows platforms? We now have downloadable data sheets that individually focus on supported data replication sources and targets.


Find out more about tcVISION — Enterprise ETL and Real-Time Data Replication Through Change Data Capture

tcVISION supports a vast array of integration scenarios throughout the enterprise, providing easy and fast data migration for mainframe application modernization projects and enabling bi-directional data replication between mainframe, Linux, Unix and Windows platforms. This innovative technology offers comprehensive abilities to identify and capture changes occurring in mainframe and relational databases, then publish the required information to an impressive variety of targets, both on-premise and Cloud-based.

___tcVISON_Big_Data_002

tcVISION acquires data in bulk or via change data capture methods, including in real time, from virtually any IBM mainframe data source (Software AG Adabas, IBM DB2, IBM VSAM, IBM IMS/DB, CA IDMS, CA Datacom, even sequential files), and transform and deliver to virtually any target. In addition, the same product can extract and replicate data from a variety of non-mainframe sources, including Adabas LUW, Oracle Database, Microsoft SQL Server, IBM DB2 LUW and DB2 BLU, IBM Informix and PostgreSQL.


__TSI_LOGO

Visit the Treehouse Software website for more information on tcVISION, or contact us to discuss your needs.

 

Treehouse Software Customers are Looking Upwards to Mainframe-to-Cloud Data Replication

The search is on for a mature, easy-to-implement Extract Transform and Load (ETL) solution for migrating mission critical data to the cloud.

Mainframe_to_Cloud

Treehouse Software’s tcVISION supports a vast array of integration scenarios throughout the enterprise, providing easy and fast data migration for mainframe application modernization projects, and enabling data replication between mainframe, Linux, Unix and Windows platforms. This innovative technology offers comprehensive abilities to identify and capture changes occurring in mainframe and relational databases, then publish the required information to an impressive variety of targets, both on-premise and cloud-based.

Mainframe-to-Cloud Case Use Example…

BAWAG P.S.K. is one of the largest banks in Austria, with more than 1.6 million private and business customers and is a well-known brand in the country. Their business strategy is oriented towards low risk and high efficiency.

BAWAG was looking to reduce the load on their IBM mainframe and as a result, reduce costs. The project involved offloading data from their core database system to a less expensive system, in real-time, and to provide read access from that system to the new infrastructure. The primary motivator for this data migration was the constantly increasing CPU costs on the mainframe caused by the growing transaction load of online banking, mobile banking, and the use of self service devices.

BAWAG ultimately migrated their online banking application to the cloud using tcVISION. Realtime Event-handling, Realtime Analytics, Realtime Fraud Prevention are only a few of the use cases that the bank’s solution currently covers.

BAWAG_Diagram

The bank decided to use tcVISION to migrate z/OS DB2 data into a Hadoop data lake (a storage repository that holds raw data in its native format). 20 Million transactions were made within 15 minutes.

Cost Reductions Seen Immediately

BAWAG is now seeing a 35-40 percent reduction of the MIPS consumption for online processing during business hours. After hours, consumption is less, because it is mainly batch processing on the mainframe. Currently, a volume of approximately 30 GB changed data (uncompressed) is replicated from DB2 per day.

In addition to the primary usage scenario, BAWAG can also cover additional use cases. This includes real-time-event handling and stream processing, analytics based upon real-time data as well as the possibility to report and analyze structured and unstructured data with excellent performance. The system can be inexpensively operated on Commodity Hardware and has no scalability limitations. Compared to the savings, the costs of replication (CPU consumption) of tcVISION are now very low.

Additionally, BAWAG plans to extend the use of tcVISION in the future, including implementation of real-time replication from ORACLE into the data lake.


Find out more about tcVISION — Enterprise ETL and Real-Time Data Replication Through Change Data Capture

tcVISION supports a vast array of integration scenarios throughout the enterprise, providing easy and fast data migration for mainframe application modernization projects and enabling bi-directional data replication between mainframe, Linux, Unix and Windows platforms. This innovative technology offers comprehensive abilities to identify and capture changes occurring in mainframe and relational databases, then publish the required information to an impressive variety of targets, both on-premise and Cloud-based.

_0_tcvision_connection_overview

tcVISION acquires data in bulk or via change data capture methods, including in real time, from virtually any IBM mainframe data source (Software AG Adabas, IBM DB2, IBM VSAM, IBM IMS/DB, CA IDMS, CA Datacom, even sequential files), and transform and deliver to virtually any target. In addition, the same product can extract and replicate data from a variety of non-mainframe sources, including Adabas LUW, Oracle Database, Microsoft SQL Server, IBM DB2 LUW and DB2 BLU, IBM Informix and PostgreSQL.


__TSI_LOGO

Visit the Treehouse Software website for more information on tcVISION, or contact us to discuss your needs.

Friends from Europe and Across the U.S. Visit the Treehouse

Friends from Europe and Across the U.S. Visit the Treehouse

The week of September 21, 2017 found Elisabeth Schwarz and Beat Münch from Treehouse Software’s German partner, B.O.S. Software Service und Vertrieb GmbH paying us a visit.

B.O.S. stands for Better Operative Solutions. B.O.S. originally developed and distributed software that made 3270 applications more user friendly before focusing on Enterprise Data and Application Integration with Treehouse-marketed tcACCESS and tcVISION – Direct Data Access and Data Synchronization / Replication / Exchange / Migration.

While Elisabeth and Beat were in town, we decided to have the entire Treehouse staff come in to Pittsburgh headquarters as well. The week was a very productive one, with Treehouse and B.O.S. staff having meetings on many new product initiatives and current customer developments.

___Treehouse_Staff_And_BOS

Treehouse Software staff and friends outside of Treehouse headquarters in Sewickley, PA (from left to right): Rolf Vollmer, European Sales Manager (Germany); Mitch Doricich, National Sales Manager; Elisabeth Schwarz, General Manager at B.O.S.; Norbert Geuettner, Senior Developer; Kevin Heimbaugh, Senior Technical Representative; Hans-Peter Will, Senior Technical Representative (Germany); George Szakach, President; Karen Dunlap, Senior Developer; Mike Kuechenberg, Senior Technical Representative; Lynn McIntyre, Technical Coordinator; Frank Griffin, Senior Developer; Andy Jones, Senior Technical Representative; Linda Woodham, Secretary; Dan Webster, National Sales Manager; Russell Roll, CFO; Chris Rudolph, Senior Technical Representative; Beat Münch, Chief Technology Officer at B.O.S.; Paul Linn, Senior Developer; Joe Brady, Marketing and Documentation Manager.

Of course, there can’t be a get-together at the Treehouse without some fun, and Michael Szakach, Treehouse Marketing Consultant and Event Organizer saw to it that our guests and staff enjoyed visiting some of Pittsburgh’s more unusual and fun attractions, in addition to a very nice night out with great food and conversation!

The Treehouse caravan brought everyone to downtown Pittsburgh to visit Bicycle Heaven Museum, Randyland, The Mattress Factory Art Gallery, and Johnny Angel’s Ginchy Stuff and Music Museum.

Bicycle Heaven Museum

This slideshow requires JavaScript.

Bicycle Heaven Museum is the world’s largest bicycle museum and shop, as seen in the New York Times and Associated Press. Rated on Trip Advisor as the #1 Pittsburgh Museum and voted top bike shop in Pittsburgh.   You can get your bike fixed, tuned up, or trade it in for a newer (or older) bicycle.


Randyland

This slideshow requires JavaScript.

Randyland is the home of artist, Randy Gilson. Located in the Mexican War Streets district of Pittsburgh’s Northside. Visitors are welcome to come and explore the public art displays in and around the property.


The Mattress Factory

This slideshow requires JavaScript.

The Mattress Factory is a contemporary art museum and experimental lab featuring site-specific installations created by artists in residence from around the world.


Johnny Angel’s Ginchy Stuff and Music Museum

This slideshow requires JavaScript.

Johnny Angel has been in the music and entertainment industry for over 45 years and has great stuff to go along with his illustrious career. From autographed pictures to memorabilia, he has it all at Johhny Angel’s Ginchy Stuff. Johnny has what you thought you had forgotten about – from pennants to pictures, and 45s to 78s, he has it all!


The last full evening, Emilie and George Szakach invited all 24 staff and visitors to dinner at one of our local favorite restaurants, called Willow.

_0_Willow

Overall, everyone had a very productive and fun week. We look forward to continued success with our friends from B.O.S., and of course, more visits!


__TSI_LOGO

Visit our website for more information on Treehouse Software.

 

Treehouse Proof of Concept: Bi-directional Replication Between Adabas and SQL Server

Chris Rudolph and Kevin Heimbaugh, Senior Technical Representatives for Treehouse Software, visited a customer site (a large retail and distribution company) to perform a five-day proof of concept (POC) of tcVISION with bi-directional replication between Software AG’s Adabas and Microsoft SQL Server.

Chris and Kevin initially met with the customer team, consisting of the DBA, Applications Manager, and a technical applications person. The agenda for the week was set to:

  • Import metadata from several Adabas files
  • Bulk load the Adabas data into SQL Server
  • Set up replication from Adabas to SQL Server
  • Add the bi-directional replication back to Adabas

Additionally, there were a few other items the customer wanted the Treehouse team to address, including support for date formats; timestamps for bi-directional replication to avoid update conflicts; using Predict views to define multiple SQL Server tables; and support for MUs and PEs. Chris noted that everything on the customer’s list is easily supported, and there are several options for the update scenarios that can be used.

_0_tcVISION_Adabas_To_SQLServer

After the tcVISION components were installed, the POC began by using tcVISION’s Control Board to define a metadata repository database in SQL Server. Once that was set, the teams moved on to import the first Adabas file’s metadata using tcVISON’s Metadata Import Wizard. As part of this process tcVISION generated Adabas to SQL Server schemas and field-to-column links as well as created target tables in SQL Server. Bulk Transfer scripts were created using a wizard to read the Adabas file on the mainframe, and load the data into SQL Server using the SQL Server bulk loader. Chris created a control script to show how tcVISION can concurrently bulk transfer multiple Adabas files into SQL Server This required increasing the tcVISION Manager’s VSE partition size to successfully test multiple load scripts executing in parallel.

The teams moved on to define the real-time change data capture (CDC) scripts necessary to process the Adabas PLOG. The tcVISION scripts use a two-phase approach to queue captured Adabas transaction on the open platform, then transform and apply the transactions to SQL Server. The scripts were set up to automatically generate detailed logs to track the PLOG transactions captured, SQL statements successfully applied to SQL Server, failed SQL statements, and informational items such as auto-corrected data and transactions rejected due to processing rules.

Now that several tables were defined and loaded, the bi-directional process was set up. SQL Server CDC was enabled for each table to be replicated. The team made a change within SQL Server and verified that the change show up in the SQL Server CDC tables. The SQL Server-to-Adabas mappings were defined in the tcVISION metadata repository, including the “back update check” to ensure only non-tcVISION transactions are captured, and the scripts on both Windows and mainframe were defined to create the LUWs from the SQL Server CDC and apply the changes to Adabas.

CDC from SQL Server to Adabas was successfully tested. Chris then showed the ability to create Journal replication where each change can be captured by replication type. The team spent time creating a few more mappings so multiple file / table updates could be tested, in addition to doing updates while the scripts were stopped to simulate a lost connection. This included setting up a new script to process copied PLOG datasets created by the ADARES utility.

The team defined the remainder of their Adabas files to the metadata repository. Some were set them up for bi-directional replication, and others were setup for unidirectional replication and Journal replication. Everything work as expected at the wrap-up meeting where the team provided a live demonstration to management of tcVISION and the items accomplished. The final tcVISION presentation and demo went very well, and everyone was pleased with the progress made during the week.


Find out more about tcVISION — Enterprise ETL and Real-Time Data Replication Through Change Data Capture

tcVISION provides easy and fast data migration for mainframe application modernization projects and enables bi-directional data replication between mainframe, Linux, Unix and Windows platforms.

_0_tcvision_connection_overview

tcVISION acquires data in bulk or via change data capture methods, including in real time, from virtually any IBM mainframe data source (Software AG Adabas, IBM DB2, IBM VSAM, IBM IMS/DB, CA IDMS, CA Datacom, even sequential files), and transform and deliver to virtually any target. In addition, the same product can extract and replicate data from a variety of non-mainframe sources, including Adabas LUW, Oracle Database, Microsoft SQL Server, IBM DB2 LUW and DB2 BLU, IBM Informix and PostgreSQL.


__tsi_logo_400x200

Visit the Treehouse Software website for more information on tcVISION, or contact us to discuss your needs.

tRelational / DPS Adabas-to-Oracle Success in South Africa

by Hans-Peter Will, Senior Technical Representative and Joseph Brady, Manager of Marketing and Technical Documentation at Treehouse Software, Inc.

Recently, Hans-Peter Will, Senior Technical Representative for Treehouse Software, traveled to South Africa to assist our partner Bateleur Software (pty) Ltd. with setting up a large public-sector customer’s data replication implementation using our Adabas-to-RDBMS tool set, tRelational / DPS (Data Propagation System).

Arriving in Johannesburg, Peter met with representatives from Bateleur and the IT Organization, where the key players discussed how tRelational / DPS was going to be used in the project. The customer initially wanted to populate sample data into Oracle, so Peter configured tRelational / DPS to process one of the smaller Adabas files to generate some data. He also recommended running an analysis with tRelational to determine whether the file contained a unique key. Peter took this opportunity to show the customer what other benefits they could realize out of the analysis information. Interestingly, they used a personnel file for analysis, and Peter was immediately able to show that 23 of the records had no gender entry and 180 of records had no surname. The customer was very pleased to see these revelations in the first analysis, and looked forward to identifying other data quality issues before commencing data replication.

Customer Replication Scenario with Treehouse Software Product Set…

_0_tReDPS_Replication_Scenario

The next step was to build the target structure in accordance with the Oracle DBA’s requirements. The DBA had specified that all columns were to be defined as VARCHAR2, except the date information. After the first model was completed, DDL and DPS parameters were generated and a quick materialization of data accomplished the desired result.

At the subsequent kickoff meeting, Peter provided a complete tRelational / DPS overview and discussed the target structure with the attendees and the Oracle DBA. The rest of the day was spent doing Adabas file implementations, analysis and modeling.

Setup was then completed for transferring extracted and transformed Adabas data into the customer’s Windows environment. Adabas Vista is used, so that one logical Adabas file was actually split into two files stored on different Adabas databases, and the customer wanted to combine them into the same target table in Oracle. While there was no unique descriptor, it was discovered that three fields in combination would make a unique key, enabling the model to be created to combine data from the separate physical files into a single Oracle table.

The team proceeded with file implementation, modeling, mapping, DPS executions, and resolving data issues. Various issues that were encountered, like invalid tab characters within the data, negative personnel numbers, duplicates in unique keys (maintained by the application) and the need to add an extra column to the output. These issues were resolved quickly by the customer’s staff.

Within a day, all the files were materialized and the PLOG copy process was modified so that from that point forward, every PLOG copy would automatically be processed through DPS Propagation to update the RDBMS on the target Windows machine.

The next day, Peter was asked by the customer, “How many of the files have been processed so far?”. Peter was pleased to report that every file was processed and was propagating successfully. The happy customer remarked that they never had a project that was completed this far ahead of the deadline.

Throughout the project, Peter never personally laid hands on a customer keyboard, but instead sat with staff, effectively training them and handing over comprehensive knowledge of tRelational / DPS. The customer was very excited to learn that their personnel can now easily use the product set to do any remaining work on their own.

A few days later, we received an e-mail from Bateleur:

“I had a very pleasant meeting with the customer today. They used tRelational to reject the non-unique keys, reran the Materialization, and reran DPS plus update into Oracle. The month-end update of Oracle that was taking nearly three days to complete, now takes five Minutes! Everyone delighted!”

Bjørn (Sam) Selmer-Olsen, Managing Director, Bateleur Software (pty) Ltd


About Treehouse Software’s tRelational / DPS Product Set

tReDPS_DIAGRAM

tRelational / DPS is a robust product set that provides modeling and data transfer of legacy Adabas data into modern RDBMS-based platforms for Internet/Intranet/Business Intelligence applications. Treehouse Software designed these products to meet the demands of large, complex environments requiring product maturity, productivity, feature-richness, efficiency and high performance.

The tRelational component provides complete analysis, modeling and mapping of Adabas files and data elements to the target RDBMS tables and columns. DPS (Data Propagation System) performs Extract, Transformation, and Load (ETL) functions for the initial bulk RDBMS load and incremental Change Data Capture (CDC) batch processing to synchronize Adabas updates with the target RDBMS.

Visit the Treehouse Software website for more information on tRelational / DPS, or contact us to discuss your needs.

TREETIP: tcVISION Supports Data Replication to MongoDB

tcVISONv6

The tcVISION cross-system integration platform is a robust, proven, and mature solution that is constantly under development to meet the requirements of new technologies, including support for MongoDB.

mongodb

MongoDB is among the leading NoSQL databases in the market and has been developed for the needs of today’s information technology. MongoDB supports a data model with dynamic schemata and is especially suitable to store large amounts of data using GridFS. It contains automatic failure protection using an integrated replication. MongoDB also offers native, idiomatic drivers for nearly all programming languages and frameworks.

Find out more about MongoDB here: https://www.mongodb.com

In addition to support for MongoDB, tcVISION features connectivity to other output targets, such as Hadoop (see previous blog about Hadoop support), Adabas LUW, DB2 BLU, and EXASOL. Additionally, new input sources include z/OS VSAM Logstream (CICS and Coupling Facility / Shared VSAM), z/OS VSAM Batch Extension, z/OS DBMS to Logstream, CA IDMS v17, CA Datacom CDC, IMS Active Log, and SMF data.

Find out more about tcVISION — Enterprise ETL and Real-Time Data Replication Through Change Data Capture

tcVISION provides easy and fast data migration for mainframe application modernization projects and enables bi-directional data replication between mainframe, Linux, Unix and Windows platforms.

_0_tcVISION_Simple_Diagram

tcVISION acquires data in bulk or via change data capture methods, including in real time, from virtually any IBM mainframe data source (Software AG Adabas, IBM DB2, IBM VSAM, IBM IMS/DB, CA IDMS, CA Datacom, even sequential files), and transform and deliver to virtually any target. In addition, the same product can extract and replicate data from a variety of non-mainframe sources, including Adabas LUW, Oracle Database, Microsoft SQL Server, IBM DB2 LUW and DB2 BLU, IBM Informix and PostgreSQL.


__TSI_LOGO

Visit the Treehouse Software website for more information on tcVISION, or contact us to discuss your needs.