Treehouse Software Onsite Training Classes are Available

New installation of a Treehouse Software product? New employees? Need a refresher course? Want to explore untapped product features? Three-to-five-day training sessions are available for tRelational / DPS and other Treehouse products.

_0_Software_Training

Treehouse Software training sessions are customized to meet your site’s unique environment and needs. As an example, the following three-day tRelational / DPS training class was conducted at a large University where they are using tRelational / DPS to create an archive of their legacy Adabas data to Oracle in preparation for their upcoming mainframe system retirement.

Over the course of the three-day session, the Treehouse instructor covered:

  • tRelational AUTOGEN feature (auto-generation of complete RDBMS schemata – Tables, Columns, Primary Key, and Foreign Keys – based upon existing ADABAS file structures). AUTOGEN was quite attractive since it will be a very time efficient way to create the Adabas-to-Oracle mappings.
  • The customer wanted to use Relational / DPS to automate as much of the process as possible, and take advantage of the batch functions of tRelational. Generally, the workshops of the class are all online, but in this case, the class ran through one online example after the File Implementation section of the training, and then jumped to the batch section of the training to show how that works. The class then returned to run additional File Implementations, Analysis, and Reporting in batch.
  • The class continued through the Modeling and Mapping section, and ran more batch jobs with some additional Adabas files.
  • Admin and Configuring DPS Parameters sections were next on the agenda. Because of the desire to automate as much as possible, the work focused on how to set up a single job stream that could be generated programmatically, where it was fed in the name of the file to be implemented and then do the AUTOGEN all in the same job. The tRelational AUTOGEN user exit was set up so the customer could identify and cater to the possibility of duplicate table names where multiple Adabas files have the same named MU (like “COMMENTS”); and handle the addition of an ETR (external transformation routine) being automatically added (there were some known HEX values in some fields) and then update the DPSCOLLGTH.
  • The class finished up the Materialization (initial loading of data) training section and then set up the jobs to run Materialization, and installed DPSSPLIT (used to separate the control and data files into one control and one data file per table materialized) on one of their servers. Generally, most class attendees are not the ones responsible for running the Materialization and Propagation (ongoing synchronization of data) jobs, so the instructor doesn’t usually set them up, but in this case, it made sense. The class started out by running the Materialization from a full database ADASAV taken over the weekend. The output of the Materialization job was FTPed to their Server and DPSSPLIT run against it to create the individual loader files. GENDDL (generate the control statements that can be passed to the RDBMS to define the tables and columns) was also run and that output transferred. After setting up the SQL job to process the DDL, the Oracle SQL*LOADER was successfully run to load the data.

Finally, the class went through some additional tRelational / DPS features, and as a final exercise, set up a Propagation job and ran it against a current PLOG just to make sure it worked satisfactorily.


__TSI_LOGO

If you are interested in finding out more about Treehouse training classes for your product, contact Treehouse Software today for more information, or to schedule onsite training.

TREETIP: tcVISION Supports Data Replication to MongoDB

tcVISONv6

The tcVISION cross-system integration platform is a robust, proven, and mature solution that is constantly under development to meet the requirements of new technologies, including support for MongoDB.

mongodb

MongoDB is among the leading NoSQL databases in the market and has been developed for the needs of today’s information technology. MongoDB supports a data model with dynamic schemata and is especially suitable to store large amounts of data using GridFS. It contains automatic failure protection using an integrated replication. MongoDB also offers native, idiomatic drivers for nearly all programming languages and frameworks.

Find out more about MongoDB here: https://www.mongodb.com

In addition to support for MongoDB, tcVISION features connectivity to other output targets, such as Hadoop (see previous blog about Hadoop support), Adabas LUW, DB2 BLU, and EXASOL. Additionally, new input sources include z/OS VSAM Logstream (CICS and Coupling Facility / Shared VSAM), z/OS VSAM Batch Extension, z/OS DBMS to Logstream, CA IDMS v17, CA Datacom CDC, IMS Active Log, and SMF data.

Find out more about tcVISION — Enterprise ETL and Real-Time Data Replication Through Change Data Capture

tcVISION provides easy and fast data migration for mainframe application modernization projects and enables bi-directional data replication between mainframe, Linux, Unix and Windows platforms.

_0_tcVISION_Simple_Diagram

tcVISION acquires data in bulk or via change data capture methods, including in real time, from virtually any IBM mainframe data source (Software AG Adabas, IBM DB2, IBM VSAM, IBM IMS/DB, CA IDMS, CA Datacom, even sequential files), and transform and deliver to virtually any target. In addition, the same product can extract and replicate data from a variety of non-mainframe sources, including Adabas LUW, Oracle Database, Microsoft SQL Server, IBM DB2 LUW and DB2 BLU, IBM Informix and PostgreSQL.


__TSI_LOGO

Visit the Treehouse Software website for more information on tcVISION, or contact us to discuss your needs.

TREETIP: tcVISION Allows for Surprisingly Innovative Uses

tcVISONv6

Treehouse Professional Services consultants help Adabas / Natural customers in a variety of ways, including DBA services, performance tuning, change management implementation and training, and data replication planning and training. Our experience and long history of service to the Adabas / Natural community helps us create innovative solutions for our customers’ challenges.

Recently Treehouse Senior Technical Representative Chris Rudolph assisted a customer with a tricky data replication problem. The customer uses tcVISION to perform bi-directional replication between Adabas and an RDBMS during the phase-in of a new application. Unfortunately, the new application incorrectly updated certain columns in the RDBMS, which were then replicated to Adabas. The customer attempted to address the issue by running a series of ADASEL reports against the Adabas PLOG and manually checking for “bad” transactions, which was a very time consuming process that pulled the Adabas DBA away from her normal duties.

Chris explained that tcVISION could expedite the process by replicating all transactions for the Adabas file to a journal table capturing the “before” and “after” values of the problematic columns. The developers working on the new application could then identify invalid values, correct the application, and patch the data themselves. This also allowed the Adabas DBA to return to their normal duties.

The journal table now includes columns to display the “before” and “after” values of the corrupted column, Adabas transaction time, end transaction time, operation and Adabas userid. The customer’s developers immediately recognized immense value from being able to query the journal table to find bad data, patch the data, prove that corruption is no longer taking place, and verify that all corrupted instances of the data have been patched. Journal tables have been added for all replicated Adabas files, and the developers now rely on the journal tables for all of their data patches.


Find out more about tcVISION — Enterprise ETL and Real-Time Data Replication Through Change Data Capture

tcVISION provides easy and fast data migration for mainframe application modernization projects and enables bi-directional data replication between mainframe, Linux, Unix and Windows platforms.

_0_tcVISION_Simple_Diagram

tcVISION acquires data in bulk or via change data capture methods, including in real time, from virtually any IBM mainframe data source (Software AG Adabas, IBM DB2, IBM VSAM, IBM IMS/DB, CA IDMS, CA Datacom, even sequential files), and transform and deliver to virtually any target. In addition, the same product can extract and replicate data from a variety of non-mainframe sources, including Adabas LUW, Oracle Database, Microsoft SQL Server, IBM DB2 LUW and DB2 BLU, IBM Informix and PostgreSQL.


__TSI_LOGO

Visit the Treehouse Software website for more information on tcVISION, or contact us to discuss your needs.

PRODUCT SPOTLIGHT: tcVISION v6 Overview and Updates

tcVISONv6

Several exciting new features and updates are now in tcVISION v6, including new output targets Adabas LUW, DB2 BLU, EXASOL, Hadoop,and MongoDB. Additionally, new input sources include z/OS VSAM Logstream (CICS and Coupling Facility / Shared VSAM),z/OS VSAM Batch Extension, z/OS DBMS to Logstream, CA IDMS v17, CA Datacom CDC, IMS Active Log and SMF data.

Another feature recently announced is the tcVISION “Direct Loader” for BULK_LOAD processing. The function does not require output to a sequential file, and the loader utility for the target DBMS is called via API with data passed directly. Direct loader supports PostGreSQL, Microsoft SQL Server and DB2 LUW / DB2 BLU. The advantage of using the Direct Loader is the elimination of disk access in writing and reading the sequential loader data file. File output is still supported (e.g., where loader data is to be distributed to other machines).

Finally, as mentioned in a previous Treehouse Blog, with tcVISION v6 comes the newly enhanced web statistics functionality and web server. Any standard web browser can access this server (Internet Explorer, Firefox, Opera, Chrome, Safari, etc.)

This valuable feature enables users to view data from the tcVISION Manager Monitor, and statistical and operational information from the tcVISION Manager network.


Find out more about tcVISION — Enterprise ETL and Real-Time Data Replication Through Change Data Capture

tcVISION provides easy and fast data migration for mainframe application modernization projects and enables bi-directional data replication between mainframe, Linux, Unix and Windows platforms.

_0_tcVISION_Simple_Diagram

Visit the Treehouse Software website for more information on tcVISION, or contact us to discuss your needs.

Join us at the Software AG TechEd User Conference in Austin, Texas

SAG_TechEd_05_2016

The third annual Software AG TechEd User Conference is planned for May 3-4 in Austin, Texas this year. In prior years, this event has developed a reputation for having the best source of technical information in our niche field, as we can learn from our peers and Software AG product experts about best practices, new features and use cases that you can apply on the job, and this year’s conference will be no exception. Of course, there is also the added benefit of being able to network with the largest collection of Adabas/Natural peers in North America.

Register here: http://www.softwareag.com/us/community/usergroup/events/default.asp

In addition to the presentations planned, there will be an Adabas Internals Class offered after the TechEd conference if there is enough interest. This class will be taught by Gene Miklovich with upgraded content for v8. Many people who attended last year’s TechEd conference expressed an interest in this topic, so if you were one of these people and/or are interested in this opportunity, please go to the Software AG Education portal to register.


__TSI_LOGO

 

 

Product Spotlight: AUDITRE

by Joseph Brady, Manager of Marketing and Technical Documentation at Treehouse Software, Inc.

AUDITRE is Treehouse Software‘s generalized auditing facility for Adabas, applicable to a wide variety of use cases. Summary reports show the number of adds, deletes, and updates made to specified files and fields, while detail reports can track specific user activity and updating of individual fields and files. Data may be extracted to output datasets for use with reporting, analysis, and other software. As a batch facility processing the Adabas PLOG, AUDITRE does not require Adabas to be active in order for reports and extracts to be run.

The Adabas Auditing Challenge

Compliance testing presents the biggest challenge to the organization’s Auditors. Compliance testing requires the Auditor to learn if applications use the proper update procedure to change Adabas data. Compliance testing requires a record of exactly what changes an application program made to the database and the order in which the changes took place. Adabas provides no automatic method to generate audit data, making compliance testing difficult. This challenge leads some sites to invest substantial resources in the development of Embedded Audit Routines (EARs).

The Latest…

The new version of AUDITRE (v5.2.1) runs on z/OS and VSE, and can process Adabas protection log (PLOG) data that contains spanned records. What is a spanned record? – Adabas v8 allows a compressed record that exceeds one physical Data Storage Block by splitting the logical record into a number of physical record segments, each part fitting into a single Data Storage (DS) block. A spanned record is comprised of one primary record and one to four secondary records.

AUDITRE’s Function

As illustrated in the following diagram, a batch job or an on-line user executes an Adabas transaction. Adabas updates the physical database components and writes information about the transaction to the Adabas Protection Log.

The information on the Protection Log is voluminous and is not in an easily readable form. AUDITRE processes the Protection Log data.

Taking direction from the Auditor through AUDITRE parameter cards, and input from the Protection Log and the Field Definition Table, AUDITRE makes one pass over the audit data. In this one pass, AUDITRE determines the number and kinds of transactions (Adds, Updates, or Deletes) made and produces multiple reports or outputs the results to a sequential dataset(s) for later processing.

AUDITRE_Main_Diagram

AUDITRE Provides the Best Auditing Solution

AUDITRE requires no additional support systems such as extra programs, “audit exit routines,” or specialized files. Audit reports can be generated on other CPUs at remote sites for security, if desired.

Further, AUDITRE requires minimal installation and training time for the DBA and other users. Creation of new reports requires coding only a few simple parameter statements.

AUDITRE produces clear, organized reports of database modification activity including only the information desired. AUDITRE can base reports on files, fields, sets of fields, and logically related updated files. Reports contain only the files and fields desired. One pass of the Protection Log allows AUDITRE to generate multiple reports simultaneously.

For maximum long-term benefit, selected data or reports can be archived to tape or disk for processing later. This allows audits to occur “after the fact” for certain critical systems if Auditors later discover a problem.

AUDITRE Makes Adabas Auditing Easier

Consider a Protection Log containing over one million records. Adabas stored these records in a compressed, non-standard form, which makes them difficult to read. The Log contains all updates for all files for all fields (entire records) whether all fields changed or not. Records on the log are ordered chronologically, and are difficult to sort because Adabas stored them in the non-standard form.

Various Adabas utilities display Before and/or After Images of updated records as one large field in character and in hex. However, determining which field(s) changed from such a “dump” is difficult, especially when updates cause different-sized values, or when fields change to/from null values.

Which Organizations Can Benefit from AUDITRE?

AUDITRE can benefit many different types of organizations. For example in the petroleum industry, AUDITRE can verify changes to ownership interests in oil leases. Magazine publishers can use AUDITRE to monitor changes to subscribers’ EXPIRATION-DATEs. Stock brokerages can use AUDITRE to verify that a stock transaction took place as ordered by the client. Colleges and universities can track changes to alumni addresses for fund-raising purposes. Any organization needing a report of changes to Adabas data can find a good use for AUDITRE.

AUDITRE’s archiving capability is useful to many departments in the same organization. The Payroll Department may discover unauthorized salary increases. Meanwhile, the Marketing Department might use summary reports for several months of Protection Log data to determine how many new customers were gained during the year by tracking adds and deletes to the CUSTOMER database. The Purchasing Department could examine RECEIVING data for changes to expected RECEIVING-DATEs, etc., to determine if any suppliers frequently postpone merchandise delivery, causing supply shortages for the organization.

There are many other uses for AUDITRE. If a question can be answered by examining changes to the database, or a problem investigated by reporting on archived update data, AUDITRE can help.

For more comprehensive information on AUDITRE, a Product Overview is available for download from the Treehouse Software website.

Reminder that CA PLEU Customers Can easily Transition to AUDITRE!

If your company uses CA PLEU and/or CA APAS/Insight, you know that support for these products is no longer provided by CA. Treehouse Software extends a special offer to CA APAS/Insight and CA PLEU customers to adopt comparable Treehouse Software solutions, and enjoy the assurance of our commitment to supporting and updating AUDITRE (as well as TRIM, NatCDCSP, NatQuery, and our other solutions that complement ADABAS and NATURAL).

AUDITRE has features that specifically aid in a customer’s transition from CA PLEU, including:

  • Previous releases of AUDITRE limited the total size of the Protection Log Compressed Data Record Fields to be printed to 32K. AUDITRE now runs above the line, removing this limit.
  • AUDITRE was updated to allow sites to route detail and summary statistics to a separate file.
  • New analysis parameters allow specification of a begin point (STARTDATE/STARTTIME), which adds additional flexibility to the PLOG extract process.
  • Additionally, we recently assisted a longtime CA PLEU site in converting their existing CA PLEU extract to an AUDITRE extract, which provided identical results!

Treehouse Software representatives are ready to help you implement our solutions to address your key requirements, and at specially discounted pricing.

Not currently using CA APAS/Insight or CA PLEU? You’re in luck, because we’ll extend our same special pricing offers to you as well!


__TSI_LOGO

Visit the Treehouse Software website, or contact us to discuss your needs.

PRODUCT SPOTLIGHT: tcACCESS

Transparent integration of mainframe data sources and mainframe programs into LUW applications

__tcACCESS_Cubes

tcACCESS is a comprehensive software solution that enables two-way integration between IBM mainframe systems and client/server, Web and SOA technologies — without the need for mainframe knowledge or programming effort. tcACCESS is a proven platform that facilitates SQL-based integration of mainframe data sources and programs into LUW applications using industry standards such as SQL, ODBC, JDBC, and .NET. SQL queries to access mainframe data can be easily created using drag and drop techniques — no programming required. Read More


__TSI_LOGO

Subscribe to Treehouse Software’s Monthly eBulletin