Data Express
Publications
Readme
System Requirements
Windows
z/OS
Extension Technology
Installation Notes
New Features
Updates and Product Support
Known Issues and Restrictions
Supplementary Information
Supported Character Encoding Systems
Supported Data Types
Data Type Restrictions
ADABAS Restrictions
Oracle Restrictions
DB2 for z/OS Environment Restrictions
AS/400 Data Stores
Readme Help
Contact Information
Installation Guide
Who Should Read This Guide
z/OS System Procedures
Installation Media
Installation Phases
New Software Installation Procedures
Allocate the Installation Sequential Data Set
Copy JCL Files to the Mainframe
Copy the Installation Data Set to the Mainframe
Allocate and Load the Installation PDS
Set Installation Parameters
Install the Data Set Libraries
Update the User Profile
Create the Database
Populate the Database
Enable Data Express for z/OS
Panels
Get Request Key
Apply Response Key
Display Enabled Options
Install Updates
Software Upgrade
Toolkit Installation
Installing Data Express Into Multiple DB2 Subsystems
Who Should Read This Information
Installation Cloning
Cloning Phases
Cloning a Database
Cloning Environment Libraries
Enabling a New Cloned Environment
Panels
Obtaining a Request Key
Applying the Response Key
Displaying Enabled Options
Install PTFs
Customization Reference
FTP Script Customization
FTP Script (ftpput.txt) Customization
FTP BAT File (ftpput.bat) Customization
PC3270 Transfer File List (inst.srl) Customization
PC3270 Transfer File List (kbd.srl) Customization
JCL File (iebupdte.jcl) Customization
Distributed Systems Procedures
Windows Installation
Installation Media
Software Setup
Software Update for Windows
UNIX Installation
Unix Software Updates
Getting Started with Distributed Data Stores
Using Distributed Data Stores with Data Express
DBA Tasks for Extension Technology
New Installations
Data Express Upgrades
Required Run-Time Knowledge Base Updates
Centralized Run-Time Knowledge Base for the ODBC Extension
Using Distributed Loader
Loading Data Store Information
Load from Database
Load from File
Limited Life Cycle Support
Use of Data Analysis (Sampling) for Class Assignment
Importing Classes
Data Dictionary
Referential Integrity
Sampling Results
Creating Referential Integrity Methods
Data Express for z/OS
Data Express for Distributed Systems
Using Distributed Exporter
Data Masking
Data Subset Extraction
SQL Files Generated by Distributed Exporter
Using Distributed Sampler
Sampling Options
Validation
Load results from file
Using Extension Technology
Extension Technology Configuration
Extension Technology Configuration File
Data Store SQL Scripts
DXCOMMON Environment Variable
Extension Technology Directories
Invoking Extension Technology
The dxestart command
Execution Modes
Error Diagnosis
Masking Routines
C
COBOL
Extension Technology Utilities
Creating an Encoded Connection File
Batch Distributed Exporter
Data Express for Distributed Data Stores Tutorials
Using Data Express
Preparation
Sample Session
Data Inventory
Sample Session
Data Masking
Sample Session
Simple Data Subset Extraction
Sample Session
Data Subset Extraction using Referential Integrity
Sample Session
Data Subset Extraction Using a Combined Data Element
Creating a Combined Data Element
Creating a Class on a Combined Data Element
Associating a Class with a Combined Data Element
Modifying a Referential Integrity Method to Use a Combined Data Element as a Selection Class
Exporting a Referential Integrity Method to Extension Technology
Executing Referential Integrity Method
Verifying Results
Simple Sampling
Sample Session
Data Generation
Catalog and Classify Tables
Start the Data Generation Module
Create Simple Data Generation Code
Execute a Simple Data Generation Law
Verify Results
Oracle Alias Creation
Oracle Wallet
Implementing Oracle Wallet Support
Getting Started with z/OS Data Stores
Product Components
Using z/OS Data Stores
Data Express for z/OS Tutorials
Sample Sessions
DB2 Data Stores Session
Importing JCL Job Streams into Your Mainframe Environment
Creating the DB2 Tablespace and Tables
Starting Data Builder
Setting Your Workspace
Loading Data Store Information into Your Mainframe Environment
Sequential Files Session
Importing the JCL CREASEQS into Your Mainframe Environment
Importing the Sequential File and Copybook Information into Your Mainframe Environment
Starting Data Builder
Setting Your Workspace
Loading Copybook Information into Your Mainframe Environment
Loading Data Store Information into Your Mainframe Environment
Data Masking
DB2 Data Stores Session
Associating Supplied Masking Classes to Data Elements
Starting the Data Masking Module
Enabling Masking on the DB2 Table CUSTOMER
Submitting a JCL to Mask Customer First and Last Names
Creating a Class
Associating a Class to Data Elements
Enabling Masking on the DB2 Table CUSTOMER for the CODCUS Class
Submitting a JCL to Mask Customer IDs
Sequential Files Session
Associating Supplied Classes to Data Elements
Starting the Data Masking Module
Enabling Masking on the Sequential File CUSTOMER and NAME and SURNAME classes
Submitting a JCL to Mask Customer First and Last Names
Simple Data Subset Extraction
DB2 Data Stores Session
Associating a Class to a Data Element
Starting Data Subset Extraction
Creating a Group
Creating a Simple Method within a Group
Submitting a JCL to Subset Customer Names
Sequential Files Session
Associating a Class to a Data Element
Starting Data Subset Extraction
Creating a Group
Creating a Simple Method within a Group
Submitting a JCL to Subset Customer Names
Data Subset Extraction using Referential Integrity and Combined Data Elements
Creating the HSURDRIA table
Importing Referential Integrity Classes
Assigning Estimated Classes
Verifying Combined Data Element Information
Creating a Referential Integrity Method
Editing Method Properties
Submitting a JCL to Create the Test Environment
Data Element Sampling
Submitting a JCL to Perform Sampling
Verifying Results
Creating a Sampling Class
Associating a Fingerprint to a Class
Associating a Class to Data Elements
Data Generation
Catalog and Classify Tables
Start the Data Generation Module
Create Simple Data Generation Code
Execute a Simple Data Generation Law
Verify Results
Managing XML and Large-object Columns
Load and Classification
Masking
XML Tag Identifiers
Provided Templates
XML Masking Template UDCXML1
Dummy Masking Template UDCXML0
LOB/BLOB/CLOB Masking Template UDCLOB1
Data Masking Guide
Who Should Read this Guide
Data Masking Considerations
Getting Started
General Characteristics of Use
Starting Data Masking
Menus and Toolbars
File Menu
Tools Menu
View Menu
Windows Menu
Help Menu
Toolbar
Context Menus
Column Sorting
Grid Functions
Data Masking Main Window
Introduction
Window Components
Machine ID./Company Grid
All Machine ID./Companies
Multiple Class Selection
Object Distribution
Column Headings in the Grid Area
Available Grid Operations
Data Changer Data Store Properties
Introduction
Window Contents
General Attributes
System
Object Attributes
Dates
Assigned Copybook
Data Changer Data Element Selection
Introduction
Window Contents
Data Store Information
Icon Bar
List of Data Elements
Data Changer Data Element Properties
Introduction
General Data Element Properties
Additional Data Element Properties
Data Changer - Work with Classes
Introduction
Window Contents
Available Operations
Data Changer Properties
Introduction
Window Contents
Available operations
Set Application ID
Introduction
Window Contents
Available Operations
Define Unload Output Data Store
Introduction
Window Contents
Available Operations
Options
Introduction
General Options
Connection Options
Work with Data Changer Jobs
Introduction
Data Store Data Changer Job Creation
Create Data Changer Job Creation
Available Operations
Distributed Exporter
Window Contents
Available Operations
Exit Routines
Writing Exit Routines
Writing Routine Parameters
Discard Exit Routines
Discard Routine Parameters
UDCUSSL Discard Exit Routine Example
Modification Exit Routines
Predefined Modification Exit Routines List
Modification Exit Routines Parameters
Logging Exit Routines
Predefined Masking and Logging Exit Routines List
Masking Routine UDCMASPG - Prototype
Masking Routine UDCLOGPG – Prototype
Logging Table HSLOGTAB
Appendix A: COBOL Masking Routines Technical Description
A.1. Masking Routines Interface
A.2. Interface Source
A.2.1. Data Express for z/OS
A.2.2. Data Express for Distributed Systems
A.3. Interface Description
A.4. UR-ACTION Values
Appendix B: C Masking Routines for ODBC - Technical Description
Appendix C: C Masking Routines for OCI - Technical Description
Data Model Guide
Table and Column Descriptions
ANDCHFLF
ANENVDLS
ANENVLST
ANLICCHG
ANLICLOG
ANURDCLA
ANURDFLC
ANURDFLF
ANURDFLN
ANURDFXC
ANURDFXF
ANURDIMC
ANURDIMG
ANURDIXC
ANURDLOG
ANURDRFC
ANURDSNC
ANURDSPE
ANURDSPN
ANURDSTR
DDDTMCOL
DDDTMDEC
DDDTMREF
DDDTMSTQ
DDDTMTAG
HSDCHCLA
HSDCHFIL
HSDGNCOD
HSDGNDIR
HSDGNDIZ
HSDGNFIL
HSDGNFLT
HSDGNLAW
HSENVELB
HSENVEXT
HSENVFLT
HSENVGRP
HSENVLMT
HSENVMTH
HSENVPAR
HSENVPRN
HSENVRRD
HSENVRRH
HSENVSTP
HSLICCHG
HSLICFIL
HSLICFLD
HSLICFTF
HSLICLID
HSLICSCD
HSLICSTR
HSLOGTAB
HSSYSAUX
HSSYSCKS
HSSYSCOL
HSSYSDAU
HSSYSDBA
HSSYSDEP
HSSYSFKE
HSSYSIND
HSSYSIPA
HSSYSKEY
HSSYSRAU
HSSYSREL
HSSYSSYN
HSSYSTAB
HSSYSTAU
HSSYSTPA
HSSYSTSP
HSSYSVDE
HSSYSVIE
HSURDAPP
HSURDAUT
HSURDCAR
HSURDCJD
HSURDCJH
HSURDCLA
HSURDCOL
HSURDCOM
HSURDCPY
HSURDDFT
HSURDEKY
HSURDEXT
HSURDFIL
HSURDFIN
HSURDINT
HSURDICP
HSURDJOB
HSURDKEY
HSURDLIC
HSURDLOG
HSURDMF
HSURDMFD
HSURDMID
HSURDNCC
HSURDPID
HSURDPRG
HSURDPRO
HSURDROU
HSURDSYC
HSURDSYT
HSURDUE
HSURDUEV
HSURDUSR
MSURDLOG
USDCHADD
USDCHCOM
USDCHEMA
USDCHNAC
USDCHNAM
USDCHSUC
USDCHSUR
USURDCBE
USURDCBZ
USURDDBM
USURDFLC
USURDIMP
USURDRIR
V1DCHFIL
V1DCHFLF
V1REP01
V1REP02
V1REP03
V1REP04
V1REP05
V1REP06
V1REP07
V1REP08
V1REP09
V1REP10
V1REP11
V1REP12
V1REP13
V1REP14
V1REP15
V1URDCPY
V1URDFIL
V1URDFLF
V1URDIMC
V1URDIMG
V1URDLOG
V1URDRFC
V2URDFLF
V3URDFLF
XPURDFLC
Sequential Files
Class List Interface
Combined List Interface
DB2 Catalog Synchronization Information
DB2 Catalog Synchronization - HEADER
DB2 Catalog Synchronization - INTERNAL KEY
DB2 Catalog Synchronization - EXTERNAL KEY
DB2 Catalog Synchronization - IMAGE COPY
Load Copy Information from External Interface
Flag replace Parameter
Flag associate Parameter
Copy Tolerance Parameter
COBOL Decimal Seperator Parameter
Maximum Progressive of I/O Area Parameter
Statement Length in PL/I Source Parameter
Load Data Store Information from External Interface
DB2 Databases
Direct Access – API Load Sequential File
Direct Access – HEADER
Direct Access – DETAIL
Access from Unload
VSAM Databases
Sequential and GDG Databases
DL/I Databases
ADABAS Data Stores
ADABAS – API Load Sequential File - HEADER
ADABAS Data Store – DETAIL
Load Referential Integrity Relation Information
Import Classification from Data Dictionary
IMPSRC - Modified Sources
HEADER
DETAIL
Method List Interface
Multi-format List Interface
Data Subset Extraction Guide
Who should read this guide
Data Subset Extraction considerations
Getting Started
General characteristics of use
Starting Data Subset Extraction
Menus
Context menus
Column sorting
Grid functions
Introduction to Data Subset Extraction window
Window components
Node pane
Icons
Context menu
Column headers by group
List of groups
List of methods in group
List of Steps in Method Group
Column headers by creator
List of creators
List of methods created by
List of steps in method creator
Work with Groups
Introduction to Work with Groups
Window contents
Available operations
New Method wizard
Introduction to New Method wizard
Creating a new method
Definition of general method characteristics
Definition of primary extraction criteria
Definition of relationship criteria
Available operations
Work with Method
Introduction to the Work with Method area
Method Confirmation phase
Method elaboration
Method Activation phase
Extraction Batch Job Launch phase
Fields
Steps context menu
Tabs
Elaborations
Column headings tabs
Context menu tabs
Excluded files
Column headings
Context menu
Method overview
Warnings
Available operations
Method confirmation
Work with Method selection class/filter properties
Introduction to selection class/filter properties
Window contents
Column headings in top grid
Global filter fields
Filter types
Filter type properties
Work with Method work with steps
Introduction Work with Method work with steps
Window contents
Display mode
Insert mode
Available operations
Work with Method method properties
Introduction to Work with Method method properties
Window contents
Available operations
Method activation
Work with Method elaboration properties
Introduction to Work with Method elaboration properties
Window contents
Method’s description
Elaboration’s description
Available operations
Work with Method define reload rules
Introduction to Work with Method define reload rules
Window contents
Available operations
Create reload jobs from reload rules
Job creation
Available operations
JCL information
Options
Introduction to Options
Window contents
General
Server information
Available operations
Data subset extraction jobs
Introduction to data subset extraction jobs
Job creation
Test environment creation
Create allocation jobs
Job creation
JCL information
Create unload jobs
Job creation
JCL information
Create extraction jobs
Job creation
JCL information
Create reload jobs
Job creation
JCL information
Available operations
Distributed Exporter
Window contents
Available operations
Distributed Statistics Loader
Window contents
Available operations
Work with Method multiple filters
Introduction to Work with Method multiple filters
More than one single filter for the same data store
Filter types
Filter examples more than one single filter
More than one combined filter involving more than one data element
Filter types
Filter examples more than one data element
Error Messages
Error Message Format
Mainframe Messages WRC0001 to WRC0199
Mainframe Messages WRC0200 to WRC0299
Mainframe Messages WRC0300 to WRC0399
Mainframe Messages WRC0400 to WRC0499
Mainframe Messages WRC0500 to WRC0599
Mainframe Messages WRC2000 to WRC4999
Data Express Extension Messages
Front End Guide
General Features
Considerations
Getting Started with Data Builder
General characteristics of use
Starting the Data Builder module
Work environment settings
Machine identifier creation
Company creation
Application identifier creation
Default environment parameter settings selection
Analysis parameter modification
Default copy analysis parameter modification
Database interface specification
Database access modes
Process identifier and database types relationships
Main functions - phase execution
Menus
File menu
Tools menu
Environment menu
View menu
Windows menu
Help menu
Context menu
Column sorting
Grid functions
Main Window - Work with Data Stores
Window pages
Structure page
Classes page
Assigned to Copy page
Sampling page
Data Changer page
Button bar
Column headings
Context menu
Properties- File
Register Tables page
Button bar
Context menu
Custom Query page
Column headings in the grid area
Available grid operations
Work with Data Store Window
Window contents
Node pane
Grid
Data Elements columns
Associated Copybook columns
Associated Copybook - CopybookName columns
Assigned Classes columns
Sampling columns
Sampling – DataElementName columns
Context menu
Data element properties
Assign an Application ID Window
Window contents - Assign Single
Window contents - Assign Multiple
Add to Combined Data Element Window
Combined data element requirements and limitations
Available operations
Work with Classes
Work with Classes window
Work with Machine IDs
Work with Machine IDs window
Work with Companies
Window contents
Available operations
Work with Application IDs
Window contents
Available operations
Work with Routines
Window contents
Available operations
Work with Process IDs
Window contents
Available operations
Work with Data Elements
Window contents
Select Data Elements page
Available Filters area
Data Element Attributes page
Naming Convention page
Data Store Attributes page
Data Element Class page
Available operations
Classes - Assignment page
All classes hierarchy
Class Attributes area
Available operations
Estimated Classes - Confirm page
Class Attributes area
Selected Data Element Attributes area
Data Element page
Data Store page
General page
Date page
Available operations
Work with Jobs
Window contents
List of Jobs grid
List of Scheduled Jobs grid
Window fields
Available operations
Job creation
Class Field Assignment job
Sections and fields
Available operations
Create Deletion Statements
Create Format Selector job
DB2 Catalog Synchronization job
Data Store / Copybook Relationship Analysis job
Data Store Data Element Sampling job
Export Class Assignment Information
Export Classes Information
Export Combined Data Elements Information
Export Copybook Information
Export Data Store Information
Export DB2 Table Information
Export Methods Information
Export Multi-format Data Stores Information
Load Distributed Sampling Results job
Import Classes Information
Import Classification from Data Dictionary job
Import Classification from Referential Integrity job
Import Combined Data Elements Information
Import Method from Referential Integrity job
Import Methods Information
Import Multi-format Data Stores Information
Load Copy Information from External Interface job
Load DB2 Table Information by Unload job
Load DL/I Database Information job
Load Data Store Information from External Interface job
Load SEQ/GDG Data Set Information job
Load VSAM Data Set Information job
Custom jobs
New Custom Query Wizard
Starting the New Custom Query wizard
Options
Window contents
General
Filter settings
Confirmation messages
Confirmation routine name
Server information
Available operations
File Properties
Window contents
General attributes page
System page
Object attributes page
Dates page
Associated Copybook page
Available operations
Filter by Data Store
Window contents
System page
Object page
Record page
Dates page
Associated Copybook page
Scheduling page
Available operations
Compare Layouts - Copybook
Window contents
Available operations
Sample Graph - Data Sampling
Window contents
Show Synthetic Data Element Contents
Window contents
Work with Copybooks
Window contents
Distributed Loader
Load from database
Load from file
Appendix A. Standard Mode
Architecture
Database connection prerequisite
DB2 database alias creation
Authorizations and privileges
Appendix B. Client / Server Mode
Architecture
Server connection prerequisite
Defining server connection information
Authorizations and privileges
Starting Server-side Executables as Windows Services
Life Cycle Guide
Considerations
Life Cycle Introduction
Life Cycle Phases
Phase 1: Changed Data Stores Identification
Phase 2: Changed Data Elements Identification
Phase 3: Apply Identified Changes
Sequential Steps
Concepts and Terms
Backup Company
Log Files
Working with Life Cycle
Definition of Environment
Work with Companies
New Company Creation
Available Operations
Execute Life Cycle Phase 1
Modification of Guide Files
Work with Changed Data Stores
Case 1 - New copybook is not associated with data store
Case 2 - Existing copybook is associated with an existing data store
Case 3 - Existing copybook is not associated with any data store
Case 4 - New copybook is associated with new data store (for DB2 files only)
Execute Life Cycle Phase 2
Work with Changed Data Elements
Execute Life Cycle Phase 3
Work with Life Cycle Jobs
Introduction
Life Cycle Job Creation
Clear Life Cycle History Job Creation
Available Operations
Process for z/OS Guide
Project Implementation
Data Inventory
Load Copybook Information
Load DB2 Tables
Load ADABAS Data Stores
Load Other Data Stores
Data Classification
Import Classification from Referential Integrity Job
Import Classification from Data Dictionary Job
Manual Association
Data Analysis
DB2 Catalog Synchronization
Data Subsetting
Method Creation
Work with Method Function
Extraction Jobs Submission
Output Flat File
Data Masking
Life Cycle
Phase 1
Phase 2
Phase 3
Image Copy
Starting Data Express for z/OS
Submission Function
GDG Support
z/OS Toolkit Guide
Considerations
Load Sequential File with DB2 Catalog
Load IMPSRC for Life Cycle
DB2 Catalog Synchronization
Create CSV File from Referential Integrity
Load Sequential File with ADABAS FDT Report
Toolkit Tables
Data Generation Guide
Who Should Read This Guide
Before Starting with Data Generation
Getting Started
Mode
Data Generation UI Guidelines
Starting the Data Generation Module
Directive Types
Distributed Exporter Utility
Executing Data Generation
Catalog Distributed Data
Catalog z/OS Data
Classify Data
Define Rules
Export Rules
Execute Rules
Data Generation Jobs
Introduction to Data Generation Jobs
Job Creation
Data Generation Jobs
Create Allocation Jobs
Job Creation
JCL Information
Create Reload Jobs
Job Creation
JCL Information
Glossary
Copyright and Trademarks