Data Exchange Overview
Data Exchange Overview
Documentation Updates
What’s New
Data Exchange Overview
Documentation Updates
What’s New
Unisys Data Exchange Data Exchange Management Studio Help
Introduction
Audience
Overview of Data Exchange Management Studio
Managing Environments
Managing Roles
Managing Users and Groups
Managing Security Profile
Securing Network Connections
Certificate Requirement
Between Data Exchange Windows Components
Between the Data Exchange Windows Components and Internal Databases
Between Enterprise Database Server and Runtime Service
From SQL Server Source to DE Agent for SQL Server
From DE Agent for SQL Server to Runtime Service
From RDMS to Runtime Service for BDT
From RDMS to Runtime Service for CDT
From Runtime Service to the Target SQL Server
From Runtime Service to the Target Oracle Database
From Runtime Service to the Target Kafka Data Store
Changing Certification Validation and Revocation Modes
Viewing Error Descriptions
Introduction
Audience
Overview of Data Exchange Management Studio
Managing Environments
Managing Roles
Managing Users and Groups
Managing Security Profile
Securing Network Connections
Certificate Requirement
Between Data Exchange Windows Components
Between the Data Exchange Windows Components and Internal Databases
Between Enterprise Database Server and Runtime Service
From SQL Server Source to DE Agent for SQL Server
From DE Agent for SQL Server to Runtime Service
From RDMS to Runtime Service for BDT
From RDMS to Runtime Service for CDT
From Runtime Service to the Target SQL Server
From Runtime Service to the Target Oracle Database
From Runtime Service to the Target Kafka Data Store
Changing Certification Validation and Revocation Modes
Viewing Error Descriptions
Installation and Configuration Guide For ClearPath MCP Users
Introduction
Audience
Before You Begin
Planning Data Exchange Installation
Understanding Data Exchange Topology
Installation Requirements
Pre-Installation Considerations
Hardware and Software Requirements
Hardware Requirements
Supported Data Stores
Supported Operating Systems and Prerequisite Software
License Key Requirements
Related Documentation
Installing Data Exchange Management Studio
Installing Data Exchange for Transformations from Enterprise Database Server
Installation Sequence
Copying Agent/Adapter Setup Files
Installing Data Exchange MCP Service (MCP Agent)
Installing Multiple Data Exchange MCP Service (MCP Agent)
Configuring MCP Host
Configuring Maximum Transmission Unit (MTU) on MCP
Implementing Scale Out on MCP Host
Installing Data Exchange for Transformations from SQL Server to Enterprise Database Server
Installation Sequence
Installing Data Exchange Agent for SQL Server
Copying Agent/Adapter Setup Files
Installing Data Exchange MCP Service (DMSII Adapter)
Enabling Change Data Capture for SQL Server Database and Tables
Installing Data Exchange Windows Components
Prerequisites
Installing Multiple Versions of Data Exchange Components
Installing Data Exchange Development Workbench
Installing Data Exchange Runtime Administration
Installing Data Exchange Runtime Service
Uninstalling Data Exchange Windows Components
Migrating Transformations
Controlling Access to DEMS and Administration Site
Installing and Configuring SSL Certificate
Enabling HTTPS for Administration Site and DEMS
Sequence of Tasks to Perform a Transformation
Firewall Rules for Ports
Introduction
Audience
Before You Begin
Planning Data Exchange Installation
Understanding Data Exchange Topology
Installation Requirements
Pre-Installation Considerations
Hardware and Software Requirements
Hardware Requirements
Supported Data Stores
Supported Operating Systems and Prerequisite Software
License Key Requirements
Related Documentation
Installing Data Exchange Management Studio
Installing Data Exchange for Transformations from Enterprise Database Server
Installation Sequence
Copying Agent/Adapter Setup Files
Installing Data Exchange MCP Service (MCP Agent)
Installing Multiple Data Exchange MCP Service (MCP Agent)
Configuring MCP Host
Configuring Maximum Transmission Unit (MTU) on MCP
Implementing Scale Out on MCP Host
Installing Data Exchange for Transformations from SQL Server to Enterprise Database Server
Installation Sequence
Installing Data Exchange Agent for SQL Server
Copying Agent/Adapter Setup Files
Installing Data Exchange MCP Service (DMSII Adapter)
Enabling Change Data Capture for SQL Server Database and Tables
Installing Data Exchange Windows Components
Prerequisites
Installing Multiple Versions of Data Exchange Components
Installing Data Exchange Development Workbench
Installing Data Exchange Runtime Administration
Installing Data Exchange Runtime Service
Uninstalling Data Exchange Windows Components
Migrating Transformations
Controlling Access to DEMS and Administration Site
Installing and Configuring SSL Certificate
Enabling HTTPS for Administration Site and DEMS
Sequence of Tasks to Perform a Transformation
Firewall Rules for Ports
Installation and Configuration Guide For ClearPath OS 2200 Users
Introduction
Audience
Before You Begin
Planning Data Exchange Installation
Understanding Data Exchange Topology
Installation Requirements
Pre-Installation Considerations
Hardware and Software Requirements
Hardware Requirements
Supported Data Stores
Supported Operating Systems and Prerequisite Software
License Key Requirements
Related Documentation
Installing Data Exchange Management Studio
Installing Data Exchange for Transformations from RDMS
Installation Sequence
Copying OS 2200 Agent Setup Files
Installing Data Exchange OS 2200 Agent
Installing Multiple Data Exchange OS 2200 Agents
Configuring OS 2200 Host
Configuring Maximum Transmission Unit (MTU) on OS 2200
Host Configuration File
CONFIG$ Element
Profile Element
Console Operations for Director and Agent
Configuring Audit Trail
Updating RDMS Catalog
Configuring a User ID for the Director
Enabling Data Exchange Runtime for RDMS Schemas
Data Exchange Runstreams
Host Files Created by Data Exchange
Installing Data Exchange Windows Components
Prerequisites
Installing Multiple Versions of Data Exchange Components
Installing Data Exchange Development Workbench
Installing Data Exchange Runtime Administration
Installing Data Exchange Runtime Service
Uninstalling Data Exchange Windows Components
Migrating Transformations
Controlling Access to DEMS and Administration Site
Installing and Configuring SSL Certificate
Enabling HTTPS for Administration Site and DEMS
Sequence of Tasks to Perform a Transformation
Firewall Rules for Ports
Introduction
Audience
Before You Begin
Planning Data Exchange Installation
Understanding Data Exchange Topology
Installation Requirements
Pre-Installation Considerations
Hardware and Software Requirements
Hardware Requirements
Supported Data Stores
Supported Operating Systems and Prerequisite Software
License Key Requirements
Related Documentation
Installing Data Exchange Management Studio
Installing Data Exchange for Transformations from RDMS
Installation Sequence
Copying OS 2200 Agent Setup Files
Installing Data Exchange OS 2200 Agent
Installing Multiple Data Exchange OS 2200 Agents
Configuring OS 2200 Host
Configuring Maximum Transmission Unit (MTU) on OS 2200
Host Configuration File
CONFIG$ Element
Profile Element
Console Operations for Director and Agent
Configuring Audit Trail
Updating RDMS Catalog
Configuring a User ID for the Director
Enabling Data Exchange Runtime for RDMS Schemas
Data Exchange Runstreams
Host Files Created by Data Exchange
Installing Data Exchange Windows Components
Prerequisites
Installing Multiple Versions of Data Exchange Components
Installing Data Exchange Development Workbench
Installing Data Exchange Runtime Administration
Installing Data Exchange Runtime Service
Uninstalling Data Exchange Windows Components
Migrating Transformations
Controlling Access to DEMS and Administration Site
Installing and Configuring SSL Certificate
Enabling HTTPS for Administration Site and DEMS
Sequence of Tasks to Perform a Transformation
Firewall Rules for Ports
Data Exchange Development Workbench Administration and Operations Help
Introduction to Data Exchange Development Workbench
Data Exchange Development Workbench Terminologies
Schema
Classifier
ClassifierMap Designer
Feature
FeatureMap Designer
Expression
Data Exchange Development Workbench Repository
Transformation
Transformation Source
Transformation Target
Data Exchange Development Workbench User Interface
Customizing the Data Exchange Development Workbench User Interface
Customizing the Data Exchange Development Workbench Window
Customizing the Schema View
Connecting to a Data Exchange Development Workbench Repository
Creating a New Data Exchange Development Workbench Repository
Connecting to an Existing Data Exchange Development Workbench Repository
Migrating the Data Exchange Development Workbench Repository
Managing Schemas
Loading Schemas into a Data Exchange Development Workbench Repository
Loading Enterprise Database Server Schema
Loading RDMS Schema
Loading SQL Server Database Schema
Loading Oracle Database Schema
Loading XSD File
Updating Data Store Schemas
Updating Enterprise Database Server Schema
Updating RDMS Schema
Updating SQL Server Database Schema
Updating Oracle Database Schema
Updating XSD Schema
Deleting Data Store Schemas
Changing Login Credentials
Changing Login Credentials for Enterprise Database Server Schema
Changing Login Credentials for RDMS Schema
Changing Login Credentials for SQL Server Schema
Changing Login Credentials for Oracle Database Schema
Managing Transformations
Creating New Transformations
Defining Mappings in Transformations
Auto Mapping Classifiers and Features
Auto Mapping for Occurs Item
Defining Mappings from Enterprise Database Server as the Transformation Source
Mapping Enterprise Database Server Classifiers
Mapping Enterprise Database Server Features
Defining Mappings from RDMS as the Transformation Source
Mapping RDMS Classifiers
RDMS Table Versions in Schema View
Mapping RDMS Features
Defining Mappings from SQL Server as the Transformation Source
Mapping SQL Server Classifiers
Mapping SQL Server Features
Interpreting the Color of the Connection Arrows
Auto Aligning Classifiers
Search Option in DDW
Setting Classifier Filter Conditions
Defining Expressions
System Variables
Extended Features
Operators
System Functions
User-Defined Functions
Developing User-Defined Functions
Using User-Defined Functions
Configuring DML Command Substitution
Relationship Between Transformation Level and Classifier Level Command Mapping
Configuring DML Command Substitution at Transformation Level
Configuring DML Command Substitution at Classifier Level
Example Scenarios
Sorting Transformations
Editing Transformations
Viewing Schema Details
Importing Transformations
Resolving Transformation ID Conflict
Resolving Transformation Name Conflict
Migrating XML File
Exporting Transformations
Creating Duplicate Transformations
Merging Transformations
Deleting Transformations
Redirecting Transformation Data Store Schema
Data Transform Error Handling Policy
Configuring Data Transform Error Handling Policy at Transformation Level
Configuring Data Transform Error Handling Policy at Classifier Level
Validating Transformations
Validating a Transformation
Validating All Transformations
Deploying Transformations
Supported and Unsupported Mappings between Data Types
Interpreting Mapping Compatibility between Data Types
Supported and Unsupported Mappings from Enterprise Database Server to SQL Server
Supported and Unsupported Mappings from RDMS to SQL Server
Supported and Unsupported Mappings from SQL Server to Enterprise Database Server
Supported and Unsupported Mappings from Enterprise Database Server to Oracle Database
Supported and Unsupported Mappings from RDMS to Oracle Database
Supported and Unsupported Mappings from Enterprise Database Server to Kafka
Supported and Unsupported Mappings from RDMS to Kafka
Transformation Rules, Errors, and Warnings
General Rules
Transformation Errors and Warnings
Troubleshooting
Common Errors and Possible Solutions
Configuring Log Files
Load Schema
Import Transformation
Export Transformation
Load User-Defined Functions
Supporting Kafka as a Target
Kafka Message Format for Different Operations in RDMS
XSD Schema Structure File and JSON Format
Generating Helper Classes for Consumer
Introduction to Data Exchange Development Workbench
Data Exchange Development Workbench Terminologies
Schema
Classifier
ClassifierMap Designer
Feature
FeatureMap Designer
Expression
Data Exchange Development Workbench Repository
Transformation
Transformation Source
Transformation Target
Data Exchange Development Workbench User Interface
Customizing the Data Exchange Development Workbench User Interface
Customizing the Data Exchange Development Workbench Window
Customizing the Schema View
Connecting to a Data Exchange Development Workbench Repository
Creating a New Data Exchange Development Workbench Repository
Connecting to an Existing Data Exchange Development Workbench Repository
Migrating the Data Exchange Development Workbench Repository
Managing Schemas
Loading Schemas into a Data Exchange Development Workbench Repository
Loading Enterprise Database Server Schema
Loading RDMS Schema
Loading SQL Server Database Schema
Loading Oracle Database Schema
Loading XSD File
Updating Data Store Schemas
Updating Enterprise Database Server Schema
Updating RDMS Schema
Updating SQL Server Database Schema
Updating Oracle Database Schema
Updating XSD Schema
Deleting Data Store Schemas
Changing Login Credentials
Changing Login Credentials for Enterprise Database Server Schema
Changing Login Credentials for RDMS Schema
Changing Login Credentials for SQL Server Schema
Changing Login Credentials for Oracle Database Schema
Managing Transformations
Creating New Transformations
Defining Mappings in Transformations
Auto Mapping Classifiers and Features
Auto Mapping for Occurs Item
Defining Mappings from Enterprise Database Server as the Transformation Source
Mapping Enterprise Database Server Classifiers
Mapping Enterprise Database Server Features
Defining Mappings from RDMS as the Transformation Source
Mapping RDMS Classifiers
RDMS Table Versions in Schema View
Mapping RDMS Features
Defining Mappings from SQL Server as the Transformation Source
Mapping SQL Server Classifiers
Mapping SQL Server Features
Interpreting the Color of the Connection Arrows
Auto Aligning Classifiers
Search Option in DDW
Setting Classifier Filter Conditions
Defining Expressions
System Variables
Extended Features
Operators
System Functions
User-Defined Functions
Developing User-Defined Functions
Using User-Defined Functions
Configuring DML Command Substitution
Relationship Between Transformation Level and Classifier Level Command Mapping
Configuring DML Command Substitution at Transformation Level
Configuring DML Command Substitution at Classifier Level
Example Scenarios
Sorting Transformations
Editing Transformations
Viewing Schema Details
Importing Transformations
Resolving Transformation ID Conflict
Resolving Transformation Name Conflict
Migrating XML File
Exporting Transformations
Creating Duplicate Transformations
Merging Transformations
Deleting Transformations
Redirecting Transformation Data Store Schema
Data Transform Error Handling Policy
Configuring Data Transform Error Handling Policy at Transformation Level
Configuring Data Transform Error Handling Policy at Classifier Level
Validating Transformations
Validating a Transformation
Validating All Transformations
Deploying Transformations
Supported and Unsupported Mappings between Data Types
Interpreting Mapping Compatibility between Data Types
Supported and Unsupported Mappings from Enterprise Database Server to SQL Server
Supported and Unsupported Mappings from RDMS to SQL Server
Supported and Unsupported Mappings from SQL Server to Enterprise Database Server
Supported and Unsupported Mappings from Enterprise Database Server to Oracle Database
Supported and Unsupported Mappings from RDMS to Oracle Database
Supported and Unsupported Mappings from Enterprise Database Server to Kafka
Supported and Unsupported Mappings from RDMS to Kafka
Transformation Rules, Errors, and Warnings
General Rules
Transformation Errors and Warnings
Troubleshooting
Common Errors and Possible Solutions
Configuring Log Files
Load Schema
Import Transformation
Export Transformation
Load User-Defined Functions
Supporting Kafka as a Target
Kafka Message Format for Different Operations in RDMS
XSD Schema Structure File and JSON Format
Generating Helper Classes for Consumer
Data Exchange Runtime Components Administration and Operations Help
Introduction
Overview of Runtime Components
Data Exchange Administration Site
Data Exchange Administrative Service
Data Exchange Runtime Service
Data Exchange MCP Service
Data Exchange MCP Agent
Data Exchange DMSII Adapter
Data Exchange OS 2200 Agent
Data Exchange Agent for SQL Server
Overview of Data Exchange Management Studio
Getting Started
Understanding the Runtime Transformation Concepts
Navigating the Runtime Administration Site Interface
Accessing the Runtime Administration Site Interface
Administration Site User Interface Layout
Manage
Events and Errors
Help
Info Pane
Configuring the Runtime Administration
Viewing System Settings
Configuring Recovery Settings
Configuring Statistics Settings
Setting Log Levels
Configuring the Runtime Service
Configuring Error Handling
Comparison in Error Handling
Kanji and Gaiji Support
Managing Transformations
Downloading Transformations
Deleting Transformations
Performing Bulk Data Transformation
Performing Bulk Data Transformation with Enterprise Database Server as the Transformation Source
Performing Bulk Data Transformation with RDMS as the Transformation Source
Performing Bulk Data Transformation with SQL Server as the Transformation Source
Stopping Bulk Data Transformation
Performing Changed Data Transformation
Performing Changed Data Transformation with Enterprise Database Server as the Transformation Source
Performing Changed Data Transformation with RDMS as the Transformation Source
Performing Changed Data Transformation with SQL Server as the Transformation Source
Stopping Changed Data Transformation
Viewing the Status of Data Exchange Runtime Components
Status on the Summary Tab
Status on the Transformations Tab
Status on the Transformation Targets Tab
Status on the Statistics Page
Understanding the Processing Rate Graph
Monitoring the Transformation
IIS Manager
Statistics
Events
Troubleshooting
Runtime Log Files
Configuring Log Files
Runtime Service
Administrative Service
Agents
Common Errors and Possible Solutions
Bulk Data Transformation Errors
MCP
OS 2200
SQL Server
Changed Data Transformation Errors
MCP
OS 2200
SQL Server
Introduction
Overview of Runtime Components
Data Exchange Administration Site
Data Exchange Administrative Service
Data Exchange Runtime Service
Data Exchange MCP Service
Data Exchange MCP Agent
Data Exchange DMSII Adapter
Data Exchange OS 2200 Agent
Data Exchange Agent for SQL Server
Overview of Data Exchange Management Studio
Getting Started
Understanding the Runtime Transformation Concepts
Navigating the Runtime Administration Site Interface
Accessing the Runtime Administration Site Interface
Administration Site User Interface Layout
Manage
Events and Errors
Help
Info Pane
Configuring the Runtime Administration
Viewing System Settings
Configuring Recovery Settings
Configuring Statistics Settings
Setting Log Levels
Configuring the Runtime Service
Configuring Error Handling
Comparison in Error Handling
Kanji and Gaiji Support
Managing Transformations
Downloading Transformations
Deleting Transformations
Performing Bulk Data Transformation
Performing Bulk Data Transformation with Enterprise Database Server as the Transformation Source
Performing Bulk Data Transformation with RDMS as the Transformation Source
Performing Bulk Data Transformation with SQL Server as the Transformation Source
Stopping Bulk Data Transformation
Performing Changed Data Transformation
Performing Changed Data Transformation with Enterprise Database Server as the Transformation Source
Performing Changed Data Transformation with RDMS as the Transformation Source
Performing Changed Data Transformation with SQL Server as the Transformation Source
Stopping Changed Data Transformation
Viewing the Status of Data Exchange Runtime Components
Status on the Summary Tab
Status on the Transformations Tab
Status on the Transformation Targets Tab
Status on the Statistics Page
Understanding the Processing Rate Graph
Monitoring the Transformation
IIS Manager
Statistics
Events
Troubleshooting
Runtime Log Files
Configuring Log Files
Runtime Service
Administrative Service
Agents
Common Errors and Possible Solutions
Bulk Data Transformation Errors
MCP
OS 2200
SQL Server
Changed Data Transformation Errors
MCP
OS 2200
SQL Server
Using the Information Center
Navigating through the Information Center
Searching for Information
Providing Feedback
Downloading Information Center
Printing Information Center Topics
Navigating through the Information Center
Searching for Information
Providing Feedback
Downloading Information Center
Printing Information Center Topics
APPENDIX
Sample Implementation of a User-Defined Function
Internal Data Types of Data Exchange
Internal Defined Error Types for EvaluationValue
Causes: Mappings that Result in Warning/May Have Warning
Rerunning a Transformation from the Beginning
Supporting SQL Server Memory Optimized Tables in Data Exchange
Supporting Kafka as a Target
Kafka Message Format for Different Operations in RDMS
XSD Schema Structure File and JSON Format
Generating Helper Classes for Consumer
Sample Implementation of a User-Defined Function
Internal Data Types of Data Exchange
Internal Defined Error Types for EvaluationValue
Causes: Mappings that Result in Warning/May Have Warning
Rerunning a Transformation from the Beginning
Supporting SQL Server Memory Optimized Tables in Data Exchange
Supporting Kafka as a Target
Kafka Message Format for Different Operations in RDMS
XSD Schema Structure File and JSON Format
Generating Helper Classes for Consumer