Data Source Support¶
The Delphix Masking service supports profiling, masking, and tokenizing a variety of different data sources including distributed databases, mainframe, PaaS databases, and files. At a high level, Delphix Masking breaks up support for data sources into two categories:
-
Dedicated Delphix Connectors: These are data sources that the Delphix Engine can connect to directly using built-in connectors that have been optimized to perform masking, profiling and tokenization.
-
FEML Sources: FEML (File Extract Mask and Load) is a method used to mask and tokenize data sources that do not have dedicated Delphix Connectors. FEML uses existing APIs from data sources to extract the data to a file, masks the file, and then uses APIs to load the masked file back into the database.
Dedicated Delphix Connectors¶
The Delphix Engine has dedicated masking connectors for the following data sources:
-
Distributed Database: DB2 LUW, Oracle, MS SQL, MySQL, SAP ASE (Sybase), PostgreSQL, MariaDB
-
Mainframe/Midrange: DB2 Z/OS, DB2 iSeries, Mainframe data sets
-
Files: Fixed Width, Delimited, XML
For a detailed view of all the versions, features, etc Delphix supports on each data source - see the sections below.
DB2 LUW Connector¶
Introduction¶
DB2 for Linux, UNIX and Windows is a database server product developed by IBM. Sometimes called DB2 LUW for brevity, it is part of the DB2 family of database products. DB2 LUW is the "Common Server" product member of the DB2 family, designed to run on the most popular operating systems. By contrast, all other DB2 products are specific to a single platform.
Support Matrix¶
The Delphix DB2 LUW connector supports the following versions of DB2 LUW:
Version | Linux | Unix | Windows |
---|---|---|---|
10.1 | Supported | Supported | Supported |
10.5 | Supported | Supported | Supported |
11.1 | Supported | Supported | Supported |
Available Features¶
The DB2 LUW connector supports profiling and masking/tokenization features. Below is a list of which options are and are not available for jobs using the DB2 LUW connector:
Feature | Availability | |
---|---|---|
In-Place Masking Mode | Multi-Tenant | Available |
Streams / Threads | Available | |
Batch Update | Available | |
Drop Indexes | Available | |
Disable Trigger | Unavailable | |
Disable Constraint | Unavailable | |
Identity Column Support | Unavailable | |
On-The-Fly Masking Mode | Restart Ability | Available |
Truncate | Available | |
Disable Trigger | Unavailable | |
Disable Constraint | Unavailable | |
Profiling | Multi-Tenant | Available |
Streams | Available |
Oracle Connector¶
Introduction¶
Oracle Database (commonly referred to as Oracle RDBMS or simply as Oracle) is a multi-model database management system produced and marketed by Oracle Corporation.
Support Matrix¶
Version | Linux | Unix | Windows | AWS RDS |
---|---|---|---|---|
10g | Supported | Supported | Supported | N/A |
11gR1 | Supported | Supported | Supported | N/A |
11gR2 | Supported | Supported | Supported | Supported |
12c | Supported | Supported | Supported | Supported |
12cR2 | Supported | Supported | Supported | Supported |
18c | Supported | Supported | Supported | Supported |
19c | Supported | Supported | Supported | Supported |
Available Features¶
The Oracle connector supports profiling and masking/tokenization features. Below is a list of which options are and are not available for jobs using the Oracle connector:
Feature | Availability | |
---|---|---|
In-Place Masking Mode | Multi-Tenant | Available |
Streams / Threads | Available | |
Batch Update | Available | |
Drop Indexes | Available | |
Disable Trigger | Available | |
Disable Constraint | Available | |
Identity Column Support | Available | |
On-The-Fly Masking Mode | Restart Ability | Available |
Truncate | Available | |
Disable Trigger | Available | |
Disable Constraint | Available | |
Profiling | Multi-Tenant | Available |
Streams | Available |
MS SQL Connector¶
Introduction¶
Microsoft SQL Server is a relational database management system developed by Microsoft. As a database server, it is a software product with the primary function of storing and retrieving data as requested by other software applications—which may run either on the same computer or on another computer across a network (including the Internet).
Support Matrix¶
Version | Linux | Unix | Windows | AWS RDS |
---|---|---|---|---|
2005 | N/A | N/A | Supported | N/A |
2008 | N/A | N/A | Supported | N/A |
2008 R2 | N/A | N/A | Supported | Supported |
2012 | N/A | N/A | Supported | Supported |
2014 | N/A | N/A | Supported | Supported |
2016 | Supported | N/A | Supported | Supported |
Available Features¶
The MS SQL connector supports profiling and masking/tokenization features. Below is a list of which options are and are not available for jobs using the MS SQL connector.
Feature | Availability | |
---|---|---|
In-Place Masking Mode | Multi-Tenant | Available |
Streams / Threads | Available | |
Batch Update | Available | |
Drop Indexes | Available | |
Disable Trigger | Available | |
Disable Constraint | Available | |
Identity Column Support | Available | |
On-The-Fly Masking Mode | Restart Ability | Available |
Truncate | Available | |
Disable Trigger | Available | |
Disable Constraint | Available | |
Profiling | Multi-Tenant | Available |
Streams | Available |
PostgreSQL Connector¶
Introduction¶
PostgreSQL, often simply Postgres, is an object-relational database management system (ORDBMS) with an emphasis on extensibility and standards compliance. PostgreSQL is developed by the PostgreSQL Global Development Group, a diverse group of many companies and individual contributors. It is free and open-source, released under the terms of the PostgreSQL License, a permissive software license.
Support Matrix¶
Version | Linux | Unix | Windows | AWS RDS | AWS Aurora |
---|---|---|---|---|---|
9.2 | Supported | Supported | Supported | N/A | N/A |
9.3 | Supported | Supported | Supported | N/A | N/A |
9.4 | Supported | Supported | Supported | Supported | Supported |
9.5 | Supported | Supported | Supported | Supported | Supported |
9.6 | Supported | Supported | Supported | Supported | Supported |
10 | Supported | Supported | Supported | Supported | Supported |
11 | Supported | Supported | Supported | Supported | Supported |
Available Features¶
The PostgreSQL connector supports profiling and masking/tokenization features. Below is a list of which options are and are not available for jobs using the PostgreSQL connector:
Feature | Availability | |
---|---|---|
In-Place Masking Mode | Multi-Tenant | Available |
Streams / Threads | Available | |
Batch Update | Available | |
Drop Indexes | Unavailable | |
Disable Trigger | Unavailable | |
Disable Constraint | Unavailable | |
Identity Column Support | Available | |
On-The-Fly Masking Mode | Restart Ability | Unavailable |
Truncate | Available | |
Disable Trigger | Available | |
Disable Constraint | Available | |
Profiling | Multi-Tenant | Available |
Streams | Unavailable |
MySQL / MariaDB Connector¶
Introduction¶
MySQL is an open-source relational database management system (RDBMS). MySQL was owned and sponsored by a single for-profit firm, the Swedish company MySQL AB. MySQL is now owned by Oracle Corporation.
MariaDB is a community-developed fork of the MySQL relational database management system intended to remain free under the GNU GPL. Development is led by some of the original developers of MySQL, who forked it due to concerns over its acquisition by Oracle Corporation.
A MySQL Connector may be used to connect to either a MySQL or MariaDB database instance.
MySQL Support Matrix¶
Version | Linux | Unix | Windows | AWS RDS | AWS Aurora |
---|---|---|---|---|---|
5.5 | Supported | Supported | Supported | Supported | Supported |
5.6 | Supported | Supported | Supported | Supported | Supported |
5.7 | Supported | Supported | Supported | Supported | Supported |
MariaDB Support Matrix¶
Version | Linux | Unix | Windows | AWS RDS |
---|---|---|---|---|
10 | Supported | Supported | Supported | Supported |
Available Features¶
The MySQL connector supports profiling and masking/tokenization features. Below is a list of which options are and are not available for jobs using the MySQL connector:
Feature | Availability | |
---|---|---|
In-Place Masking Mode | Multi-Tenant | Available |
Streams / Threads | Available | |
Batch Update | Available | |
Drop Indexes | Available | |
Disable Trigger | Unavailable | |
Disable Constraint | Unavailable | |
Identity Column Support | Available | |
On-The-Fly Masking Mode | Restart Ability | Unavailable |
Truncate | Available | |
Disable Trigger | Unavailable | |
Disable Constraint | Unavailable | |
Profiling | Multi-Tenant | Available |
Streams | Available |
SAP ASE (Sybase) Connector¶
Introduction¶
SAP ASE (Adaptive Server Enterprise), originally known as Sybase SQL Server, and also commonly known as Sybase DB or Sybase ASE, is a relational model database server product for businesses developed by Sybase Corporation which became part of SAP AG.
Support Matrix¶
Version | Linux | Unix | Windows |
---|---|---|---|
15.03 | Supported | Supported | Supported |
15.5 | Supported | Supported | Supported |
15.7 | Supported | Supported | Supported |
16 | Supported | Supported | Supported |
Available Features¶
The SAP ASE (Sybase) connector supports profiling and masking/tokenization features. Below is a list of which options are and are not available for jobs using the SAP ASE connector:
Feature | Availability | |
---|---|---|
In-Place Masking Mode | Multi-Tenant | Available |
Streams / Threads | Available | |
Batch Update | Available | |
Drop Indexes | Available | |
Disable Trigger | Available | |
Disable Constraint | Available | |
Identity Column Support | Available | |
On-The-Fly Masking Mode | Restart Ability | Available |
Truncate | Available | |
Disable Trigger | Available | |
Disable Constraint | Available | |
Profiling | Multi-Tenant | Available |
Streams | Available |
DB2 Z/OS and iSeries Connectors¶
Introduction¶
DB2 for z/OS and iSeries are relational database management systems that run on IBM Z(mainframe) and IBM Power Systems.
Support Matrix¶
Version | z/OS | i-Series |
---|---|---|
7.1 | N/A | Supported |
7.2 | N/A | Supported |
7.3 | N/A | Supported |
9 | Supported | N/A |
10 | Supported | N/A |
11 | Supported | N/A |
Mainframe | Supported | N/A |
Available Features¶
The DB2 for z/OS and iSeries connectors support profiling and masking/tokenization features. Below is a list of which options are and are not available for jobs using the DB2 and z/OS and iSeries connectors:
Feature | Availability | |
---|---|---|
In-Place Masking Mode | Multi-Tenant | Available |
Streams / Threads | Available | |
Batch Update | Available | |
Drop Indexes | Unavailable | |
Disable Trigger | Unavailable | |
Disable Constraint | Unavailable | |
Identity Column Support | Unavailable | |
On-The-Fly Masking Mode | Restart Ability | Unavailable |
Truncate | Available | |
Disable Trigger | Unavailable | |
Disable Constraint | Unavailable | |
Profiling | Multi-Tenant | Available |
Streams | Available |
Files Connector¶
Introduction¶
Much of the time data will live outside of databases. The data can be stored in a variety of different formats including Fixed Width, Delimited, etc.
Support Matrix¶
File Type/Format | Support Level |
---|---|
Fixed Width | Supported |
Delimited | Supported |
XML | Supported |
JSON | Not Supported |
On-The-Fly Masking Jobs¶
Delphix Masking supports On-The-Fly (OTF) masking jobs where the data is read from a source location and written to a different target location. Only certain combinations of connector types are supported for OTF jobs.
OTF jobs with connectors of the same type are supported. For example, masking data from an Oracle source database to an Oracle target database is supported if both are using the built-in Oracle connector, as is a job with a delimited file source and target. OTF jobs using Extended Connectors are supported if both the source and target are using the same Extended Driver (the same uploaded JDBC driver). Additionally, OTF jobs with a relational database source and a delimited file target are supported. The following data sources are supported as source connectors for OTF jobs with delimited file targets.
- Oracle
- DB2
- MS SQL
- PostgreSQL
- MySQL / MariaDB
- SAP ASE (Sybase)
- Connectors created as Extended Connectors
No other combinations of connector types are supported. For example, an Oracle source with a PostgreSQL target, or a MS SQL source with a fixed width file target, are unsupported.