DATA GOVERNANCE
with
DATA VIRTUALIZATION
[If you want to know more about Data Virtualization, you may want to reach out to my Data Virtualization blog first.]
In this article, I will explain how data governance is beautifully supported by Data Virtualization and Lyftrondata platform. Please check out below video for more information:
As you see in below picture, Data Governance is the process of identifying the nature of VDOs, understanding the purpose of using VDOs and pro-actively controlling and protecting VDOs while letting VDOs to be used by or shared to authorized people and systems. In Data Virtualization, VDOs are the centralized & virtual objects of all enterprise data assets, therefore, it is easy to view them all in one place, add, edit or review the metadata comes with VDOs, apply data governance rules and let VDOs to be used by or shared to consumers.
It starts with identifying what is the content of a VDO, what is the right classification level for that VDO (according to standards, laws etc), who is going to use it and therefore, what security mechanism must be applied to VDO, these steps are all supervised by Data Owners and supported by Data Stewards and Custodians.
In Data Virtualization all elements are virtual including connections, sources/targets, VDOs and their attributes, schemas and PIPEs. Data Governance and Data Sharing can be applied to any of these virtual items. So, Data Governance process is very flexible and change management cycle of that is very fast and simple. Lyftrondata gives us a centralized governance portal to easily apply governance rules, alter governance rules and monitor activities.
Let's look at Data Governance in more details. Data Governance has few important components and roles:
Data must be classified according to the content type. All VDOs are tabular form (of downstream structured, semi-structured or unstructured data) and content type can be referred to the whole VDO or individual attributes of that.
A Virtual Data Object (simply a VDO) can be classified to different levels but most commonly, VDOs are classified to ‘Personal, Public, General, Restricted and Confidential’ in non-government and 'Top Secret, Secret, Confidential, Sensitive, and Unclassified' in governments, but in-fact, your organization should be able to customize it based on your needs.
Non-government classes:
Government classes:
A Role in Lyftrondata, is essentially an individual account or a group of individual accounts and a Connection, a Source, a VDO or part of a VDO can be accessed by that Role. Access for a Role is called Access Right and different permissions can be granted or denied. VDO also is used or shared to someone or a Role in your organization or outside of your organization.
Below are some permissions that can be granted/denied with Access Right to a Role:
System Administration Rights / Alter / Alter Data Sources / Control / Control Data Sources / Create Schema / Create VDO / Delete / Insert / Select / Update / View Definition / ...A VDO also can be secured from unauthorized accesses through different data security methods like Segregation, Masking, Hashing or Encryption:
The key point is here. In order to protect a VDO but still be able to effectively use or share it for data, analytics or integration purposes, a VDO which is not in Public classification and is going to be used by a Role, must be protected with a proper security enforcement. This customized security enforcement is called Classification Rules.
As an example, you may want to ‘hash a restricted VDO when is shared with an external user’ but ‘symmetrically encrypt that restricted VDO when used by internal HR team’.
In enterprises, Data Ownership is an important role that essentially owns the VDOs (like client banking transactions) and grants people/systems to use them.
Data Stewardship is also another role in enterprises that understands VDOs from business process point of view VDO and can help consumers to use them effectively.
Like Data Stewardship is also another role in enterprises that understands VDOs from technical point of view VDO.
Lyftrondata as a real Data Virtualization platform helps organizations to implement Data Governance at any level and all objects. Below is list of Data Governance features and objects in Lyftrondata that can be protected by Data Governance:
And here are some snapshots that explain how Data Governance is implemented in Lyftrondata platform:
Example 1 - apac-aws-customers source:>
Example 2 - vdoCustomerInfo.CreditCard VDO:>
Example 3 - Data Dictionary:>
Ali Aghatabar, founder and director of Intelicosmos®, has been helping clients across the globe, particularly the APAC region, for over two decades. With a consulting background, he helped a wide range of clients and industries for their IT needs specially on data & analytic, cloud architecture and computing, AI and process automations, digital transformation, IoT and smart devices etc.