Real-Time Information Governance and Data Integration

  • about ernie ostic
  • Table of Contents (for reasonably useful Postings!)
  • What’s this Blog about?

    Thoughts and techniques concerning all things about data and data integration, especially lineage and “data lineage” and how and why it needs to be tracked and monitored.

  • Select Posts by Area

  • Enter your email address to follow this blog and receive notifications of new posts by email.

    Join 246 other subscribers

Open Metadata Sharing with ODPi/Egeria and IGC

October 2, 2018 — dsrealtime

Hi everyone…..here to share with you the continuing evolution of Open Metadata and its soon-to-be-released implementation for Information Server 11.7 and the Information Governance Catalog (IGC).

Recently I was given the opportunity to start working with what is being called the
igc-omrs-connector — an implementation of ODPi/Egeria and its Open Metadata Repository Services (OMRS) api’s that enable IGC to be the first OMRS-Compliant repository!

The link below points to a demonstration that illustrates the real-time and bi-directional sharing of metadata between two instances of IGC.  It reviews several key concepts of ODPi/Egeria and OMRS (such as the meaning of a “cohort”) and then dives deeper to illustrate and “watch” (with windows into the kafka topics that help enable OMRS sharing) the sharing of metadata between the repositories using OMRS.

The 15 minute recording starts with a brief overview of ODPi/Egeria and OMRS, and then moves into the actual demonstration to illustrate the sharing of technical database metadata.  It continues afterwards with the sharing of glossary information and then the assignment of business terms to technical assets.

The video highlights ODPi/Egeria for the sharing of metadata between two instances of IGC, which is attractive for its application of real-time, bi-directional, and automated metadata exchange; however, the real value is when (in the next few months) Apache Atlas and other repositories _also_ become OMRS-Compliant — thus enabling metadata sharing among _independent_ repositories!    This is where the benefits of Open Metadata will be fully realized.   Costs associated with building and maintaining custom bridging solutions can be reduced, and developers, business users and data scientists alike will be able to more easily find, understand and validate valuable data assets and their meaning while further exploiting metadata driven solutions throughout their organization.

https://www.youtube.com/watch?v=P_RhQXXEbd4&t=11s

Stay tuned.  As additional compliant repositories come on-line, I will profile and (where possible) demonstrate their capabilities here, and continue this important discussion!

Thanks.

-ernie

 

Posted in Data Governance, Information Governance, metadata, Metadata Management. Tags: apache atlas, Egeria, igc, information governance catalog, ODPi/Egeria, Open Metadata. Leave a Comment »
Blog at WordPress.com.
  • please note

    The postings on this site are my own and don’t necessarily represent current or former employers or their positions, strategies or opinions.

  • Recent posts

    • What is Data Lineage? (a reprise) July 27, 2019
    • Open Metadata Sharing with ODPi/Egeria and IGC October 2, 2018
    • Please welcome Egeria! August 30, 2018
  • Follow Following
    • Real-Time Information Governance and Data Integration
    • Join 197 other followers
    • Already have a WordPress.com account? Log in now.
    • Real-Time Information Governance and Data Integration
    • Customize
    • Follow Following
    • Sign up
    • Log in
    • Report this content
    • View site in Reader
    • Manage subscriptions
    • Collapse this bar