Azure Data Catalog

Data Catalog is a cloud-based service. When a needed user can discover data sources and have an understanding of the data sources found. Organisations can get more value from existing investment using Data Catalog.

Data sources can be discovered, consumed and understood by any user (developer, analysts or data scientist) with Data Catalog. Crowdsourcing model of metadata and annotations are included in Data Catalog. To build a community that supports data culture, knowledge contribution by users from different organizations is required to which Data Catalog is a central place.

Data consumers challenges

User sometimes is unaware of the existence of a data source unless by part of another process they come into contact with the data source. Registered data sources do not have any central location.

Unless location of a data source is known by the user, by using client application they cannot be connected to data.

The user needs to know about data source documentation location to understand intended uses of data. A variety of place data sources and documentation might exist and through a variety of experience, it can be consumed.

If there are information assets queries by a user, they must contact the expert. The explicit connection between data and people who are expert about these doesn't exist.

Unless the process of requesting permission to access data source is understood by a user, finding out the data source and documentation won't help them access data.

Data producers challenges

Often annotating data sources with metadata description is not that useful. Description stored at data sources are ignored by the client application.

Data sources documentation creation is often of no use. It's an ongoing responsibility to keep documentation sync with the data source and it's possible that user might lack trust in documentation as it is out of date.

It's a complex task to create and maintain documentation for data sources. Creating that documentation without hesitation of making available to everyone by whom data source is used can be even more complex.

Data sources access restriction and ensuring that data consumers know how to request for access is the ongoing challenge.

UtterlyCloud

• admin@utterlycloud.com
• India