Difference between revisions of "Data Catalog"

From wiki
Jump to navigation Jump to search
Line 24: Line 24:
 
== Data Catalog Architecture ==
 
== Data Catalog Architecture ==
 
<gallery>
 
<gallery>
CatalogArchitecture.png|DFO-MPO Data Catalog Conceptual Architecture
+
File:CatalogArchitecture.png|A work in progress DFO-MPO Data Catalog Conceptual Architecture
 
 
</gallery>
 
</gallery>
 
== List of Stakeholders ==
 
== List of Stakeholders ==
  
 +
{| class="wikitable sortable mw-collapsible"
 +
|+
 +
!
 +
!
 +
!
 +
!
 +
!
 +
!
 +
|-
 +
|Sector
 +
|Contact Person
 +
|Project / Program
 +
|Meeting date
 +
|Relation to TADAP
 +
|Other Comments
 +
|-
 +
|Conservation and Protection
 +
|Lise Melanson
 +
|Department Violation System (DVS)
 +
|Augut 24th, 2018
 +
|These projects have to be  supported by TADAP
 +
|We are contacting  André  Bélanger to get more info about data sources
 +
|-
 +
|
 +
|Pauline Lalonde
 +
|C-STAT
 +
|September 25th, 2018
 +
|This project has to be supported by TADAP
 +
|
 +
|-
 +
|Canada Coast Guard
 +
|Shawn Legault and Nicholas O’Hara
 +
|SIPA
 +
|September 11th, 2018
 +
|CCG has its own opertional network. However, we need to at  least catalouge their data
 +
|
 +
|-
 +
|
 +
|Jean-François Coutu
 +
|INNAV
 +
|September 24th, 2018
 +
|CCG has its own opertional network. However, we need to at  least catalouge their data
 +
|
 +
|-
 +
|
 +
|Chris Burnie-Gardiner and Patrick Marion
 +
|SISAR
 +
|September 13th, 2018
 +
|CCG has its own opertional network. However, we need to at  least catalouge their data
 +
|The goal of this meeting was to explore how AI can be applied  in Search and rescue. However, we may at least want to catalouge their SISAR  database
 +
|-
 +
|
 +
|Bert Paulin
 +
|Reporting for CCG programs
 +
|To be determined
 +
|Further discussion required
 +
|
 +
|-
 +
|Canadian Hydrographic Services
 +
|Terry Fanning and Matthew McGowan
 +
|Main work is to move science, ocean, and species data to the  Government of Canada Open Portal
 +
|August 27th, 2018
 +
|This program needs to be supported by TADAP
 +
|George is contacting David Bradley, new manager of science data  sub-committee, to arrange for future meetings
 +
|-
 +
|
 +
|Claude Guay
 +
|Metadata management and data management for whole science  sector
 +
|To be determined
 +
|
 +
|
 +
|-
 +
|SRS, Science Branch
 +
|Theraesa Coyle and Johannie Duhaime
 +
|Aquaculture Monitoring Program
 +
|August 27th and September 4th, 2018
 +
|This program needs to be supported by TADAP
 +
|
 +
|-
 +
|Fishery & Assessment Data  Section, Science Branch
 +
|Bruce A. Patten and Di Wan
 +
|Scientific survey documentation for fish population  assessment, fish harvest tracking and reporting
 +
|August 31st, 2018
 +
|Stakeholders are very interested in collobration. Their  programs need to be supported by TADAP
 +
|
 +
|-
 +
|Aquaculture Management  Directorate, Aquatic Ecosystems Sector
 +
|Tyree Lush and Arsenault Shane
 +
|Canadian Shellfish Sanitation Program (CSSP) mapping system
 +
|September 7th, 2018
 +
|This program needs to be supported by TADAP
 +
|
 +
|-
 +
|Fisheries & Licence Policy  / Fisheries and Harbour Management
 +
|Mark Ledwell
 +
|FHM
 +
|To be determined.
 +
|Further discussion required
 +
|
 +
|-
 +
|Ecosystems and Fisheries  Management: System Integration
 +
|Aaron Gillis and Andrew Frost
 +
|EFM-SI
 +
|To be determined
 +
|This program has to be supported by TADAP
 +
|
 +
|-
 +
|Information Management and  Policy Strategies
 +
|Lyn Warner
 +
|Open Data Portal
 +
|To be determined
 +
|Has to be supported by TADAP
 +
|
 +
|-
 +
|Ocean Data and Information  Section
 +
|Tobias Spears
 +
|To be determined
 +
|To be determined
 +
|
 +
|
 +
|}
  
 
== Data Catalog Team ==
 
== Data Catalog Team ==

Revision as of 15:00, 20 September 2018

Data Catalog

Data catalog is an organized service that allows users to centralize metadata and learn more about their data sources which help organizations achieve more values from their assets. Following are some advantages to centralizing metadata:

  • Consistency and accuracy across the department/government
  • Better data congruency, quality and structure
  • Makes data easily accessible
  • Allow users to self-serve

Why Data Catalog

USGS data Life Cycle

In an enterprise vision, we would like to minimize the number of data silos, get a faster access to what matters most, and function as a single source (during the Data Life Cycle) for better doing.
Data-driven culture empowers users with getting access to their data source. With this, the growing numbers of cloud applications, privacy regulations and security rules are making it more difficult to effectively secure and govern data

Therefor, a Data Catalog is needed to:

  • Spend less time searching for data and more time using it to gain insight
  • Have a better/safer access to data through governance. Departments have a hard time finding data and controlling who has access to it.
  • Reduce the cost of data redundancy and hoarding.
  • Better linkage between the technical value of metadata and the business value.

Data Catalog Architecture

List of Stakeholders

Sector Contact Person Project / Program Meeting date Relation to TADAP Other Comments
Conservation and Protection Lise Melanson Department Violation System (DVS) Augut 24th, 2018 These projects have to be supported by TADAP We are contacting  André Bélanger to get more info about data sources
Pauline Lalonde C-STAT September 25th, 2018 This project has to be supported by TADAP
Canada Coast Guard Shawn Legault and Nicholas O’Hara SIPA September 11th, 2018 CCG has its own opertional network. However, we need to at least catalouge their data
Jean-François Coutu INNAV September 24th, 2018 CCG has its own opertional network. However, we need to at least catalouge their data
Chris Burnie-Gardiner and Patrick Marion SISAR September 13th, 2018 CCG has its own opertional network. However, we need to at least catalouge their data The goal of this meeting was to explore how AI can be applied in Search and rescue. However, we may at least want to catalouge their SISAR database
Bert Paulin Reporting for CCG programs To be determined Further discussion required
Canadian Hydrographic Services Terry Fanning and Matthew McGowan Main work is to move science, ocean, and species data to the Government of Canada Open Portal August 27th, 2018 This program needs to be supported by TADAP George is contacting David Bradley, new manager of science data sub-committee, to arrange for future meetings
Claude Guay Metadata management and data management for whole science sector To be determined
SRS, Science Branch Theraesa Coyle and Johannie Duhaime Aquaculture Monitoring Program August 27th and September 4th, 2018 This program needs to be supported by TADAP
Fishery & Assessment Data Section, Science Branch Bruce A. Patten and Di Wan Scientific survey documentation for fish population assessment, fish harvest tracking and reporting August 31st, 2018 Stakeholders are very interested in collobration. Their programs need to be supported by TADAP
Aquaculture Management Directorate, Aquatic Ecosystems Sector Tyree Lush and Arsenault Shane Canadian Shellfish Sanitation Program (CSSP) mapping system September 7th, 2018 This program needs to be supported by TADAP
Fisheries & Licence Policy / Fisheries and Harbour Management Mark Ledwell FHM To be determined. Further discussion required
Ecosystems and Fisheries Management: System Integration Aaron Gillis and Andrew Frost EFM-SI To be determined This program has to be supported by TADAP
Information Management and Policy Strategies Lyn Warner Open Data Portal To be determined Has to be supported by TADAP
Ocean Data and Information Section Tobias Spears To be determined To be determined

Data Catalog Team