Manage Data Assets: Query & Cost Optimisation

Where to start?

Catalog provides you with a number of very useful tools to support better maintenance and cost optimisation of your data environments.

Reports on query utilisation and individual queries are starting points that help identify those tables and queries that have a high number of hits or take a long time / return a high number of records.

Reports

'User Activities' & 'Table Analytics' reports can be found under the Reports tab of your Governance section and offer information on queries by user and tables. This information can be used to identify improvement opportunities: e.g. a high query run time against a table or tables with many hits.

'Unused Asset' report is provided on demand by Catalog. This will highlight those objects that are not being used that could be removed from the data estate. These reports take into consideration child dependencies when an object is being flagged as ‘unused’.

Queries

Once you have identified a potential opportunity to optimise an object, you can navigate to that object.

In the data view you can navigate to Queries to visualise all the read statements and investigate if the queries could be optimized further.