Skip to content

jygerardy/test_plugin

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

SQL code extractor

Overview

  • One of the strengths of DSS is its ability to run visual recipes using compute infrastructures (SQL databases, Hadoop clusters, etc). See: https://www.dataiku.com/learn/guide/getting-started/dss-concepts/where-does-it-all-happen.html

  • To that end, DSS translates visual recipes into code that can then be pushed down to the data source, whether traditional SQL for relational databases (Postgres, MySQL , Oracle etc.) or other SQL-like dialects for Hadoop clusters (Hive, Impala, SparkSQL). DSS users can also directly write code recipes in those languages.

  • The purpose of this macro is to build a report consisting of SQL code from these recipes (visual and code). The macro can build a report for a single project or for all projects in an instance.

Usage

Input

  • This macro takes as input an existing folder in the project where the macro is used.
  • The user can choose to either run the macro on the current project or across all the project they have access to on the instance.

Output

  • The output is a zip file dumped in the chosen folder and a report table that shows the count of recipes per project from which SQL code was retrieved.

  • The structure in the zipped folder is sql_extract-{extractionTime}/{projectKey}/{recipeName.sql}

Limitations

  • This macro is unable to retrieve SQL from the pivot recipes.

License

Apache Software License

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages