Code

update my branch#305

Code

Merged

tderk merged 61 commits into124-list-of-columns-for-hashdiff-with-includeexclude-parametersScalefreeCOM/datavault4dbt:124-list-of-columns-for-hashdiff-with-includeexclude-parametersfrom mainScalefreeCOM/datavault4dbt:mainCopy head branch name to clipboardJan 17, 2025

+1,876-1,297

Commits

Commits on Nov 19, 2024

• add macro to process new prejoin list syntax

  tkiehn

  authored
  98d001d

  Copy full SHA for 98d001d

• add process_prejoined_columns macro to top-level stage macro

  tkiehn

  authored
  4b0e02d

  Copy full SHA for 4b0e02d

Commits on Nov 20, 2024

• change prejoin-logic to perform less joins

  tkiehn

  committed
  07ec2de

  Copy full SHA for 07ec2de

Commits on Nov 27, 2024

• add check and compilation error if a prejoined column is defined twice

  tkiehn

  authored
  fa4087e

  Copy full SHA for fa4087e

• add amount of extract_columns and aliases to amount-mismatch compilation error message

  tkiehn

  authored
  54b8720

  Copy full SHA for 54b8720

• Merge branch 'main' into 287-feature-extract-multiple-columns-from-one-prejoined-object

  tkiehn

  authored
  582af24

  Copy full SHA for 582af24

• add prejoin with source to processing-macro

  tkiehn

  authored
  60b2a98

  Copy full SHA for 60b2a98

Commits on Dec 2, 2024

• removed unnecessary md file

  tkirschke

  committed
  9f1a06b

  Copy full SHA for 9f1a06b

• First version of yaml parsing, needs to be turned into macro

  tkirschke

  committed
  d18d28b

  Copy full SHA for d18d28b

• First version of macro, and Control_snap_v0 adjusted to use it.

  tkirschke

  committed
  24ee6ba

  Copy full SHA for 24ee6ba

Commits on Dec 3, 2024

• Update yaml_metadata_parser.sql, fix if-nesting, rename metadata_dict

  tkiehn

  authored
  956e71a

  Copy full SHA for 956e71a

• Fixed warnings

  tkirschke

  committed
  3a94499

  Copy full SHA for 3a94499

• Merge branch '181-modify-macros-to-directly-work-with-yaml-metadata' of https://github.com/ScalefreeCOM/datavault4dbt into 181-modify-macros-to-directly-work-with-yaml-metadata

  tkirschke

  committed
  f3bc4a7

  Copy full SHA for f3bc4a7

Commits on Dec 9, 2024

• move stage_processing_macros.sql into staging folder

  tkiehn

  committed
  3fed963

  Copy full SHA for 3fed963

Commits on Dec 11, 2024

• change extract_input_columns, process_prejoined_columns. add extract_prejoin_column_names

  Show description for edf3dc4
  tkiehn

  committed
  edf3dc4

  Copy full SHA for edf3dc4

• add staging.yml with descriptions of process_prejoined_columns and extract_prejoin_column_names

  tkiehn

  committed
  da7d000

  Copy full SHA for da7d000

• postgres: modify stage to handle new prejoin syntax and simplify setting of commas for ghost records

  tkiehn

  committed
  a970a0a

  Copy full SHA for a970a0a

• bigquery: stage: implement new prejoin syntax

  tkiehn

  committed
  f8767ae

  Copy full SHA for f8767ae

• databricks: stage: implement new prejoin syntax

  tkiehn

  committed
  90dc5c8

  Copy full SHA for 90dc5c8

• exasol stage: implement new prejoin syntax

  tkiehn

  committed
  706b2af

  Copy full SHA for 706b2af

• fabric stage: implement new prejoin syntax

  tkiehn

  committed
  20d012c

  Copy full SHA for 20d012c

• oracle stage: implement new prejoin syntax

  tkiehn

  committed
  36617f3

  Copy full SHA for 36617f3

• postgres stage add prepend_generated_by()

  tkiehn

  committed
  7adba69

  Copy full SHA for 7adba69

• redshift stage: implement new prejoin syntax

  tkiehn

  committed
  3070e0a

  Copy full SHA for 3070e0a

• snowflake stage: implement new prejoin syntax

  tkiehn

  committed
  ef8b375

  Copy full SHA for ef8b375

• synapse stage: implement new prejoin syntax

  tkiehn

  committed
  e891046

  Copy full SHA for e891046

• First batch of modified front-end macros

  tkirschke

  committed
  a065dc1

  Copy full SHA for a065dc1

Commits on Dec 12, 2024

• synapse stage: remove column name escaping in ghost record macro call

  tkiehn

  committed
  71bfee3

  Copy full SHA for 71bfee3

• fabric stage fix escape column names

  tkiehn

  committed
  e683e45

  Copy full SHA for e683e45

• synapse, fabric stages: fix derived input columns

  tkiehn

  committed
  3a86469

  Copy full SHA for 3a86469

• oracle stage: include col_size to ghost records

  tkiehn

  committed
  57e21da

  Copy full SHA for 57e21da

• synapse stage: fix prejoin_column_names

  tkiehn

  committed
  c8df4d3

  Copy full SHA for c8df4d3

Commits on Dec 13, 2024

• Finished yaml implementation, not tested yet

  tkirschke

  committed
  f484bbb

  Copy full SHA for f484bbb

• Fixed returning none for optional parameters

  tkirschke

  committed
  1642057

  Copy full SHA for 1642057

Commits on Dec 19, 2024

• Fixed ref satellite parameter

  tkirschke

  committed
  2f9e218

  Copy full SHA for 2f9e218

Commits on Jan 6, 2025

• unify formatting of yaml_metadata_parser calls

  tkiehn

  committed
  5e203ca

  Copy full SHA for 5e203ca

Commits on Jan 7, 2025

• Update hash_standardization.sql

  tkirschke

  authored
  aa0ea49

  Copy full SHA for aa0ea49

• Update hash_standardization.sql

  Show description for 1e2f721
  tkiehn

  authored
  1e2f721

  Copy full SHA for 1e2f721

• Move warnings to log and improve content of the messages

  tkiehn

  committed
  de6861f

  Copy full SHA for de6861f

• add ghost record for DATETIME on BigQuery

  tkiehn

  committed
  ec1366c

  Copy full SHA for ec1366c

• fix oracle ghost records for timestamps

  tkiehn

  committed
  bef34c1

  Copy full SHA for bef34c1

Commits on Jan 8, 2025

• Merge remote-tracking branch 'origin/issue-295-tkirschke-patch' into test

  tkiehn

  committed
  78af272

  Copy full SHA for 78af272

• fix behaviour of derived columns throughout the CTEs for all adapers except synapse and fabric

  tkiehn

  committed
  659d8ea

  Copy full SHA for 659d8ea

• fix fabric ghost records for datetime2

  tkiehn

  committed
  c859311

  Copy full SHA for c859311

• Merge branch '287-feature-extract-multiple-columns-from-one-prejoined-object' into test

  tkiehn

  committed
  0557fbf

  Copy full SHA for 0557fbf

• Update oracle stage, remove AS for alias of joined tables

  tkiehn

  authored
  6c380d3

  Copy full SHA for 6c380d3

Commits on Jan 9, 2025

• Update oracle ghost_record_per_datatype, simplify detection of (var)char types

  tkiehn

  authored
  e1703c7

  Copy full SHA for e1703c7

• redshift: use qualify statement instead of prep CTEs throughout all macros

  tkiehn

  committed
  c0d40bf

  Copy full SHA for c0d40bf

• change placeholder alias to actual alias in deduplicated_incoming cte for redshift eff_sat

  tkiehn

  committed
  7f13d91

  Copy full SHA for 7f13d91

• small fixes on exasol stage

  tkiehn

  committed
  d143732

  Copy full SHA for d143732

• Update ghost_record_per_datatype.sql, fix databricks hash_default_values

  tkiehn

  authored
  1570800

  Copy full SHA for 1570800

Commits on Jan 10, 2025

• Merge pull request #300 from ScalefreeCOM/test

  Show description for 76c5ccf
  tkiehn

  authored
  76c5ccf

  Copy full SHA for 76c5ccf

• Merge branch 'main' into fix-databricks-ghost-records-binary-defaults

  tkiehn

  authored
  3f9c9f8

  Copy full SHA for 3f9c9f8

• Merge remote-tracking branch 'origin/main' into 298-bug-redshift-not-using-qualify-for-latest-records

  tkiehn

  committed
  8eb950c

  Copy full SHA for 8eb950c

• Merge pull request #301 from ScalefreeCOM/fix-databricks-ghost-records-binary-defaults

  Show description for e397ce4
  tkiehn

  authored
  e397ce4

  Copy full SHA for e397ce4

• Merge branch 'main' into 298-bug-redshift-not-using-qualify-for-latest-records

  tkiehn

  authored
  261d7ab

  Copy full SHA for 261d7ab

• Merge pull request #302 from ScalefreeCOM/298-bug-redshift-not-using-qualify-for-latest-records

  Show description for 27f64ae
  tkiehn

  authored
  27f64ae

  Copy full SHA for 27f64ae

Commits on Jan 13, 2025

• Added optional parameter "union_strategy" and implemented it in all nh_link macros

  tkirschke

  committed
  c524a57

  Copy full SHA for c524a57

• Added optional parameter "union_strategy" and implemented it in all nh_link macros

  tkirschke

  committed
  72e0085

  Copy full SHA for 72e0085

• fix nh_link union strategy condition syntax

  tkiehn

  authored
  78d6364

  Copy full SHA for 78d6364

• Merge pull request #303 from ScalefreeCOM/177-nh-link-add-union_strategy-parameter

  Show description for 208139c
  tkiehn

  authored
  208139c

  Copy full SHA for 208139c