Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

In this article

...

This article emphasizes the different scenarios that are possible while performing an SCD2 operation and the behavior of the ELT SCD2 Snap, in each of these scenarios.

Terminology

To follow these scenarios and configure the ELT SCD2 Snap properly in your SnapLogic environment, you will need to understand the following terms:

...

Customer ID (Natural Key)

Address (New Cause Historization Entries)

Start Date
(Temporal Field 1)

End Date
(Temporal Field 2)

Current Row
(Temporal Field 3)

Remarks / Key Take-aways

1

Chicago

1/1/18

12/1/18

false

No change.

1

New York

1/1/19

1/1/20

false

Not current row anymore.

1

Chicago

1/1/20

1/1/21

false

New entry but not current row. Start date for the newer row is the End date for this entry.

1

New York

1/1/21

MAX_DATE

true

Current row with default End Date.

Info

The SCD2 operation uses a row-by-row approach. The final current row is arrived at, only after processing all rows for that natural key.

...

Customer ID (Natural Key)

Address (New Cause Historization Entries)

Start Date
(Temporal Field 1)

End Date
(Temporal Field 2)

Current Row
(Temporal Field 3)

Remarks / Key Take-aways

1

Chicago

1/1/18

12/1/18

false

No change.

1

New York

1/1/19

1/1/21

false

Not current row anymore. Any end date for New York before 1/1/21 (start date for Boston) results in New York becoming a historical row.

1

Boston

1/1/21

MAX_DATE

true

Current row with default End Date.

Scenario 3: Target table is Empty and Source Table Contains Duplicate Values for Cause-Historization field

...

Customer ID (Natural Key)

Address (New Cause Historization Entries)

Start Date
(Temporal Field 1)

End Date
(Temporal Field 2)

Current Row
(Temporal Field 3)

Remarks / Key Take-aways

1

Chicago

1/1/15

1/1/16

false

End date arrived based on the start date of the next entry (in ascending order).

1

Boston

1/1/16

1/1/18

false

End date arrived based on the start date of the next entry (in ascending order).

1

Chicago

1/1/18

1/1/20

false

Any start date for Chicago outside the range 1/1/18 - 1/1/20 will be ignored.

1

Boston

1/1/20

MAX_DATE

true

Current row with default End Date.

Info

The SCD2 operation sorts the source data records in the ascending order of their Start Dates when there is no row numbering (sequence) specified in the source data.

...