Database Administrators Stack Exchange
Database Administrators Stack Exchange

Questions tagged [data-flow]

7 questions
3
votes
1 answer

SSIS Merge Join: Delete does not work

I've set up a Data Flow Task to sync a flat file with its destination table using a Merge Join with a Left Outer Join as described here (and elsewhere). Merge Join: Inserting and Updating works fine, however, deleting a record from the flat file…
wp78de
  • 317
  • 6
  • 14
2
votes
1 answer

How is SSDT Data Flow batching handled?

How does SSDT handle batching of Data Flow tasks? I am parsing a CSV that is about 1GB into SQL Server using SSDT. In the Data Flow there is a Flat File source, that goes to an OLE DB destination (a staging table). Then an SP is executed using a SQL…
Zach Smith
  • 2,430
  • 13
  • 34
  • 65
0
votes
1 answer

How can the data flow show the number of values changed by a Derived Column that replaces a given column if a condition is met?

I take a Derived Column Transformation to replace a value as soon as a condition on two other columns is met. How can I see in the data flow how often a value changes by this replacement? Is there a way to show it on the output arrow, or how else…
questionto42
  • 366
  • 1
  • 2
  • 12
0
votes
1 answer

The debugger only stops at the breakpoints of the first Script Component. How do I debug more than one Script Component in an SSIS Data Flow Task?

This takes up How to debug a script component in SSIS - Stack Overflow which was asked for the 2008 version and is now outdated. That is why this question needs to be revived for the versions of nowadays. I put a breakpoint in two Script Components…
questionto42
  • 366
  • 1
  • 2
  • 12
0
votes
1 answer

How do you detect a change in grouping when using Partition By in SQL Server 2012+ and execute logic based upon the change in the same SQL statement?

If I have a SQL statement that contains something like, ROW_NUMBER() OVER(PARTITION BY school_area ORDER BY school_area) I get: 1 someschool1 schoolarea1 2 someschool2 schoolarea1 3 someschool3 schoolarea1 1 soomschool4 schoolarea2 2 ... How can I…
learntofix
  • 3
  • 1
0
votes
1 answer

Power BI refresh dataflow keep a snapshot of data

my requirement is to be able to save the past state of an entity at a certain point of time. Currently when the dataflow is refreshed, the past state is lost and only the current one is displayed. Is there a way to do it? I tried setting up the…
Yousra
  • 1
0
votes
1 answer

SSIS - Disable Task Based on Variable Value

I have an SSIS package that runs a number of Data Flow Tasks all at the same time. Each Data Flow Task is placed inside a Sequence Container. Before the Data Flow Tasks are run, a Script Task is used to check what Data Flow Tasks are required to…
Kevin
  • 533
  • 2
  • 12
  • 20