Database Administrators Stack Exchange
Database Administrators Stack Exchange

Questions tagged [integration]

22 questions
17
votes
4 answers

Not able to create SSISDB catalog

Getting the error below while trying to create a catalog in sql server 2014 integration services. Any idea what I missed in installation or anywhere else? The catalog backup file 'C:\Program Files\Microsoft SQL …
Radhi
  • 323
  • 1
  • 2
  • 9
10
votes
3 answers

Looking for advice on how to integrate data from 100+ client DB's into a centralized reporting database

I am a SQL Developer (not DBA or Architect) for a small (~50 employees) SaaS company. I am tasked with figuring out how to: Offload operational reporting from our 100+ OLTP databases Allow those reports to run against data from multiple client…
bperry
  • 101
  • 2
7
votes
5 answers

Does MySQL have a version of Change Data Capture?

We're in the process of phasing out an old system and migrating onto a new one. The last time that we phased out an old system, we ran both systems in parallel and integrated data between both until everything was fully migrated out in our field.…
njkroes
  • 655
  • 4
  • 7
  • 15
5
votes
3 answers

Can PostgreSQL support integration test with some kind of throwaway overlay?

It's a common problem to write integration tests that include a database. If the test changes the database then it could effect other tests or the next run of itself. I know that I could wrap my test in a transaction and rollback the transaction…
Thomas Koch
  • 151
  • 2
3
votes
1 answer

SQL User Permissions for Continuous Integration via DbUp and Octopus

Currently, our deverloper group has started using DbUp and Octopus to do Continuous Integration on SQL Database Deployments. We have created a Domain user which will utilized to do the SQL Database deployment via Octopus server. I wanted to know,…
NismoGTR05
  • 309
  • 2
  • 12
2
votes
1 answer

Scheduled snapshots of views (without using materialized views or Oracle Golden Gate)?

I have 40 views in an Oracle 18c GIS database that are used in a map in a workorder management system (WMS). The views are served up to the WMS map via a web service. There are an average of 10,000 rows per view. The views have joins to…
User1974
  • 1,517
  • 25
  • 54
2
votes
1 answer

Register dll to use in SSIS Script Component

I've been asked to register an existing dll file so that it can be referenced in an SSIS script component. I have a dim and distant memory of doing this using gacutil.exe so that was my initial go to. However, gacutil.exe is not present on the…
Molenpad
  • 1,814
  • 2
  • 23
  • 41
2
votes
1 answer

Data from different tables into one table

I've requirement where I need to store information from different sources in my system and the process that data. When I say from different sources it will be completely different table structure from all the sources and these sources will be…
NewbieDev
  • 21
  • 1
1
vote
0 answers

Service Broker received an error message on this conversation

I will first have to say, I am still trying to wrap my brain around all the components of the Service Broker and how they work together, so it's very likely I'm missing something obvious... it's just not obvious to me. A little summary: We have a…
Jeremy Holovacs
  • 1,271
  • 4
  • 20
  • 27
1
vote
3 answers

View: Ignore a left join if it is not used?

I have a web service that references a view called gis_sidewalks_vw. create table gis_sidewalks ( id number(10,0), last_edited_date date ); insert into gis_sidewalks (id, last_edited_date) values (1, TO_DATE('2019/01/01 00:00:00',…
User1974
  • 1,517
  • 25
  • 54
1
vote
4 answers

Integration: Keep two systems in sync

I have a GIS system with 40 tables, ranging from 1,000 to 60,000 rows per table. The tables are the system of record for assets in a municipality. The GIS assets in the tables get integrated to a Workorder Management System (WMS) on a weekly basis.…
User1974
  • 1,517
  • 25
  • 54
1
vote
1 answer

SQL Server Integration Services (SSIS) Package Failing with no error

I have some SSIS packages that are executed as steps in a Server Agent Job. The Steps often fail with no error and I have had to add retries. Now the jobs complete but I get the warning exclamation mark telling me there has been a failure and its…
Michael
  • 11
  • 3
1
vote
1 answer

Data integration name of best practices to avoid corruption, caused by becoming out of sync?

I have identified an issue in the design of a system and I am trying to find the right language to describe the cause of the issue so I can report it to managers, and get the issue fixed. The problem is we have a web service syncing data by copying…
user802599
  • 463
  • 2
  • 7
  • 14
1
vote
1 answer

How to fix data discrepancies between columns from two tables

The problem: I am working for a retail site that sells various products for cars and trucks. We want to integrate eBay and Amazon API to list our products on these stores. The problem arises when I try to send Vehicle compatibility data. Example…
OutFall
  • 167
  • 5
1
vote
0 answers

Efficient methods/tools for managing a data warehouse pulling data from multiple database applications

Until now I have used an on premise SQL Server 2012 and performed manual ETL operations to create/manage a data warehouse that contains data from multiple database application from different organizations. I get the source data [several dozen…
Sid
  • 11
  • 2
1
2