Using REST API in SSIS to Extract Top 100 User Tweets

Abstract The growing popularity of the use of social networks by businesses indicate a possible change in ETL requirements. Part of this change is that developers had to revise existing ETL model such that it caters for sourcing of data off the internet in addition to the traditional flat files or OLE/ODBC Connections. In this [Read More →]

Execute Process Task – Compress File Using 7-Zip

Abstract In this blog post I will demonstrate using SQL Server Integration Services‘s Execute Process Task to compress a csv file into a zip format using 7-Zip. Requirements Microsoft Visual Studio 2005 or later 7-Zip SIFISO_Test Article Recently I have been involved in a project whereby I have been required to extract data into csv [Read More →]

SSIS 2012: Programmatically Create Catalog

Abstract I have a client that has already started migrating existing SQL Server environments to SQL Server 2012. Thus, this article will demonstrate creating a catalog and catalog folder using a Script Task component. Requirements Microsoft Visual Studio 2010 Article We begin by launching Microsoft Visual Studio and create a new Integration Services Project which [Read More →]

Download & Save SSIS Packages from SQL Server 2008 Instance to XML Format

Abstract This article explains how to Programmatically download SQL Server Integration Services (SSIS) packages from an instance of SQL Server 2008 and save them into an XML file using a Microsoft’s SSIS Script Task component. Requirements Microsoft Visual Studio 2008 (or later editions) SQL Server 2005 (or later editions) Article If the above requirements are [Read More →]

Programmatically Insert into SQL Server Table from an Excel File Using SSIS Script Tasks

Abstract This article explains how to Programmatically create an SQL Server Integration Services (SSIS) package with a Script Task component. Requirements Microsoft Visual Studio 2008 (or later editions) SQL Server 2005 (or later editions) AdventureWorks2008 database (downloadable database file available here) Article If the above requirements are all met, we will begin by launching Microsoft [Read More →]

Programmatically Transfer SQL Server Objects (Views) Using C#

Abstract This article explains how to Programmatically create an SQL Server Integration Services (SSIS) package with a Transfer SQL Server Objects component. The Transfer SQL Server Objects tasks allows ETL developers to copy one or more Microsoft SQL server objects (i.e. views, stored procedures, tables, schema etc) into another SQL instance. For the purposes of [Read More →]

Programmatically Transfer SQL Server Objects (Tables) Using C#

Abstract This article explains how to Programmatically create an SQL Server Integration Services (SSIS) package with a Transfer SQL Server Objects component. The Transfer SQL Server Objects tasks allows ETL developers to copy one or more Microsoft SQL server objects (i.e. views, stored procedures, tables, schema etc) into another SQL instance. For the purposes of [Read More →]

Programmatically Execute SQL Server Package Task Using C#

Abstract This article explains how to execute an SSIS package task of a package that is stored in SQL Server. Requirements Microsoft Visual Studio 2008 (or later editions) SQL Server 2005 (or later editions) AdventureWorks2008R2 database (downloadable database file available here) Article If the above requirements are all met, we will begin by launching Microsoft [Read More →]

Programmatically Insert Conditional Split Transformation in Data Flow Task of SSIS Package Using C#

Abstract This article explains how to create an SSIS package with both Data Flow Task and Conditional Split Transformation connected together using C# programming language. Requirements Microsoft Visual Studio 2008 (or later editions) SQL Server 2005 (or later editions) AdventureWorks2008R2 database (downloadable database file available here) Article If the above requirements are all met, we [Read More →]

Programmatically Create Data Flow Task with Row Count Transformation in SSIS Package Using C#

Abstract This article explains how to programmatically create data flow task with row count transformation in SQL Server Integration Services Package Using C#. Requirements Microsoft Visual Studio 2008 SQL Server 2008 AdventureWorks2008R2 database (downloadable database file available here) Article If the above requirements are all met, we will begin by launching Microsoft Visual Studio 2008. [Read More →]