Comments on: SQL SERVER – Import CSV File into Database Table Using SSIS

By: SQL SERVER – Weekly Series – Memory Lane – #029 | SQL Server Journey with SQL Authority

Sat, 18 May 2013 01:31:23 +0000

[…] Import CSV File into Database Table Using SSIS It is a very frequent request to upload CSV file to database or Import CSV file into a database. I have previously written an article how one can do this using T-SQL over here Import CSV File Into SQL Server Using Bulk Insert. One of the request which I quite often encounter is how I can do the same using SSIS package and automate it. Today we will understand the same using images. […]

By: Paul

Paul — Tue, 14 May 2013 20:41:19 +0000

N to N column mappings as explained here (In DTS)
http://msdn.microsoft.com/en-us/library/aa933488%28v=sql.80%29.aspx

By: Paul

Paul — Tue, 14 May 2013 20:40:09 +0000

Does SSIS support N to N column mappings as DTS did ? I do not see it graphically as I did with DTS

By: thang nguyen

thang nguyen — Mon, 22 Apr 2013 09:43:20 +0000

Nice example

By: jinneshparekh

jinneshparekh — Wed, 27 Feb 2013 17:11:51 +0000

Hi Pinal, Great article to begin with, i am working in SSIS and am not sure on backward compatibility stuff supported in 2008, i have made a package with 97-2003 as source but if the version of excel is 3.0/4.0, would the behaviour of ssis change, do we need to explicitly handle this and also if we wanna make this .xlsx compatible what would be a good practice?
Thanks
Jinesh Rajesh Parekh

By: Chirag

Chirag — Mon, 11 Feb 2013 05:13:38 +0000

Hi,

I’m looking for the similar solution. Please let me know if you able to find it.

Thanx..
Chirag

By: Katie Webb

Katie Webb — Thu, 31 Jan 2013 17:15:29 +0000

Great article! I am just learning how to use SSIS (today) and your article is very helpful. I am wondering if there is a way to load a CSV file and change all blank strings to NULL across all columns without writing it out column by column?

By: Dennis Trunzo

Dennis Trunzo — Thu, 24 Jan 2013 15:19:27 +0000

Thanks! great articles…

By: Gnanasekaran Kuppusamy

Gnanasekaran Kuppusamy — Thu, 06 Dec 2012 07:58:52 +0000

Hi Madhivanan,
Am also looking for a solution for the same problem. Kindly reply if you have any solution for this. Thanks in advance.

By: Gnanasekaran Kuppusamy

Gnanasekaran Kuppusamy — Thu, 06 Dec 2012 07:41:15 +0000

Hi Saranya,
Am also looking for the solution for the same problem (both questions). Kindly reply if you have any idea to do the same. Thanks in advance.

By: Snamelisch

Snamelisch — Tue, 27 Nov 2012 09:33:49 +0000

Hi Pinal,
I’ve worked with and it worked great for a while. Now I have an issue. Somewhere in the csv file there is something bad. The file has about 200k lines in it, so manually searching for the error is not possible (although I’ve done that anyway). I seem to have no issues when reading the file into Excel or Access (for trying to find the error). Do you have an addition to the solution show, that enables me to exactly pinpoint the line that is causing the error?. By the way, I have tried to redirect the line containing the error to an alternative table. My (probably crude) attempt was not successfull

By: commissary

commissary — Mon, 26 Nov 2012 21:03:58 +0000

thanks pinal ..

By: SQL SERVER – Copy Data from One Table to Another Table – SQL in Sixty Seconds #031 – Video « SQL Server Journey with SQL Authority

Wed, 31 Oct 2012 01:32:13 +0000

[...] SQL SERVER – Import CSV File into Database Table Using SSIS [...]

By: Abhishek

Abhishek — Mon, 08 Oct 2012 11:47:12 +0000

Just got a doubt, if the file name changes everyday then what would be the mechanism. As in this case the file name is CSVfile.txt. Lets put an example. The file name would be CSVfile_20121008.txt (where 20121008 is today’s date). And this value will be changing regularly and the file would be placed in the same location(so the old file is deleted and only the new file as of current date is present). Is there any process for the same with keeping with the approach same of importing the data.

By: madhivanan

madhivanan — Thu, 06 Sep 2012 10:12:28 +0000

Do the files have date values as part of the names?

By: Gallop

Gallop — Wed, 05 Sep 2012 08:33:09 +0000

How can I load the latest csv file in a folder into the database table.I have 5 csv files with different modified times….I want to load the latest file.

Thanks

By: Raj

Raj — Mon, 27 Aug 2012 02:02:41 +0000

Hi Everybody,

Could you please suggest me how can I insert data from one flat file to different tables in sql server Database using SSIS or SQL code?

TB1*AP*ENH5895*86597*20120620~
TB2*395*000001*0052959874~
TB3*0569*00*E042165578*0034603409~
TB1*AP*ENH5895*86597*00501025836~
TB2*395*000001*00529265684~

I have a data like this format in flat file. I need to insert it into different 3 tables in sql server 2008 , named TB1, TB2 and TB3. here in raw file : fieldterminator = ‘*’ and rowterminator = ‘~’
1st and 4th rows records should be inserted in TB1 TABLE.
2nd and 5th rows records should be inserted in TB2 table
and 3rd row’s records should be inserted in TB3 table.

Thanks,
Raj

By: Pandi

Pandi — Thu, 02 Aug 2012 12:33:06 +0000

Hi Pinal,
I upload csv file but it execute operating system error… What can i do for this error. Any updation for OS. I am using XP sp1 .

Thanks,
Pandiyaraj

By: Maximila

Maximila — Wed, 04 Jul 2012 08:01:11 +0000

Hi, I want same with mulitiple files to load into database using Foreach loop container.

By: SQL SERVER – Importing CSV File Into Database – SQL in Sixty Seconds #018 – Video « SQL Server Journey with SQL Authority

Wed, 20 Jun 2012 01:31:57 +0000

[...] SQL SERVER – Import CSV File into Database Table Using SSIS [...]

By: madhivanan

madhivanan — Wed, 23 May 2012 13:05:23 +0000

Did you get any error?

By: Amitsinh

Amitsinh — Fri, 04 May 2012 04:09:56 +0000

Hello Pinal,

I need your help in Import 4GB .CSV file with 340 colums.

Its not allow me to import it

Thanks,
AMIT NAKOOM

By: Dev

Dev — Wed, 02 May 2012 09:52:00 +0000

Hi der, I am transformning txt n csv files into database through SQL plus/loader. I have file of transections where there are more than 1 columns holds negactve values. Now the problem is that in txt file a negative sign occurs on the right side of the number. .So I have multiply certain colums contents with (-1) it works for 1 colum, but what can I do with more than 1 colums containing negatives at the end. FOR EXAMPLE: |Jusq. 0 |Jusq. 30 |Jusq. 60 |Jusq. 90 |Jusq. 180 | |760.288 - | 653.612 | 145.456- | 117.814- | 170.807 | |760.288 | 653.612-| 145.456 | 117.814- | 170.807- | |760.288 - | 653.612 | 145.456 -| 117.814- | 170.807- | |760.288- | 653.612-| 145.456 | 117.814 | 170.807 | |760.288 | 653.612-| 145.456 | 117.814- | 170.807- |

By: mercified

mercified — Wed, 25 Apr 2012 00:22:51 +0000

nice explanation. thanks.

By: Offer

Offer — Sat, 24 Mar 2012 23:09:13 +0000

Dear everybody.

I’m still waiting for a solution to load current data from live dynamic CSV file (mail server log file).

How can I make the connection to it, and read it line by line whenever a line is added?

Thanks!