PHISSUG

Home of Filipino Sql Server Enthusiasts
Welcome to PHISSUG Sign in | Join | Help
in Search

Importing 6GB CSV Flat File to SQL Server

Last post 10-14-2007, 11:24 PM by Arthur Jr. 4 replies.
Sort Posts: Previous Next
  •  10-11-2007, 12:29 AM 2172

    Importing 6GB CSV Flat File to SQL Server

        Hi to all, can somebody help me with this problem? I tried the DTS of SQL but it does not work. I tried creating a data flow in SSIS but it seems that my CSV file is too big because the I/O buffer overflowed. What to do?????
  •  10-11-2007, 3:38 AM 2174 in reply to 2172

    Re: Importing 6GB CSV Flat File to SQL Server

  •  10-12-2007, 3:56 AM 2176 in reply to 2172

    Re: Importing 6GB CSV Flat File to SQL Server

    There could be other reasons that resulted to the buffer overflow exception and not just the size of your csv file. Is this just a firehost insert, or you have transformations in the process? As there are other ways of doing this, lets try to solve it first with SSIS as this is the best candidate for the job.

  •  10-14-2007, 9:44 PM 2181 in reply to 2176

    Re: Importing 6GB CSV Flat File to SQL Server

    I don't know what's a firehost is. What I did was create a data flow (Source: flat file = my csv 6GB file) and (Destination: SQL Server database table). That's it. But when I tried running it, the item for the source generates an error about the overflow. I will try using the BULK Insert tool from the Control Flow tools. Thanks. :)
  •  10-14-2007, 11:24 PM 2182 in reply to 2181

    Re: Importing 6GB CSV Flat File to SQL Server

    i think that overflow is caused by BAD data in your csv.

    i created a 6G csv file and import it to table using SSIS and it works fine. I used Flat File Source and Ole DB destination and No transformation, just direct import.

     

View as RSS news feed in XML
Powered by Community Server (Personal Edition), by Telligent Systems