I'm using SqlBulkCopy to restore tables from xml backups. One of the table backup is ~200MB large and has a lot of records.
I'm having error:
Timeout expired. The timeout period elapsed prior to completion of the operation or the server is not responding.
Using sql server 2005 and vb.net 2005.I'm creating a .net console application where I am doing a SqlBulkCopy from a non-sql server db to a sql server db table and on the call for the bulk insert:
[Code]....
I'm getting a time out error after around 1 minute, however I set BulkCopyTimeout (see above) to 100 minutes, the error:
<ERROR>
Timeout expired. The timeout period elapsed prior to completion of the operation or the server is not responding.
</ERROR>
Has anyone experienced this and how to fix this or how do I change the timeout so I dont get this error?
I'm using the SqlBulkCopy within my asp.net C# web form. I'm able to upload my excel file, but if the first row has any blank cells in it, that colum does not upload, I was wondering if anyone had any luck in looking for NULL/Blank cells and if so how did you handle them for the insert into the database?
View 6 RepliesI am confused by some behaviour I am experiencing when I use the SqlBulkCopy command.I have two tables in my SQL server database that I use to upload 2 tables of data from an excel workbook. The primary key of each table is customer account number, the first table being a table of accounts, the second being a table of details with the account number linking the 2 tables creating a one-to-one relationship.The bulk copy works a treat apart from one rather problematic situation I have found when performing error handling. If I put an account into the details table that does not appear in the customer table, instead of causing key violation errors it still adds the entry - I was under the impression that this was impossible?
If I go edit the entry using SQL Server management studio, I cannot change account numbers to anything that does not exist in the other table thus showing that the relationship exists and works when using standard update SQL.Does anyone have any idea why and how data that violates key violations is allowed through when I use SqlBulkCopy?
I'm successfully using SqlBulkCopy to import spreadsheet data.
I am trying to add 2 additional fields,'UserID' and the specific 'employerID' whom they're logged in as.
Both these ID's are on the page. However how do I tag them on to my column mappings statement?
These ID's aren't on the spreadsheet but I need to know whose imported the data and from where
The columnMappings structure:
[Code]....
I am impoting data from CSV file to my sql server database.
I successfully get data into datatable and using the SqlBulkCopy method to import data into database.
It's working fine.
But i want that if record id is exists then update the record do not insert that record.
I have a customized data import executable in .NET 3.5 which the SqlBulkCopy to basically do faster inserts on large amounts of data. The app basically takes an input file, massages the data and bulk uploads it into a SQL Server 2000. It was written by a consultant who was building it with a SQL 2008 database environment. Would that env difference be causing this? SQL 2000 does have the bcp utility which is what BulkCopy is based on. So, When we ran this, it triggered a Deadlock error.
Error details: Transaction (Process ID 58) was deadlocked on lock resources with another process and has been chosen as the deadlock victim. Rerun the transaction.
I've tried numerous ways to try to resolve it. like temporarily setting the connection string variable MultipleActiveResultSets=true, which wasn't ideal, but it still gives a Deadlock error. I also made sure it wasn't a connection time out problem. here's the function.
/// <summary>
/// Bulks the insert.
/// </summary>[code].....
i am making bulkcopy from excel sheet to database and it is working fine , but my requirement is , i have previously inserted column in excel and other columns are blank therefore i want to update the table using sqlbulkcopy . how to perform it.
View 1 RepliesI do not want to insert duplicate values in sql serve if values is exists in DB and excel value be skip.
View 1 RepliesI want to bulk insert the datatable data into database.I can not use sqlbulkcopy class.since,I am using oledb.
View 3 RepliesI code to exec a store procedre (sp_truncate) to truncate 10tables and using sqlBulkCopy to download a huge data. Both them are working fine.Now I want to use transaction with application (not in store procedure) torollback truncate tables if download is failed.Is it possible to use transaction to work with these two steps?
View 1 Repliesi am facing problem in sqlbulkcopy function.
in database i have one ID column in where i am generating unique id through db function.
now for insert query its working properly but when i am using Sqlbulkcopy the default value fuction not executing.
I am new in asp.net..My Problem is i have 3 textboxes..
in first text box i enter A1,
Second Textbox i enter 3,
Third Textbox i enter 5
after button click i want to store
A1B1,A1B2,A1B3 as per second textbox i enter 3
A1C1,A1C2,A1C3,A1C4,A1C5 as per Third Textbox i enter 5
how to generate the above rows and how to save in database
I'm using SqlBulkCopy to load large file into databse, but a file bigger than 200k give me an error outofmemoryexception. Is there any way to append data into database from a file splitted in two. the first time I can use SqlBulkCopy, but to append second file into my table.
View 1 RepliesI read a CSV file into a DataTable.The DataTable in the first image shows each column and type.The types are exactly what they are supposed to be and the data loaded all the rows it was supposed to load.From the second screen shot you can see the database table. SqlBulkCopy is supposed to map column names to database columns by default.According to that logic each column matches up exactly to the database and the column types also match.However,when I run the command it errors on the first row with:
"The given value of type String from the data source cannot be converted to type decimal of the specified target column."
Here is the StackTrace:
"at System.Data.SqlClient.SqlBulkCopy.ConvertValue(Object value, _SqlMetaData metadata) at System.Data.SqlClient.SqlBulkCopy.WriteToServerInternal() at System.Data.SqlClient.SqlBulkCopy.WriteRowSourceToServer(Int32 columnCount) at
[code]...
Anyone have any ideas why this will not import correctly?
http://www.daviddelella.com/Images/Image1.jpg
http://www.daviddelella.com/Images/Image2.jpg
Hopefully I am posting this in the correct forum.
I am having a problem with my ASP.Net Web application. The application is developed using vb.net and is linked to a SQL Server database. Let me explain how the application works and the problem I am experiencing. The system is an online web app which allows registered users to create a CV online. One of the pages within the app gives users the chance to add a cover note to their CV. The page that allows them to do this consists of only a textarea control and a button control. The textarea allows users to input up to 4,000 characters.
Once the user clicks the 'Save' button to save their cover note info, the following code then executes.This code checks to see if the CV already has cover note info, if it does, then the application runs an update statement, otherwise, it runs an insert statement.The table within the database which records the cover note information is called tbl_covernote and has three columns, covernote_id (int and autoincrement), cv_id(int), covernote_text (nvarchar(max)).
The error which occurs sometimes is as follows:
Dim dr As SqlDataReader
Dim param(0) As SqlParameter
Finally [code]...
I am attempting to use SqlBulkCopy to import data from an XML document. I receive the following error when executing WriteToServer: Invalid cast from 'System.String' to 'System.Guid'
View 1 RepliesHow to use SqlBulkCopy for import excel data into windows with high performance.
E.g.: using SqlBulkcopy.TableLock options
I would like to use a progress bar with SqlBulkCopy, but am unable to find any examples. The solution needs to have taken into consideration using SqlBulkCopy for displaying percentage copied to SqlServer.
View 1 RepliesThe problem is I have a stored procedure that runs consistently in Sql Server Management Server with a time of 2 seconds but when calling that same stored procedure from code it times out.
When it runs correctly from SSMS it should return about 30 rows.
I've tried a few different ways to call the procedure from code but every time the same result. This just recently started happening, yesterday it was working fine.
The preferred method for calling the procedure for us is using Linq2Sql which gives the following error message:
[code]....
I am getting the following error on my page:
System.InvalidOperationException: Timeout expired. The timeout period elapsed prior to obtaining a connection from the pool. This may have occurred because all pooled connections were in use and max pool size was reached. at System.Data.ProviderBase.DbConnectionFactory.GetConnection(DbConnection
owningConnection) at System.Data.ProviderBase.DbConnectionClosed.OpenConnection(DbConnection outerConnection, DbConnectionFactory connectionFactory) at System.Data.SqlClient.SqlConnection.Open() at _default.commentCount(Int32 ArtID) at ASP.default_aspx.__DataBind__control4(Object
sender, EventArgs e)....
I thought I had closed all the connections in my code:
[Code]....
I am working on one application and it has report functionality in it. i have one stored procedure which is doing some calculation and inserting whole calculation in one table and then that table will show up in one report..this insertion procedure may have to insert 5000 number of records or more than that so while my stored proceudre is executing that calculation and insertion part, my application is thorwing below exception :
Timeout expired. The timeout period elapsed prior to completion of the operation or the server is not responding.i have set timeout in web.config i.e. timeout=10000000...still throwing an exception
We are seeing the following timeout error being logged into our Event Viewer every now and then. We are using LINQ to connect to the SQL Server 2008 and the connection string is defined in the web.config file.One wierd thing I noticed is that the .NET framework is timing out trying to detect if this is SqlCe connection string. Why is it trying to waste time and then timing out when we have a SQL Server 2008 as the database?
What can I do to fix this problem?
Server: Windows 2008 R2 64-Bit
\IIS 7.5.7600.16385 Application Pool: Integrated Mode with 32-Bit Applications Enabled. Queue Length = 5000, Indentity = Network Service.Database Server: SQL Server 2008
[code]...
now i need to test on a website, which i able to login to the main website and some of the sub-website or sub page. but when i click on 1 of the link to link to the page. it always show me Timeout expired.
I already try to restart the IIS admin service and make sure my database is up and connected.
now i test on my development server. so the website i browse is at localhost.
Timeout expired. The timeout period elapsed prior to completion of the operation or the server is not responding.
The error i get as below. hopefully get some idea to solve this issue.
Description: An unhandled exception occurred during the execution of the current web request. review the stack trace for more information about the error and where it originated in the code.
Exception Details: System.Data.SqlClient.SqlException: Timeout expired. The timeout period elapsed prior to completion of the operation or the server is not responding.
Source Error:
An unhandled exception was generated during the execution of the current web request. Information regarding the origin and location of the exception can be identified using the exception stack trace below.
Stack Trace:
[SqlException (0x80131904): Timeout expired. The timeout period elapsed prior to completion of the operation or the server is not responding.]
System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection) +862234
System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection) +739110
System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj) +188
[Code]....
We have been getting this Oracle connection pool exception a lot recently for our ASP.NET website. This is the detailed exception message:
Timeout expired. The timeout period elapsed prior to obtaining a connection from the pool. This may have occurred because all pooled connections were in use and max pool size was reached.
This is our connection string
User ID=user1;password=password1;DATA SOURCE=Datasource1
how to set max pool size to 1 so that I can debug it on my local?
what is the recommended pool size for a website with 10,000 users?