Web Forms :: Upload Large Excel File - Use Multithreading?
Mar 7, 2011
i have a large excel file which has 1 lakh row , i want to insert these data in my table i am using entity framework for insert but it takes more than 45 minutes to insert which is too much, i want to speed up the uploading process what should i do. can I use multithreading for it if yes then how i can use? if any other way to do this process.
I have standard asp.net file upload control on a page. If a user try to upload large file they get all the cryptic error messages like page not found etc.I dont want them to be able to upload large files, but still want to show gracefull error message saying that file is too large to upload or something like that. Is there any way to do that?
What is better way to large upload file.using a web service or in application itself.If in application, how can we check that files is to upload in a regular interval.actually i dont want user to wait for complete uploading, when it starts uploading user will get response of uploaded and uploading will be done in backgroud.I am not sure this type of task can be done in webservice also so that user doesnot need to wait for complete uploading.and one more query which event fires when the page redirects to another page.Is it Page_UnLoad or Dispose
I am trying to upload file in WCF.When I try to upload file I am getting following error message. System.ServiceModel.CommunicationException:The socket connection was aborted.
I have a scenario which I am looking at where large files which are about 30-40 MB are being FTPed to a server. I am looking at creating a .net screen with the FTP control to upload the file to a Unix server. I need to know how much of a performance hit it is to work with such large files, is it a feasible option in this scenario? I might have to create a .net component for the same and call from ASP application. Is it doable?
I need large file upload support in my hosted (godaddy) medium trust asp.net app.It obviously needs to be responsive with indication of progress, so handling the stream myself is important.This all seems pretty simple and works well when in full trust:
1.Write an HttpModule that listens for file uploads.
2.Get the HttpWorkerRequest object from the Context using reflection.
3.Write out stream to a FileStream
All very well and good except that I keep getting permission exceptions when trying to get the HttpWorkerRequest object from the context in medium trust. Whether I use reflection or I use System.IServiceProvider.GetService() to get the object (which is clearly using reflection), I get the same error.
I have also tried using System.Web.HttpPostedFile. It has a property InputStream. But it seems this object is uploading the entire file on initialization, so no good.I have googled myself tired, and can't find another alternative.
Even if it is a security risk to let users have the HttpWorkerRequest object, surely the framework provides another way to handle the stream of files when Method="POST" and enctype="multipart/form-data"
My problem is Asyncfileupload control is working fine when i debug the application and upload large file...but when i run this from iis it only upload file less then 5 kb. why is that so?? i did try adding Httpruntime maxRequestLength="4096" i tried to find on search but no help... did m i mising any settings..??
This works in other browsers but not in chrome. I am trying to allow users to upload large files and have an ajax call to update them on the progress of the file upload.
So a unique ID is generated on the client side and added to the action of the form before sending. Then the form is submitted (form only contains a file upload input) and an ajax call is made to get the progress of the upload. The ajax call goes to another page and uses the ID to lookup the upload.
I am using JQuery 1.5.1. Debugging this and putting something on the error function give me nothing other than "error". Not very helpful. I used Chrome's debugger and it just says failed to load resource xxxx.aspx. xxx.aspx is the URL i needed. Turns out that there seems to be some sort of conflict between the form and the ajax call.
I have a simple webpage which uses the FileUpload control. I am trying to select a file from the local pc and save it to the web server which is a remote server on the company network. I have a shared folder on the web server with the appropriate permissions. The folder authentication is using a predefined user name and password.
I have tried My.Computer.Network.UploadFile and System.Net.WebRequestMethods.File.UploadFile. For both methods I am getting the following error:
System.IO.FileNotFoundException: Could not find file 'C:empfilename.xls'
I am trying to upload an excel file and my code reads the data of excel one by one. Unfortunately as we all know that excel doesn't restrict the data type for each cells, so there is a chance and possibility that my code can catch the exceptions.
How can I do this?
Code:
try { // do the statement } catch { // throw the exception, log it and then proceed to the next, don't stop. // then prompt the users of all exceptions encountered. }
I need to process more than 1,000 rows of data from excel. I don't want every time there is an exceptions the uploading process stops and fixed the problem then re-upload the data again. I want to consolidate first all the data with issues or exceptions then deal with it later after the uploading process done.
i need to control Only ExcelFile uploading with RegularExpressionValidator How can i do that? i need to write a regex pattern in ValidationExpression...
I've an application built on asp.net 2.0. There is an option for user to upload excel file. Once the file has been uploaded the data in the file is validated against some business rules. Rows that successfully validates are inserted into database as soon as it is validated.
I use ado.net to connect to excel file. And use data reader to iterate over all the records. Normally the number of records range from 5,000 to 20,000. This process takes good 8 to 10 minutes. I want to optimize this process because to my understanding it takes too long. Currently I am looking at OPENROWSET, OpenDataSource which so far is unsuccessful. Valiation that takes place on every row is very simple. I only checks for maximum length. So validation itself is not an issue.
I have a gridview that allows the user to export this gridview to excel. Here is my codes but I would like my user to be able to select where to download the file
Protected Sub ExportToExcel(ByVal sender As Object, ByVal e As System.EventArgs) Handles btnExport.Click lblMsg.Visible = True Try Dim objSw As New StreamWriter(txtFileName.Text.Trim + ".xls") 'Dim serverFilePath As String = "D:Excel Files" 'Dim fileStream As New FileStream(serverFilePath, FileMode.Open) 'Dim fileSize As Long = fileStream.Length 'Response.ContentType = "application/octet-stream" 'Response.AddHeader("Content-Disposition", "attachment; filename=""" & txtFileName.Text.Trim & """;") 'Dim fileBuffer As Byte() = New Byte(fileSize - 1) {} 'fileStream.Read(fileBuffer, 0, CInt(fileSize)) 'Response.BinaryWrite(fileBuffer) 'fileStream.Close() 'Response.[End]() Dim objDt As DataTable = DirectCast(Session("Data"), DataTable).Copy() 'Get No Of Column in GridView Dim NoOfColumn As Integer = objDt.Columns.Count...........................
We have the data in excel file and want to upload the same into Oracle table.To achieve this we are using following query insert into [ODBC:Driver={Microsoft ODBC for oracle};connectionstring].tablename (select * from sheet$ ) This is working fine for less records but when the record count increases following is the error faced. Error : System Resource Exceeded
We tried the following: 1. We tried to remove connection pooling for oracle. 2. We tried to remove connection pooling for excel. 3. We also verified that only one connection for each (oracle and excel) is open.
Our assumptions: 1. Either the server setting is the issue 2. Jet oledb Driver is the issue.
I need to create an upload site to upload large files over 2GB I want ot create a site like [URL]. Once these files get upload i want them to have a link to the file created but the link encrypted. I know there is a limit to http upload. I have used a bunch of the flash upload web apps but are capped at a specfic mb becuase of .net. What options are out there.