I have contact mails large than 700.000 Mails and i want to insert them in sqlserver using c# in a few minutes not hours i know that pre impossible but , i know there`s way to do it
View 4 RepliesI want to generate 30,000 cards and each card must be duplicate check with database. In my card, there are 2 things. Serial No and CardID. If any card already exists then I generate another card id but with the same serial no.
So how faster way I can generate 30,000 card with duplicate check? Which one I have made application, it takes about 25 minutes to insert.
I need to insert large amount of data into SqlServer 2008. My project is based on linq-to-sql.
I process csv file with 100.000 rows. Each row is mapped to Order object. Order contains also collection of Category and Code objects. I need to map each row to object in order to validate it.
Then I need to insert all these objects into database.
List<Order> orders = Import("test.csv");
db.Orders.InsertAllOnSubmit(orders);
db.SubmitChanges();
OR
foreach(Order order in orders)
db.Orders.InsertOnSubmit(order);
db.SubmitChanges();
Both ways are slow. Is there any workaround? I may use other approach than l2sql for this task.
I read about SqlBulkCopy class - would it handle inserting child entities as well?
i want to to sotre large amount of character in one field of a table i use text-nvarchar(max) and but it show me this exception
(String or binary data would be truncated The statement has been terminated.) I know that text and nvarchar can store 8000 character
I have a project that will be assigned to me soon whereby I need to develop a survey which needs to support 40,000 users approximately. Now we are thinking of doing a staged approach so not all users are on the server at any one point of time. Probably splitting it so we can serve at least a few thousand of users...
I dont have much experience of how I can ensure to serve those levels of users on a server and how to manage this so I am after some advice?
From my understanding I need to do some stress testing on a server and obviously I need some figures i.e. average size of request, average size of response and content of response.
- Do I have to build the database and add records in to see what size is a typical survey row?
- Do I have to build the survey in .NET i.e. by adding controls etc and seeing what size is the page?
- The survey shouldnt be too instensive processing wise, it will be adding information into a backend sql database...
we have a classic ASP Webpage for displaying reporting data.
The process is following:
user inputs reporting criteria reporting criteria are passed to a method in a VB6 DLL containing the reporting business logic (generating a dynmic sql statement) VB6 DLL method returns xml data xml data are displayed with xsd transformation 150.000 datarows are displayed in some seconds (less than 10 seconds maybe) Now we want to extend this reporting function and decided to use asp.net (2.0) So I have written a little prototyp application with a SqlDataSource Object and a GridView Control.
A table with less data (about 100 or so) are displayed quickly.
But a view with about 150.000 datarows needs about 2 minutes and ended with a OutOfMemoryException!
The request of the customer is definitvely to display the data on one page like in the old classic asp application!
how to display large amount of data in griedview with serach funcationality.(the data should be 20 L)with example in asp.net.
View 1 RepliesI want to bind large amount of data in gridview using jquery but without paging.
I am taking reference from this post
[URL]
But when there is large amount of data, it's not working
If you had to get large amount data(nearly 230.000 rows) from database(I use oracle) to an excel file with asp.net, how would you do it?
View 2 RepliesI am trying to show a large amount of data in gridview but the problem is that everytime data increase the gridview row size increase automatically.
is there any possible way that the data which is stored in my MS access Database display in multi line instead of one single long line.
I have a database of about 50 tables and some of the tables have more than 9999999 records. When I try to fetch some data on some SQL statements, sometimes it takes more then 5 minutes. I would like to know if there is good searching approach to get data from that much records in many tables.
View 6 Repliesi have write data from db to .txt file,where db have large amount data,i need to wite data into file, if some error occure, then reInitiated that file and write data again without stop process.that is Continuous calling same process
View 2 RepliesI was looking for JQuery Grid which will help me more than 1000 - 2000 records. I mainly need search and paging . Can some tell me with its own experience
View 3 Repliesi want to show some contents out of large amount of data...and want to apply read more link so that after clicking the link all data will shows on next page..how can i show the some contents out of large data ....
View 1 RepliesI have above 4,00,000 records. I have more searching options.
Is filter expression is good for better performance or I will build the query with WHERE condition?
Which process is better for searching in large amount of data?
want to make fast search over 5,00,000 records in asp.net web application.
View 5 RepliesI have about 5,00,000 data. I want to display the records according to group by. It takes to me about 2 minutes. Is it good?
If not, then what is best process to display the record in a very fast way?
Moreover, I have encrypted one field in database and encryption is done from my code behind. So when I display the records, I have to decrypt those. That's why I make paging on 100 records per page.
have developed a Asp.net application which uploads data from Excell Sheet and then Inserts those data after doing several Checks to the Mysql data base.The Issue which Iam facing is that when Iam uplading lage amount of data at a time say around that 10000, the application crashes and gives the Unable to Open connection to server Error.The same app works well 1000-2000 data.
View 1 RepliesI have a WCF method that returns a huge number of rows, causing a long wait for end user.
Also I do not have IIS7 but only IIS 6 for my WCF.
Is there any way I can speed up the WCF response so user does not wait for a longer time?
I have a scenario for which I wanted the best solution in asp.net c#. My application allows users to retrieve search data from database, this data is the users own temporary list of records which they can search, delete records or select them. All these actions are only on users temporary data list and not on the data base. I have currently carried out this functionality using data table which is stored in session. This method is causing problems when huge amounts of data is held in session (eg: 7000 records). I need a best possible solution for this. Is creating temporary tables an option? Can it be assigned to particular user sessions? Please point me to the right direction and right articles.
View 5 RepliesI need to store a large amount of data in user's session but I guess using Session Object is not the best way of doing that. Is there any other way around??? Remember I don't have small variables to store, I have large collections.
View 5 RepliesI have Sql Table for Products that have ~8000 records. In my web form I want use dropdown list to edit code with dropdown list. This drop down list populate very slow. How to increase speed to populate dropdown list with large amount data.
View 1 RepliesHow to insert data from local SQL server to remote SQL server (without using linked server) like below?
insert * into [remote server].[northwind].orders
from [local server].[northwind].orders
I have an application that is developed using VB.Net that is saving data in SQL Server 2008. in this application i have to save a big amount of data in one button click. When i say big i mean around 21000 record in one table. this is taking a lot of time since I'm calling the "Insert" procedure around 21000 time from my application. What i want to do is to find a way to put my data in a kind of container then let VS or SQL 2008 manage the saving. I'm thinking of putting the data in a dataset.
Is this the best solution, or is there any other way to reduce the saving time of the 21000 records?
In my program, I need update a filed to the database. The field is for a pdf file content. I know, maybe I should save the pdf file to the local file system, and save the file path to the SQL. but, right now, it is the file content saved to the SQL.
from my program, it loads the file which is input by user. I use File.ReadAllBytes. Then, run the stored procedure on the SQL server, and use the bytes[] as parameter, to insert the file to the SQL. it works fine when file size is small. However, as file size becomes larger, say 200MB, sometimes, it pops out of memory exception.
So, I'm thinking, maybe I can load parts of the file, say 1MB a time, then update the database, then loop. so, this way, no matter how large the file is, it should not have any problem.
my question is: is there a standard way to do this? so, I should not save file content to the SQL at all? shoudl save file in file system, save the file path to sql only? or there are other way to deal with this?