Architecture :: Extract Large Data From SQL To CSV Using Asynchronous Function
Oct 16, 2010
I have a table growth 100000row per day, I'm facing many problems to export data from this table using ASP.net page.
I don't know how to apply this scenario:
Senerio 1:
1- run Asynchronous function to export data from SQL for specified period to CSV file (without locking the table)
2- Refresh page every 5 sec in order to track the status of extracting data
3- compress the file
4- Stop refreshing and showing the download link in order to download the compressed file
or
Senerio 2:
1- run Asynchronous function to export data from SQL for specified period to CSV file (without locking the table)
3- compress the file
4- send the compressed file by Email
View 3 Replies
Similar Messages:
Jul 30, 2010
I am working on 3 tier architecture: UI, BL, DAL. In my UI i have following code for Asynchronous page processing:
[Code]....
But I want a database fetch operation to be performed in this asyncronous method. And due to 3 tier arch. i am unable to do this in UI Layer. Can anyone guide me that how can I implement Asynchronous processing in 3 tier architecture? Note: If you are going to place EndAsyncWork1 in DAL then show that how can I return a value back to UI layer from this function.
[Code]....
View 1 Replies
Mar 10, 2011
I have a C# asp.net file upload form with a submit button. After the form is submitted the file is uploaded and post-processing is started. The point is that the post-processing can take up to several minutes.I would like to create some kind of asynchronous call of the post-processing function with showing information to the user
View 4 Replies
Nov 3, 2010
I'm developing chat application on asp.net mvc, in my app, user can create room and invite other join to chat, but don't need to save chat room information.So, I designed to save all chat message ,room information and user info in Session and clear it when owner close the room.I'm worry about stressing server when I save alot of data (include room info, user info, and message) in Session if there are up to 5000 rooms created and alot of messages transfered in that room.Is my solution good enough ? is it ok to save in Session ?
View 3 Replies
Apr 28, 2010
I have implemented the 3-tier architecture project; DAL, BAL, and presentation layer are three layers in it. I am going to implement the following scenario:
Presentation layer calls to a function in the BAL layer which returns 2 string variable, and in turn this function from BAL layer calls to a DAL layer function which also returns 2 string variable. How can I implement the above scenario?
View 2 Replies
May 17, 2010
is it possible to make an asynchronous call to a static class function?
View 3 Replies
May 10, 2010
I have to call a function to run a report through a web service, then call another function to get the data but only after the 1st function has finished processing. How do I make c# wait till the first function has finished processing to run the second function?
my code looks something like:
NetworkCredential Cred = new NetworkCredential("uid", "pw");
ReportWebService reportService = new ReportWebService();
reportService.Credentials = Cred;
string s = reportService.runReportAsync("0ede9884e6394daf73fa418e9bffd4fc");
string report = reportService.getReportData(s);
This code will break because s is not set since the function (runreportasynch) has not finished running to produce s.
View 1 Replies
Apr 4, 2010
I am currently working on a page that has 13 gridviews in it. Each one is in a control and a separate updatepanel. The time from link click to page load is 20 seconds though and I am looking for ways to load the controls asynchronously so that the page can load and then the data can come after. I have tried a few different methods so far but have been unsucessful so far. I thought about using the Ajax incremental page display pattern but I did not think this would work because it only returns html. I need to load the gridviews in and they need to support pagination and sorting.
View 5 Replies
Feb 4, 2010
I have a scenario which I am looking at where large files which are about 30-40 MB are being FTPed to a server. I am looking at creating a .net screen with the FTP control to upload the file to a Unix server. I need to know how much of a performance hit it is to work with such large files, is it a feasible option in this scenario? I might have to create a .net component for the same and call from ASP application. Is it doable?
View 3 Replies
Jul 11, 2010
how a large ASP.NET webapplication can be structured / designed with "subwebs" !? In other words I want to structure a large web-application where I have a solution with more web-application projects. These projects are more or less independent "modules". One project should be a kind of frame application with shared masterpages, an shared sitemap and and a shared authentication. Later it should also be maybe possible also to integrate loosely older websites (which where written in classic ASP. ASP.NET 1.1, ASP.NET 2.0), but this not so important at the moment
View 1 Replies
Feb 17, 2010
I need to create a method which looks through a large string of text, and determines which words (apart from words like "a" "and" "the") are the most frequently used. I would like to determine which are the top 3 most frequently used words in a string of text...is this possible?
View 4 Replies
Jan 21, 2011
I am building a small mass email application for my department. Which basically emails out a notice to a large list of email addresses. Because the company email server limits the amount of email addresses that can be contained in a single email I have to break the list apart into smaller 100 email groups.
I've create the query to pull all email addresses needed, stuffed them into a collection but I am not sure how to grab 100 emails at a time and send it off to another sub to perform the email send before grabbing the next 100.
This is what I have so far.
[Code]....
View 5 Replies
Oct 5, 2010
I have a project that will be assigned to me soon whereby I need to develop a survey which needs to support 40,000 users approximately. Now we are thinking of doing a staged approach so not all users are on the server at any one point of time. Probably splitting it so we can serve at least a few thousand of users...
I dont have much experience of how I can ensure to serve those levels of users on a server and how to manage this so I am after some advice?
From my understanding I need to do some stress testing on a server and obviously I need some figures i.e. average size of request, average size of response and content of response.
- Do I have to build the database and add records in to see what size is a typical survey row?
- Do I have to build the survey in .NET i.e. by adding controls etc and seeing what size is the page?
- The survey shouldnt be too instensive processing wise, it will be adding information into a backend sql database...
View 4 Replies
Aug 30, 2010
I'm having trouble retrieving the value of a cell in a gridview.
I think it may have something to do with the item template calling a function since I am able to retrieve the values of cells that are not calling a function in the same gridview.
How can i extract the displayed value from this cell?
protected void GridView1_SelectedIndexChanged(object sender, EventArgs e)
{
GridViewRow row = GridView1.SelectedRow;
lblTest.Text=row.Cells[7].Text;
}
<ItemTemplate>
<%# GetWednesday(decimal.Parse(Eval("Wed").ToString())).ToString("N2") %>
</ItemTemplate>
View 1 Replies
Sep 13, 2010
It is a very large .txt file (more than 3M), and produced everyday, the content is user's system log like below:
2007-11-01 18:20:42,983 [4520] INFO GetXXX() SERVICE START
2007-11-01 18:21:42,983 [4520] WARING USER ACCESS DENIED
2007-11-01 18:22:42,983 [4520] ERROR INPUT PARAMETER IS NULL CAN NOT CONVERT TO INT32
2007-11-01 18:23:59,968 [4520] INFO USER LOGOUT
View 14 Replies
Mar 11, 2010
So this interface allows one server to request data from another server. The catch is that all xml for the interface is transmitted entirely over http posts followed by an empty status code 200 response. No data is sent in a response. So if my application wants to requests data, we send an http post with the xml request and receive a blank 200. Then, shortly after our request, we'll receive an http post to a predetermined URL with the xml data which we then send a blank 200. This data will then be stored in a SQL database. This interface cannot be altered.
The reason this is problematic is because our server is handling requests from clients that need that data in the response. If a user requests for data that isn't available in our database, it needs to be requested from the interface and then returned in the response. I'm just not sure how to get this to work out. I've thought about polling the database, but I'm worried about thread pool issues. I've also looked into using ManualResetEvent.WaitOne to halt the processing of the client request and then calling Set when the interface sends the data (as a request). I've read that wait threads are shared, but just don't know if this will scale well. Does anyone have any insight or I'm pretty much stumped on this one...
View 4 Replies
Oct 24, 2010
what is the function of abstract class, why design pattern need to build BLL and DAL
anyone give an example for my reference as I am getting strat to build my web-based project
View 3 Replies
Jan 26, 2011
c#/vb webapp. I'm working on a very old app with a ton of pages. I want to add a function to every page's PreRender. If this application was designed properly from the start, it would use a MasterPage, or would at least inherit all pages from a BasePage other than System.Web.UI.Page.The goal is that every aspx page's PreRender should trigger a call to FooFunction(). I'd like to have this done all in one page, to avoid opening every single .aspx file and changing it's inheritence / pasting FooFunction() / some other time waster.Is there a way to do this in .net? Can you point me in the direction of any design/discussion articles?
View 5 Replies
Jan 20, 2011
I'm comfortable sending emails to individuals in ASP.NET, but recently have needed to create a function to send an email to all users in a particular role.
A couple of problems I'm having are:
My shared hosting allows 200 emails per hour. Although not an issue at the moment it could be very soon, so how can I 'throttle' my application to not send out more emails then I'm allowed to?
If want to loop through the emails and send the messages in the background of my app. Rather than have a situation where logging off or closing the browser stops the process. point me in the direction of some articles about this type of thing, my searching so far hasn't given me great results.
View 2 Replies
Feb 26, 2010
I have many locations stored with addresses and longitude/latitude information in my database.I need a function or store procedure which returns only locations near by 10kms of given longitude/latitude parameters.It is not neccesary to be a sql query but I am fine with any other solution.
View 6 Replies
May 12, 2010
I have an process that take about 15minutes to execute. And i have toput this process in a service, and managed his statWell, i placed this process in a service and in some specific pointi have one variable telling me how much % the process have done.So my service reference im my consumer project its typed to let asynchronous calls.When i start my process with a
[Code]...
View 2 Replies
Aug 20, 2010
first i'll describe my problem:
I have payment form with a clients dropdownlist that is populated from a database on form load with:
value field = clientIdtext field = nameId
<asp:DropDownList ID="selClients" runat="server">
</asp:DropDownList>
When user makes a payment, it's necessary to chose a client from selClients, and so i get the clientsId value and build my insert SQL query.
Until here, no problems.
The problem with my UI has started since i had a lot of clients been registered: My dropdownlist became huge and it's taking too much time to load it's contents on page load. Also the dropdownlist area is taking a large area from page screen.
So i tryied a solution with jquery autocomplete plug in. I put a textbox with autocomplete for client name and another hiddenfield to receive the clientId when user select a item.
That solves both problems:
No more large amout of data loaded on page loadThe dropdownlist doesn't take a large area from page screen
But it gave me another problem!
With a textbox, there is a possibility for wrong input client name. So if i don't have a valid clientId in hiddenfield, it will generate a database INSERT exception because it doesn't respect the client table constraint:
payment table REFERS client table
I'm trying to find kind of dropdownlist where the user can type text with autocomplete. Like this, the user will be able to select only data within the possibilities of the dropdownlist and i always will have a valid clientId.
View 3 Replies
Jul 1, 2010
I have a scenario where I have two data grids (both dynamic) to be loaded onto a page. However, the data that needs to be shown on one of the grids has no dependence on the data of the other grid. So, when fetching the data, I want to fetch it in an asynchronous manner and bind that data to each of the grids individually. Currently we have a code like
GetData(ForGridOne) ;
GetData(ForGridTwo);
I want to make these calls asynchronously so that in order to load the page, the time taken would be lesser. What should be the ideal way to go forward with this ? One more thing, we would be hosting the application in a portlet which doesn't support AJAX.
View 1 Replies
Jan 5, 2011
I am having a gridview in which there are many columns. The Last column is button column with command name as Select.
In row command event, I am creating a webreqest instance and passing the url of the required page in my application, and based on the response status code, updating the column value for that particular row.
This is working.
What I want is this should be asynchronous. Means, if I click the first row Select button, then it should fire and process request. Meanwhile I should be able to click other row's Select button, even if the previous button's click event is still in process.
Means the communication should be asynchronous. Even if
View 1 Replies
Jan 24, 2010
I have got a text file that I need to extract details from.the text file is in the following format:
FirstName SurName (emailaddress)
FirstName SurName (emailaddress)
FirstName SurName (emailaddress)
FirstName SurName (emailaddress)
FirstName SurName (emailaddress) Etc.
Ideally I would like to have the the contents saved to an additional text file in the following format:
FirstName,Surname,EmailAddress
FirstName,Surname,EmailAddress
FirstName,Surname,EmailAddress Etc.
View 6 Replies
