I am looking at upgrading a realtime program ASP.NET C#, that takes very frequently updated data and moves it from one database to another.
Currently using a middle man app, that pulls from one and inserts into another using SqlBulkCopy.
Is it better to have the source db server write a flat file and the middle man collect from that flat file?
I am new to databases and linq, so my problem may be considered trivial. I currently start all my db requests in each class with:
DataClassesDataContext db = new DataClassesDataContext()
Then I proceed to make whatever linq request I need within the method and carry on with the main application logic.
Now, two interesting queries:
1) I believe I have seen people wrapping db usage within 'using'. Such as:
using (DataClassesDataContext db = new DataClassesDataContext())
{
...
}
If this is correct, then doesn't it mean that my class can't use a member 'db' variable anymore, but rather those db requests need to be made within each function call? Also, what exactly would happen if I don't use 'using' within the calls?
2) Running my app with SQL Profiler enabled, I see lots of connections opening and closing. Does this means that each
DataClassesDataContext call makes a separate connection? It seems inefficient, so is the right way to actually make the DataClassesDataContext object a static within each class being used?
i have flat files in some direcotry. each flat file contains around 60,000 rows of data. earlier we were using excel sheets to upload data. but now the challenge is it is taking more time to upload data into DB tables. which is the best way to upload such a huge data into db tables. can we use SSIS for uploading data. if so, how can we achieve that.
View 1 Repliesretrieving data from sql server 2000 database which has four tables. 3 of them has 256 datafields. And I need to retrieve all columns from all table for last 3years. All tables are related through a coman primary key.
So, Total data is 300,000.
I have a flat file with text that has a special character like this: "RIBAŽ Generic Strip Labeling." so the registerd symbol is coming as square when i am simply reading the file in c#. is there a way to read the symbol as is and print on screen? i am working in on a console application. Also other german characters, not all but a few are showing as squares as well.
View 3 RepliesI'm using a log file to document info while getting and processing info from a form
1. if not post back, open the log file, build page, send form. 2. get submit back from form, possible post back if errors, possible writes to log file, if no errors definitely writes to log file, and send confirm page. 3. postback from confirm page can either be going back to form or finalizing, and send acknowledge page, then done.
so I need to keep the logfile object between direct postbacks to the form, or posting back to orignal form page after gettting a postback from a confirm page.
this type of file setup works fine, it creates a single log file per day:
[Code]....
then successive writes are like this:
[Code]....
when the form submit comes back from the original send/submit, lf from above is 'nothing'
saw the post about 9 ways to maintain state, not sure at all which would be most appropriate to keep the lf object accessible between possible postbacks and submits to the form.
I am working on an SSIS package that needs to read a flat file and load the data into a SQL table. The problem is, the flat file name changes because it incorporates a date similar to this:
fileName_2010-04-12.txt
I found this site that shows how to set up a dynamic flat file connection:
[URL]
I understand the principle, but what I'm struggling with is using it in my data flow task. I need to configure the column mappings. In the PROPERTIES of the flat file connection, under expressions, I set up a ConnectionString with the following:
@[User::DataLoadDir] + @[User::priceFileName]
where [User::DataLoadDir] is the path where the file resides and [User::priceFileName] is a variable that should have the name of the specific file I want to read.
However, when I try to set the column mappings in the flat file connection, it's pulling the column headings for a different file in the same directory.
I have to get input from user in flat file format.then convert it to xml. Then, i have to store the entries into a datatable in the database. say 1,2,3 a,b,c be the user entries. it shall be stored into a table with 2 columns.how to do this?
View 1 RepliesI've an arraylist having 30000 items in it, what's the best way of creating a text file on the fly from an ASP.NEt page? Currently I'm using the code below but it times out with large data,
Using fileStr As New FileStream(sFileName, FileMode.Create, FileAccess.Write)
Using writer As New StreamWriter(fileStr)
writer.WriteLine("Error Messages") [code].....
I am trying to export images from my SQL server to SSIS's Flat file destination but keep getting the same error: Error 0xc0208030: Data Flow Task: The data type for "input column "image_full" (105)" is DT_IMAGE, which is not supported. Use DT_TEXT or DT_NTEXT instead and convert the data from, or to, DT_IMAGE using the data conversion component. (SQL Server Import and Export Wizard) The data type is IMAGE in SQL DB. I would like to export the image and save the same in local folder. Is their any way to perform this task using SSIS flat file destination? What is the best and easiest way to do this? What format should I be exporting to?
View 1 RepliesI have function called getdoctor () in asmx file I wannna call this webmethod from javascript and get the result into flat text i.e i wanna get the name doctor name not in neither in xml or json
View 2 RepliesI simply want to create one file and then delete it, means I want to access one file subsequently. I am getting the very familiar error as shown in title. (Process can't access the file,) I have tried using file stream and all other stuff that I found from Googling but no success so far. Does any body have small and neat solution? in short, I would like to run the following statements without any error.File.Create("C:\hsp1.txt");
File.Open("C:\hsp1.txt", FileMode.Open, FileAccess.Read, FileShare.None);
i have an asp.net application
c# code
i have adtabase in access and i craete adatset from it
i want to create excell file
my problem is my asp.net and C#.net application should read flat files(.txt,.doc) from folder automatically and read the data from file and stored into database
my file like this :
BNK20100312APPHU6658994 // BNK,20100312(date),Ap,PHU6658994 So we have to store these..
BNK20100312APPRU5104220
BNK20100312APPRU5761800
BNK20100312APPZU3739288
BNK20100312APPZU4454037
BNK20100312APESU2552894
BNK20100312APAXU4302543
BNK20100312APCKU1613369
iam Working on Asp.net Web apliation using c#.net. in system folder (Ex: E://Santhu) i have few Flat files and Excels Files .So My Application should read those files automatically and should store the data into my database..
View 1 RepliesI have 4 file uploader in my form to upload 4 images in the DB for each article submitted. My issue when I want update/edit my article with some new pictures and I want delete or update the old pictures with the replacement with the new one.
How I can implement it? I am using ASP.NET based on VB.NOT .... NOT C#
Iam facing the problem with creating the Data Access layer using Dataset.xsd file and How to access the data from the file.
View 2 RepliesIt's simple to do a webrequest, get the page and parse the html to get the title of the page. But I'm wondering if there is a more efficient way that is faster, and doesn't require downloading the whole html?
View 2 Repliesi am building a member management site for a sports club, i have all the usual feilds
lastName, firstName, address1, address2, address3 ....
but they also want a photo
when i first made the DB i used access 2010 which uses the 2007 file type which supports attachments, however asp.net doesnt support the 2007 format. and the 2003 file type doesnt support attachments, i assume i use the OLE object data type but i have no idea how i get my aspx page "new.aspx" to upload an attachment. plus i want to restrict the file type to *.jpg
What's the best way to do this? I have seen quite a few examples that use a Dataview etc. what is the best method. I'm thinking about speed issues when a grid has a few thousand records etc.
this is how I populate the gridview:
Code:
[code]....
I have a requirement where 15 listviews have to be loaded on a web page.But only one shown at a time. Number of columns will be only 2 for each and Number of rows for every listview is very limited.The thing I am not able to decide is the sorting method.1. If I am using the datasource control, it automatically sorts my listview.2. If I am programmatically populating listview , I will have to sort my datatable and rebind to the listview.To use the second method I have to store the datatables in sessions.So taking that into consideration, will datasource control be more efficient ?
View 4 RepliesAssuming a list of objects, each with an ID, what's the most efficient way of building a carousel, so that each object knows what its previous and next item is. The Last Item's previousId will link to the first item. The first item's previousId will link to the last.
I need the ID of the previous and the ID of the next, as this will be used to populate next and previous buttons on a web page.
I know I could iterate over them, adding placeholders for _next and _prev id, but what's the most efficient way to do this?
I figure my object should look like this:
class Item {
public int Id { get; set; }
public string ItemName { get; set; }
public int Next { get; set; }[code]....
I think I'm looking at this wrong way. Is there a better way of doing this?
I am making a blog application and for the sake of my question I have 2 tables: Posts & Comments. I would like to loop through the posts and use a nested loop to display the comments relating to a specific post. Currently, I am using this code:
[Code]....
Obviously this is a simplified version. Is this the most efficient method of displaying this kind of data?
I am outputting the entire HTML for my server control as follows:
public override void Render(HtmlTextWriter output)
{
output.Write(myStringBuilder.ToString());
}
myStringBuilder is a StringBuilder object that is manually built in a separate private method.Is this an efficient way to do it? Or is it better to pass the HtmlTextWriter to my private method and make multiple calls to HtmlTextWriter.Write()?
What is the most efficient way to transmit messages in WCF? I've done a few basic walkthroughs of WCF and upon analyzing the XML transmission I saw that they were very large by default... Containing what appears to me, as a lot of unnecessary information, for my needs. I'm looking for a way to send the shortest messages possible. How can I trim as much as possible from the XML? Can I remove all the header information. What approach for sending the shortest messages possible using XML in WCF?
View 3 Replies
