C# WebClient.DownloadString() Returns String With Perculiar Characters?

Jan 17, 2011

I have an issue with some content that we are downloading from the web for a screen scraping tool that I am building.in the code below, the string returned from the web client download string method returns some odd characters for the source download for a few (not all) web sites.I have recently added http headers as below. Previously the same code was called without the headers to the same effect. I have not tried variations on the 'Accept-Charset' header, I don't know much about text encoding other than the basics.The charachters, or character sequences that I refer to are:

""
and
"Â"

These characters are not seen when you use "view source" in a web browser. What could be causing this and how can I rectify the problem?

string urlData = String.Empty;
WebClient wc = new WebClient();
// Add headers to impersonate a web browser. Some web sites
// will not respond correctly without these headers
wc.Headers.Add("User-Agent", "Mozilla/5.0 (Windows; U; Windows NT 6.1; en-GB; rv:1.9.2.12) Gecko/20101026 Firefox/3.6.12");
wc.Headers.Add("Accept", "*/*");
wc.Headers.Add("Accept-Language", "en-gb,en;q=0.5");
wc.Headers.Add("Accept-Charset", "ISO-8859-1,utf-8;q=0.7,*;q=0.7");
urlData = wc.DownloadString(uri);

View 1 Replies


Similar Messages:

Put Again In Url For Query , Do Multiple WebClient.DownloadString?

Mar 16, 2010

I'm using WebClient.DownloadString("http://www.website.com/Default.aspx?fltdte=01050402);Part of data that is returned I want to put again in above url for query again and again if data returned satisfy conditions..I want to do multiple webClient.DownloadString.How to do that?

View 2 Replies

C# - WebClient.DownloadString() Not Producing Exact HTML

May 20, 2010

So here's the deal. I'm creating a spider bot for a website that scans all the product pages and records the product data. I'm using C# and the WebClient library to download the HTML string. The site I'm crawling must be specially made because the HTML that is received from WebClient.DownloadString() is different than the HTML that I get when I view the source of the HTML when visiting it on a browser. This seems intentional because the only info I can't get is the price.

View 1 Replies

Web Forms :: WebClient Illegal Characters In Path?

Jul 2, 2010

I am trying to use a WebClient to get the content of another webform in my project. I am using a WebClient because I want to do this asynchronously, so if there is a better way to do that, I am open to it.My webclient, however, is erroring with the "Illegal characters in path" error. Looking at it in the debugger, I see that this is the URI string I am using:

"PortfolioDetail.aspx?CCSG=True&Open=False&Plcmt=2008-Aug "

I don't see any illegal characters in it... what am I doing wrong?

View 3 Replies

MVC String Formatting C# - By 100 Characters Make 4 Rows Each 25 Characters?

Aug 23, 2010

I have a string with 100 characters and it is for me too long in one line. I want to make NewLine after each 25 characters. For example:

Instead: "Lorem ipsum dolor sit amet, consetetur sadipscing elitr, sed diam nonumy eirmod tempor invidunt ut labore et dolore magna aliquyam erat, sed diam voluptua."

View 2 Replies

Webclient Always Returns "Cannot Resolve"?

Jul 25, 2010

It doesnt matter the code.But whenever I attempt to use webclient on localhost always returns "Cannot resolve" its because server is local ?

[Code]....

View 2 Replies

Architecture :: Difference Between Webclient.OpenReadAsync And Webclient.DownloadStringAsync?

Mar 1, 2010

I'm mix up between webclient.OpenReadAsync and webclient.DownloadStringAsync? Can anyone explain clearly for me ? What are the difference between them? In addition, may i know whether webclient.OpenReadAsync got download the file or just open and read the file only without download to other places?

View 3 Replies

Security :: VB.NET Returns System.String[] Instead Of The Actual Value Of The String

Dec 24, 2010

I have two sub routines that I've created to pull in my Membership user roles and assign the value/name of that role to the value of a cookie.

My first subroutine looks like this

[Code]....

At this point, role ID is a 1-dimentional array which is not acceptable for a cookie's value (it must be a string), but in Debug mode, I can see that the array does contain the correct roleID value. In my 2nd subroutine I change the value from array to string for no other reason than that it gives me an opportunity to see that the value of CookieValue() before it is converted does have the correct roleID.

[Code]....

Even though it still shows that string as having the correct value, it returns the object "System.String[]"

View 1 Replies

MVC String Formatting C# - Show 20 Characters Of 100 - Trim / Cut String?

Aug 23, 2010

I want to show just a part of a string for example:

Instead: "Lorem ipsum dolor sit amet, consetetur sadipscing elitr, sed diam nonumy eirmod tempor invidunt ut labore et dolore magna aliquyam erat, sed diam voluptua."

Just a: "Lorem ipsum dolor sit amet, consetetur sadipscing..."

Which method can I use to do that?

View 3 Replies

Vb.net Function Returns Either String Or Nothing?

May 25, 2010

I'm tring to create a vb.net 3.5 function that can return either a string or nothing.

Public
Shared
Function MakeLookupField(ByVal pasString
As
String)

[Code]....

What can I set the return variable to return either a string or null value

View 7 Replies

JQuery .val() Returns Empty String?

Nov 10, 2010

With script below, request to the server always sends empty string (even if value is not emtpty), where the data line is:

data: "{ 'folderName': '" + $(this).val() + "' }"

The html element under investigation is this:

<asp:TextBox id="searcher" runat="server" ClientIDMode="Static" CssClass="classificationFolder" />

Script is:

<script type="text/javascript">
$(document).ready(function () {
$(".classificationFolder").each(function () {

[Code]....

The reason that I select elements by css class selector ($(".classificationFolder")) is that, this control is a user control and used in the same page more than once. That is why I'm not using $("#searcher").

I tested the code In IE8 and Chrome 8.0.552.28 beta. This issue is arising in both of the browsers.

On the other hand, request is sent to the server, client received response successfuly and response is processed on the client.

View 3 Replies

WCF / ASMX :: Webservice Returns Xml As A String?

Nov 22, 2010

i work with visual studio 2005 and asp net 2.0 and i must to create a webservice who returns a xml as a string

this string must be use by an application java as i know ..

ok i can create the asmx and my web method who run a sql command BUT how i can return a xml as a string ?

View 3 Replies

How To Remove Characters From String

Aug 16, 2010

i have string

Dim str As String = "C#app_wiod_200"

i want to remove characters from wiod in string which one is the best string function to do this.

View 3 Replies

How To Fix Special Characters In String

Aug 3, 2010

I've got a program that in a nutshell reads values from a SQL database and writes them to a tab-delimited text file.

The issue is that some of the values in the database have special characters (TM, dash, ellipsis, etc.) When written to the text file, the formatting is lost and they come across as junk "â„¢ or â€" etc"

When the value is viewed in the immediate window, before it is written to the txt file, everything looks fine. My guess is that this is an issue of encoding. But, I'm not real sure how to proceed, where to look, or what to look for.

Is this ASCII or UTF-8? If it's one of those how do I correct it before it's written to the text file.

Here's how I build the text file (where feedStr is a StringBuilder)

objReader = New StreamWriter(filePath)
objReader.Write(feedStr)
objReader.Close()

View 1 Replies

How To Replace Characters In String

Dec 1, 2010

i have a string and want to remove text up to the last forward slash, e.g

/images/UserThumbnails/22.jpg
Should now be
22.jpg

How do i go about doing this?

View 2 Replies

Finding Characters In A String?

Mar 24, 2011

I'm currently working on this application that records a users email.

I was wondering if there was a function that would read the last 7 digits of the inputted user email and store it in a variable? Is there any way to do this?

View 7 Replies

ADO.NET :: Sort By The First N Characters Of A String?

Feb 9, 2011

I need to be able to sort by a product title and then by a products price, which is simple but I only want the title sorted on the first 3 or 4 characters. My client wants to add the brand name to the beginning of the product title and have them automatically sorted. I can a new field in the database called brand and sort by that, but wanted to know if this is possible. I've posted what I though might work but it doesn't

[Code]....

I guess this is probably possible with a lambda expression, but I've no experience with Lambda expressions at all.

View 1 Replies

How To Add <br> In String After Counting Particular Characters

Jan 25, 2011

I want to display description of product in gridview, but i want to display only 15 characters on one line, I want to break it after 15 characters, I have written countchar function as follows:

public int CountChars(string value)
{
bool lastWasSpace = false;
foreach (char c in value)
{
result++;
lastWasSpace = false;
}
return result;
}

and called function as:

string description="sdfsdfsd sdfsdf sdfsdf asdfsa dfsda safsaf sdfdf sdfs sdfsdf sdff sdf ";

CountChars(description);

And i want to check:

if(result>15)
{
after every 15 characters i want to break the line.
}

View 3 Replies

Remove Characters In A String?

May 6, 2010

I have users emails in my database and when i retrieve those usernames, i want to remove every charecter after the @ charecter in the email for example, i have myname@domain.com i want to cut that to myname.

View 3 Replies

C# String Split Returns Double Quotes Out Of No Where?

Dec 16, 2010

Why does this

string test = "Text1, Text2";
string [] tests = test.Split(", ".ToArray());

returns this

[0] = "Text1"
[1] = ""
[2] = "Text2"

what's with the quotes in tests[1] ? I thought the output would be like this

[0] = "Text1"
[1] = "Text2"

View 4 Replies

C# - RadioButtonList.Selectedvalue Returns An Empty String

Apr 4, 2011

I define the datasource in my c# code and I have a submit button which takes the value of the radiobuttonlist

asp:RadioButtonList ID="RadioPaidIdList" runat="server" DataValueField ="Label" DataTextField = "Label"

First time i click submit it returns an empty value. And next time i select a radiolist and click submit it returns a proper value.

View 2 Replies

Strange Characters While Trimming String

Feb 21, 2011

using vb.net/asp.net 2005 and sql server 2005. I'm querying the database and returning text which I am then adding to a string. I'm creating a crystal report with the text however this is not a crystal report question, its about the string data. what I"m noticing is that when I show the string on the pdf that there are some strange characters at the end of the string. I am both trimming the string and taking out null characters however the strange text shows up like this:

strangeText>
SÙÇ
TÙçy|Ü
DÙÇ
$ÛÇ
</strangeText>

does anyone know what these characters are and how to get rid of them?

View 7 Replies

How To Remove Special Characters From String

Feb 20, 2011

i want to display values in dropdownlist using querystring[which is successfully happening] but the problem is when id passed in querystring is 7.17 then in dropdownlist it is displaying values as 7 . 1 7....but i want to display it as 7 and 17...

here is a part of the code

string imageid;
string logoid;
string id1;
string id2;
String Name;
protected void Page_Load(object sender, EventArgs e)...

View 2 Replies

How To Remove Characters From Middle Of String

Apr 13, 2010

string="/?UPID=1000001&One=1&Two=2"

UPID is always equal to 7 digits. I want to remove "UPID=(any 7 digits)".

I'd like the output to be:

string="/?One=1&Two=2"

Or if no query strings

string="/"

View 7 Replies

ADO.NET :: Cleaning A String Input From Bad Characters

Nov 15, 2010

Can anyone advice of the best way to clean an input string from characters that will cause SQL Update error? For instance:

Dim sText as string = 'this is line to a break <br> before the end.'
Dim SQLString as string = "update sometable set somefield='"
& sText & "'"

Executing SQLString will fail because of the <br> it contains. how to filter out all possible characters that will cause the update query to fail?

View 5 Replies







Copyrights 2005-15 www.BigResource.com, All rights reserved