Web Scrape

Topics: Developer Forum
Jan 5, 2009 at 4:49 PM
I am very new to .NET.  I want perform a web scrape on one of our company web servers after performing a query.  So, for lack of better terms, the webserver has a page that I can login to, put a value, emulate and click, then it posts back to me html. That is the html data that I need to parse, not the stored file on the server. All the examples that I have seen seem to point only to downloading the HTML file first.  This is not available to me.  It seems as if I need to use the system.IO.stream overload, but can't find any examples of how to do it.  Any ideas/suggestions?

Thanks!
Jan 13, 2009 at 4:33 PM
You should use HttpWebResponse class to post a request and get a response from a web server. The response is a stream. Is that what you were looking for?