Cache problem

Topics: Project Management Forum
Feb 17, 2010 at 10:25 PM
Edited Feb 17, 2010 at 10:28 PM

It seems to me that the caching feature of HtmlWeb doesn't take URL parameters into account. Am I correct?

This is bad because it makes the cache unusable with any dynamic page (e.g. Details.aspx?id=3169 with a varying id).

Also, it would be nice if the cache supported multithreading. Currently it just throws an exception because the file is already in use. Web access often has a big latency and it's very useful (performance-wise) to request several pages at the same time. Currently to do so, one has to deactivate the HtmlWeb cache.

Oct 16, 2013 at 1:32 PM
I have the same issue since I would like to loop over some url.

I havre tried the following code but I have the same data on each loop
     for (int i = 1; i <= Convert.ToInt32(NbrePage); i++)
            {
                url = urlBase + i.ToString();
                doc = null;
                doc = new HtmlAgilityPack.HtmlDocument();
                HtmlWeb web = new HtmlWeb();
                web.UsingCache = false;
                doc = web.Load(url)   ;