The HtmlWeb class is great for retrieving html documents from the web.
However, some important properties are currently not implemented.
I've modified my source code with the following 2 properties, that compliment the request object.
String UserAgent (req.UserAgent = UserAgent)
Integer TimeoutMillis (req.Timeout= TimeoutMillis)
I've actually created an additional constructor for HtmlWeb that takes those 2 parameters and modified the Get method responsible for the request object to take the above parameter values.