c# - htmlagilitypack gzip加密异常

Question

我有异常抛出 gzip 不受支持。这就是我使用加载页面的全部内容，关于如何允许 gzip 的任何想法？

        HtmlWeb hwObject = new HtmlWeb();
        HtmlAgilityPack.HtmlDocument htmldocObject = hwObject.Load(siteURL);

Answer 1

您可以自己下载页面，即使用派生自 WebClient 的类(或手动创建 WebRequest 并设置 AutomaticDecompression )

public class GZipWebClient : WebClient
{
    protected override WebRequest GetWebRequest(Uri address)
    {
        HttpWebRequest request = (HttpWebRequest)base.GetWebRequest(address);
        request.AutomaticDecompression = DecompressionMethods.GZip | DecompressionMethods.Deflate;
        return request;
    }
}

鉴于此，您可以执行以下操作:

string html;
using(var wc = new GZipWebClient())
  html = wc.DownloadString(siteUrl);

var htmldocObject = new HtmlDocument();
htmldocObject.LoadHtml(html);