- html - 出于某种原因,IE8 对我的 Sass 文件中继承的 html5 CSS 不友好?
- JMeter 在响应断言中使用 span 标签的问题
- html - 在 :hover and :active? 上具有不同效果的 CSS 动画
- html - 相对于居中的 html 内容固定的 CSS 重复背景?
我正在使用这个库,当我在本地运行我的应用程序时一切正常。我在 NetworkHelper 类中实现了 TorSharp:
using Knapcode.TorSharp;
using System;
using System.IO;
using System.Net;
using System.Net.Http;
using System.Threading.Tasks;
namespace SWP.Helpers
{
public class NetworkHelper
{
private int _maxRequests = 100;
private int _failedAttempts = 10;
private HttpClient _httpClient = null;
private TorSharpProxy _proxy = null;
public async Task<string> GetHtmlAsync(Uri url)
{
try
{
if (_httpClient == null)
{
var settings = new TorSharpSettings
{
ZippedToolsDirectory = Path.Combine(Path.GetTempPath(), "TorZipped"),
ExtractedToolsDirectory = Path.Combine(Path.GetTempPath(), "TorExtracted"),
PrivoxySettings =
{
Port = 1337,
},
TorSettings =
{
ControlPort = 1338,
ControlPassword = "foobar"
}
};
// download tools
await new TorSharpToolFetcher(settings, new HttpClient()).FetchAsync();
// execute
_proxy = new TorSharpProxy(settings);
var handler = new HttpClientHandler
{
Proxy = new WebProxy(new Uri("http://localhost:" + settings.PrivoxySettings.Port))
};
var httpClient = new HttpClient(handler);
_httpClient = new HttpClient(handler);
await _proxy.ConfigureAndStartAsync();
}
string response = await _httpClient.GetStringAsync(url);
if (_maxRequests == 0)
{
await _proxy.GetNewIdentityAsync();
_maxRequests = 100;
Console.WriteLine("Ottenimento nuova identità...");
var newIP = await _httpClient.GetStringAsync("http://api.ipify.org");
Console.WriteLine("Nuovo IP: " + newIP);
}
_maxRequests--;
return response;
}
catch (Exception)
{
if (_failedAttempts != 0)
{
Console.WriteLine("Failed request, retry ...");
_failedAttempts--;
await Task.Delay(15000);
}
else
{
//_proxy.Stop();
throw;
}
return await GetHtmlAsync(url);
}
}
}
}
因此,当我必须从网页中获取 html 时,我只需执行以下操作:
string html = await _parser.NetworkHelper.GetHtmlAsync('somelink');
现在的问题是,当我在本地运行应用程序时,所以在 Visual Studio 中,一切正常,但是当我在 Docker 容器中运行它时,出现此错误:
[16-01-2021 11:55:25]
Jan 16 11:57:33.001 [notice] Tor 0.4.4.6 (git-2a8b789ea6f308d0) running on Linux with Libevent 2.1.11-stable, OpenSSL 1.1.1i, Zlib 1.2.8, Liblzma N/A, and Libzstd N/A.
Jan 16 11:57:33.031 [notice] Tor can't help you if you use it wrong! Learn how to be safe at https://www.torproject.org/download/download#warning
Jan 16 11:57:33.031 [notice] Read configuration file "/tmp/TorExtracted/tor-linux64-10.0.8/Data/Tor/torrc".
Jan 16 11:57:33.034 [notice] Opening Socks listener on 127.0.0.1:19050
Jan 16 11:57:33.063 [notice] Opened Socks listener on 127.0.0.1:19050
Jan 16 11:57:33.159 [notice] Opening Control listener on 127.0.0.1:1338
Jan 16 11:57:33.175 [notice] Opened Control listener on 127.0.0.1:1338
Jan 16 11:57:33.175 [warn] Fixing permissions on directory /tmp/TorExtracted/tor-linux64-10.0.8/Data/Tor
Jan 16 11:57:33.000 [warn] You are running Tor as root. You don't need to, and you probably shouldn't.
/tmp/TorExtracted/privoxy-linux64-3.0.29/usr/sbin/privoxy: error while loading shared libraries: libbrotlidec.so.1: cannot open shared object file: No such file or directory
Jan 16 11:57:33.000 [notice] Bootstrapped 0% (starting): Starting
Jan 16 11:57:33.000 [notice] Starting with guard context "default"
Jan 16 11:57:34.000 [notice] Bootstrapped 5% (conn): Connecting to a relay
Jan 16 11:57:34.000 [notice] Bootstrapped 10% (conn_done): Connected to a relay
Jan 16 11:57:34.000 [notice] Bootstrapped 14% (handshake): Handshaking with a relay
Jan 16 11:57:34.000 [notice] Bootstrapped 15% (handshake_done): Handshake with a relay done
Jan 16 11:57:34.000 [notice] Bootstrapped 20% (onehop_create): Establishing an encrypted directory connection
Jan 16 11:57:34.000 [notice] Bootstrapped 25% (requesting_status): Asking for networkstatus consensus
Jan 16 11:57:35.000 [notice] Bootstrapped 30% (loading_status): Loading networkstatus consensus
Jan 16 11:57:36.000 [notice] I learned some more directory information, but not enough to build a circuit: We have no usable consensus.
Jan 16 11:57:36.000 [notice] Bootstrapped 40% (loading_keys): Loading authority key certs
Jan 16 11:57:37.000 [notice] The current consensus has no exit nodes. Tor can only build internal paths, such as paths to onion services.
Jan 16 11:57:37.000 [notice] Bootstrapped 45% (requesting_descriptors): Asking for relay descriptors
Jan 16 11:57:37.000 [notice] I learned some more directory information, but not enough to build a circuit: We need more microdescriptors: we have 0/6896, and can only build 0% of likely paths. (We have 0% of guards bw, 0% of midpoint bw, and 0% of end bw (no exits in consensus, using mid) = 0% of path bw.)
Jan 16 11:57:37.000 [notice] I learned some more directory information, but not enough to build a circuit: We need more microdescriptors: we have 0/6896, and can only build 0% of likely paths. (We have 0% of guards bw, 0% of midpoint bw, and 0% of end bw (no exits in consensus, using mid) = 0% of path bw.)
Jan 16 11:57:38.000 [notice] Bootstrapped 50% (loading_descriptors): Loading relay descriptors
Failed request, retry ...
Jan 16 11:57:39.000 [notice] The current consensus contains exit nodes. Tor can build exit and internal paths.
Jan 16 11:57:42.000 [notice] Bootstrapped 57% (loading_descriptors): Loading relay descriptors
Jan 16 11:57:42.000 [notice] Bootstrapped 64% (loading_descriptors): Loading relay descriptors
Jan 16 11:57:43.000 [notice] Bootstrapped 75% (enough_dirinfo): Loaded enough directory info to build circuits
Jan 16 11:57:43.000 [notice] Bootstrapped 80% (ap_conn): Connecting to a relay to build circuits
Jan 16 11:57:43.000 [notice] Bootstrapped 85% (ap_conn_done): Connected to a relay to build circuits
Jan 16 11:57:44.000 [notice] Bootstrapped 89% (ap_handshake): Finishing handshake with a relay to build circuits
Jan 16 11:57:44.000 [notice] Bootstrapped 90% (ap_handshake_done): Handshake finished with a relay to build circuits
Jan 16 11:57:44.000 [notice] Bootstrapped 95% (circuit_create): Establishing a Tor circuit
Jan 16 11:57:45.000 [notice] Bootstrapped 100% (done): Done
Failed request, retry ...
System.Net.Http.HttpRequestException: Cannot assign requested address ---> System.Net.Sockets.SocketException: Cannot assign requested address
at System.Net.Http.ConnectHelper.ConnectAsync(String host, Int32 port, CancellationToken cancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.ConnectHelper.ConnectAsync(String host, Int32 port, CancellationToken cancellationToken)
at System.Threading.Tasks.ValueTask`1.get_Result()
at System.Net.Http.HttpConnectionPool.CreateConnectionAsync(HttpRequestMessage request, CancellationToken cancellationToken)
at System.Threading.Tasks.ValueTask`1.get_Result()
at System.Net.Http.HttpConnectionPool.WaitForCreatedConnectionAsync(ValueTask`1 creationTask)
at System.Threading.Tasks.ValueTask`1.get_Result()
at System.Net.Http.HttpConnectionPool.SendWithRetryAsync(HttpRequestMessage request, Boolean doRequestAuth, CancellationToken cancellationToken)
at System.Net.Http.HttpConnectionPool.EstablishProxyTunnel(CancellationToken cancellationToken)
at System.Threading.Tasks.ValueTask`1.get_Result()
at System.Net.Http.HttpConnectionPool.CreateConnectionAsync(HttpRequestMessage request, CancellationToken cancellationToken)
at System.Threading.Tasks.ValueTask`1.get_Result()
at System.Net.Http.HttpConnectionPool.WaitForCreatedConnectionAsync(ValueTask`1 creationTask)
at System.Threading.Tasks.ValueTask`1.get_Result()
at System.Net.Http.HttpConnectionPool.SendWithRetryAsync(HttpRequestMessage request, Boolean doRequestAuth, CancellationToken cancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
at System.Net.Http.HttpClient.FinishSendAsyncUnbuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)
at System.Net.Http.HttpClient.GetStringAsyncCore(Task`1 getTask)
at SWP.Helpers.NetworkHelper.GetHtmlAsync(Uri url) in /src/SWP/Helpers/NetworkHelper.cs:line 72
at SWP.Helpers.NetworkHelper.GetHtmlAsync(Uri url) in /src/SWP/Helpers/NetworkHelper.cs:line 101
at SWP.Helpers.NetworkHelper.GetHtmlAsync(Uri url) in /src/SWP/Helpers/NetworkHelper.cs:line 104
at SWP.Helpers.NetworkHelper.GetHtmlAsync(Uri url) in /src/SWP/Helpers/NetworkHelper.cs:line 104
at SWP.Helpers.NetworkHelper.GetHtmlAsync(Uri url) in /src/SWP/Helpers/NetworkHelper.cs:line 104
at SWP.Helpers.NetworkHelper.GetHtmlAsync(Uri url) in /src/SWP/Helpers/NetworkHelper.cs:line 104
at SWP.Helpers.NetworkHelper.GetHtmlAsync(Uri url) in /src/SWP/Helpers/NetworkHelper.cs:line 104
at SWP.Helpers.NetworkHelper.GetHtmlAsync(Uri url) in /src/SWP/Helpers/NetworkHelper.cs:line 104
at SWP.Helpers.NetworkHelper.GetHtmlAsync(Uri url) in /src/SWP/Helpers/NetworkHelper.cs:line 104
at SWP.Helpers.NetworkHelper.GetHtmlAsync(Uri url) in /src/SWP/Helpers/NetworkHelper.cs:line 104
at SWP.Helpers.NetworkHelper.GetHtmlAsync(Uri url) in /src/SWP/Helpers/NetworkHelper.cs:line 104
at SWP.Helpers.NetworkHelper.GetHtmlAsync(Uri url) in /src/SWP/Helpers/NetworkHelper.cs:line 104
at SWP.Controllers.CountryController.GetDomesticCountries() in /src/SWP/Controllers/CountryController.cs:line 28
at SoccerWay.Business.CountryManager.GetCountries(Nullable`1 international) in /src/SoccerWay/Business/Manager/Utility/Country.Utility.cs:line 59
at SoccerWay.Scraper.StartAsync(String instance) in /src/SoccerWay/Scraper.cs:line 55
there is the following line that caught my attention:
/tmp/TorExtracted/privoxy-linux64-3.0.29/usr/sbin/privoxy: error while loading shared libraries: libbrotlidec.so.1: cannot open shared object file: No such file or directory
这是我用来编译 Docker 镜像的 Dockerfile:
FROM mcr.microsoft.com/dotnet/core/sdk:2.1 AS build
WORKDIR /src
# Copy csproj and restore as distinct layers
COPY /SoccerWay/*.csproj SoccerWay/
COPY /SWP/*.csproj SWP/
RUN dotnet restore SWP/*.csproj
RUN dotnet restore SoccerWay/*.csproj
# Copy and build app and libraries
COPY SoccerWay/ SoccerWay/
COPY SWP/ SWP/
WORKDIR /src/SoccerWay
RUN dotnet build -c release
FROM build AS publish
RUN dotnet publish -c release -o /app
# Final stage/image
FROM mcr.microsoft.com/dotnet/core/runtime:2.1
WORKDIR /app
COPY --from=publish /app .
ENTRYPOINT ["dotnet", "SoccerWay.dll"]
我怎样才能解决这个问题?
FROM mcr.microsoft.com/dotnet/core/sdk:3.1 AS build
# add missing packages
RUN apt update -y && apt-get install -y libbrotli1 libmbedtls-dev && apt-get clean
WORKDIR /src
# Copy csproj and restore as distinct layers
COPY /test-app/*.csproj test-app/
RUN dotnet restore test-app/*.csproj
# Copy and build app and libraries
COPY test-app/ test-app/
WORKDIR /src/test-app
RUN dotnet build -c release
FROM build AS publish
RUN dotnet publish -c release -o /app
# Final stage/image
FROM mcr.microsoft.com/dotnet/core/runtime:3.1
WORKDIR /app
COPY --from=publish /app .
ENTRYPOINT ["dotnet", "test-app.dll"]
我为运行容器所做的如下:
docker build -t test .
docker run -d --name test_1 --restart=always test
并且所有 http 请求都将失败,我也收到此错误:
Unhandled exception. System.Net.Http.HttpRequestException: Cannot assign requested address
---> System.Net.Sockets.SocketException (99): Cannot assign requested address
at System.Net.Http.ConnectHelper.ConnectAsync(String host, Int32 port, CancellationToken cancellationToken)
--- End of inner exception stack trace ---
最佳答案
错误消息非常清楚 - 您的图像缺少必需的包。
只需添加它们 到最终图像 .
我使用添加的依赖项测试了您的 Dockerfile,它运行良好。
# Final stage/image
FROM mcr.microsoft.com/dotnet/core/runtime:3.1
# add missing packages
RUN apt update -y && apt-get install -y libbrotli1 libmbedtls12 && apt-get clean
WORKDIR /app
COPY --from=publish /app .
ENTRYPOINT ["dotnet", "test-app.dll"]
关于c# - 无法分配请求的地址(使用 Docker 时),我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/65957649/
我正在尝试从该网站抓取历史天气数据: http://www.hko.gov.hk/cis/dailyExtract_uc.htm?y=2016&m=1 在阅读了 AJAX 调用后,我发现请求数据的正确
我有两个 postman 请求 x,y,它们命中了两个不同的休息 api X,Y 中的端点。 x 会给我一个身份验证 token ,这是发出 y 请求所必需的。如何在请求 y 中发出请求 x ?也就是
我使用请求库通过 API 与其他服务器进行通信。但现在我需要同时发送多个(10 个或更多)POST 请求,并且只有在所有响应都正确的情况下才能进一步前进。通常语法看起来有点像这样: var optio
背景:当用户单击按钮时,其类会在class1和class2之间切换,并且此数据是通过 AJAX 提交。为了确认此数据已保存,服务器使用 js 进行响应(更新按钮 HTML)。 问题:如果用户点击按钮的
我正在将 Node.js 中的请求库用于 Google 的文本转语音 API。我想打印出正在发送的请求,如 python example . 这是我的代码: const request = requi
我经常使用requests。最近我发现还有一个 requests2 和即将到来的 requests3 虽然有一个 page其中简要提到了 requests3 中的内容,我一直无法确定 requests
我正在尝试将图像发送到我的 API,然后从中获取结果。例如,我使用发送一个 bmp 图像文件 file = {"img": open("img.bmp)} r = requests.post(url,
我发现 Google Cloud 确保移出其物理环境的任何请求都经过强制加密,请参阅(虚拟机到虚拟机标题下的第 6 页)this link Azure(和 AWS)是否遵循类似的程序?如果有人能给我指
我有一个 ASP.NET MVC 应用程序,我正在尝试在 javascript 函数中使用 jQuery 来创建一系列操作。该函数由三部分组成。 我想做的是:如果满足某些条件,那么我想执行同步 jQu
我找不到如何执行 get http 请求,所以我希望你们能帮助我。 这个想法是从外部url(例如 https://api.twitter.com/1.1/search/tweets.json?q=tw
我的应用只需要使用“READ_SMS”权限。我的问题是,在 Android 6.0 上,当我需要使用新的权限系统时,它会要求用户“发送和查看短信”。 这是我的代码: ActivityCompat.re
我的前端代码: { this.searchInput = input; }}/> 搜索 // search method: const baseUrl = 'http://localho
我有一个由 AJAX 和 C# 应用程序使用的 WCF 服务, 我需要通过 HTTP 请求 header 发送一个参数。 在我的 AJAX 上,我添加了以下内容并且它有效: $.ajax({
我正在尝试了解如何使用 promises 编写代码。请检查我的代码。这样对吗? Node.js + 请求: request(url, function (error, response, body)
如果失败(除 HTTP 200 之外的任何响应代码),我需要重试发送 GWT RPC 请求。原因很复杂,所以我不会详细说明。到目前为止,我在同一个地方处理所有请求响应,如下所示: // We
当用户单击提交按钮时,我希望提交表单。然而,就在这种情况发生之前,我希望弹出一个窗口并让他们填写一些数据。一旦他们执行此操作并关闭该子窗口,我希望发出 POST 请求。 这可能吗?如果可能的话如何?我
像 Facebook 这样的网站使用“延迟”加载 js。当你必须考虑到我有一台服务器,流量很大时。 我很感兴趣 - 哪一个更好? 当我一次执行更多 HTTP 请求时 - 页面加载速度较慢(由于限制(一
Servlet 容器是否创建 ServletRequest 和 Response 对象或 Http 对象?如果是ServletRequest,谁在调用服务方法之前将其转换为HttpServletReq
这是维基百科文章的摘录: In contrast to the GET request method where only a URL and headers are sent to the serv
我有一个循环,每次循环时都会发出 HTTP post 请求。 for(let i = 1; i console.log("succes at " + i), error => con
我是一名优秀的程序员,十分优秀!