django - Gunicorn 退出，因为来自 Django 的 https 请求在 OpenSSL 中失败

Question

这是场景。我在 Linux 上有一个由 Gunicorn 提供的 Django 应用程序。在某些请求上，它通过 httplib2.request() 对外部 API 进行 https 调用。 .有时该调用失败的方式会影响 OpenSSL(不确定如何，但这不是我的错，也无关紧要)。在这种情况下，OpenSSL 会向 gunicorn 发送一个 SIGABRT 信号。 Gunicorn 处理 SIGABRT 并立即退出系统(应该如此)。

我看到的根本问题是 OpenSSL 异步通知父进程中止，而不是返回错误代码。不要因为你的个人问题告诉我中止，OpenSSL!遗留代码在起作用。

有没有其他人对这个问题感到非常恼火？您将如何防止这杀死您的 Gunicorn 进程？它完全绕过了 Django 异常处理。

相关代码点:

每当调用 OpenSSLDie() 时，OpenSSL 都会发送 SIGABRT:https://github.com/openssl/openssl/blob/e0fc7961c4fbd27577fb519d9aea2dc788742715/crypto/cryptlib.c#L391

每当在任何加密操作中出现 fatal error 时，都会发生评论声明:https://github.com/openssl/openssl/blob/e0fc7961c4fbd27577fb519d9aea2dc788742715/fips/fips.c#L136

SIGABRT 由 gunicorn 处理:https://github.com/benoitc/gunicorn/blob/6eb01409da42a81b7020cd78c52613d8ec868e94/gunicorn/workers/base.py#L173

这导致 gunicorn 到 sys.exit(1): https://github.com/benoitc/gunicorn/blob/6eb01409da42a81b7020cd78c52613d8ec868e94/gunicorn/workers/base.py#L200

Answer 1

我认为信号不是由 OpenSSL 创建的。该信号来自 gunicorn，如果请求时间过长，它会发送此信号。

worker_abort(worker): Called when a worker received the SIGABRT signal.

This call generally happens on timeout.

The callable needs to accept one instance variable for the initializedWorker.

https://docs.gunicorn.org/en/stable/settings.html#worker-abort
我的回溯，如果请求需要超过 N 秒，我会得到:

SystemExit: 1
  File "django/core/handlers/wsgi.py", line 133, in __call__
    response = self.get_response(request)
  File "django/core/handlers/base.py", line 128, in get_response
    response = self._middleware_chain(request)
  File "django/core/handlers/exception.py", line 47, in inner
    response = get_response(request)
  File "debug_toolbar/middleware.py", line 48, in __call__
    return self.get_response(request)
  File "django/core/handlers/exception.py", line 47, in inner
    response = get_response(request)
  File "django/utils/deprecation.py", line 114, in __call__
    response = response or self.get_response(request)
  File "django/core/handlers/exception.py", line 47, in inner
    response = get_response(request)
  File "whitenoise/middleware.py", line 59, in __call__
    response = self.get_response(request)
  File "django/core/handlers/exception.py", line 47, in inner
    response = get_response(request)
  File "django/utils/deprecation.py", line 114, in __call__
    response = response or self.get_response(request)
  File "django/core/handlers/exception.py", line 47, in inner
    response = get_response(request)
  File "django/utils/deprecation.py", line 114, in __call__
    response = response or self.get_response(request)
  File "django/core/handlers/exception.py", line 47, in inner
    response = get_response(request)
  File "django/utils/deprecation.py", line 114, in __call__
    response = response or self.get_response(request)
  File "django/core/handlers/exception.py", line 47, in inner
    response = get_response(request)
  File "django/utils/deprecation.py", line 114, in __call__
    response = response or self.get_response(request)
  File "django/core/handlers/exception.py", line 47, in inner
    response = get_response(request)
  File "django/utils/deprecation.py", line 114, in __call__
    response = response or self.get_response(request)
  File "django/core/handlers/exception.py", line 47, in inner
    response = get_response(request)
  File "django_middleware_global_request/middleware.py", line 15, in __call__
    return self.get_response(request)
  File "django/core/handlers/exception.py", line 47, in inner
    response = get_response(request)
  File "django/core/handlers/base.py", line 179, in _get_response
    response = wrapped_callback(request, *callback_args, **callback_kwargs)
  File "django/contrib/admin/options.py", line 614, in wrapper
    return self.admin_site.admin_view(view)(*args, **kwargs)
  File "django/utils/decorators.py", line 130, in _wrapped_view
    response = view_func(request, *args, **kwargs)
  File "django/views/decorators/cache.py", line 44, in _wrapped_view_func
    response = view_func(request, *args, **kwargs)
  File "django/contrib/admin/sites.py", line 233, in inner
    return view(request, *args, **kwargs)
  File "django/utils/decorators.py", line 43, in _wrapper
    return bound_method(*args, **kwargs)
  File "django/utils/decorators.py", line 130, in _wrapped_view
    response = view_func(request, *args, **kwargs)
  File "django/contrib/admin/options.py", line 1719, in changelist_view
    response = self.response_action(request, queryset=cl.get_queryset(request))
  File "django/contrib/admin/options.py", line 1402, in response_action
    response = func(self, request, queryset)
  File "lala/admin.py", line 252, in send_invoice_via_mail
    send_invoice_mail_failsafe_and_create_log(invoice)
  File "lala/views/send_invoices_via_mail.py", line 24, in send_invoice_mail_failsafe_and_create_log
    return send_invoice_mail(invoice)
  File "contextlib.py", line 75, in inner
    return func(*args, **kwds)
  File "lala/views/send_invoices_via_mail.py", line 39, in send_invoice_mail
    mail.send_mail(
  File "django/core/mail/__init__.py", line 61, in send_mail
    return mail.send()
  File "django/core/mail/message.py", line 284, in send
    return self.get_connection(fail_silently).send_messages([self])
  File "django/core/mail/backends/smtp.py", line 109, in send_messages
    sent = self._send(message)
  File "django/core/mail/backends/smtp.py", line 125, in _send
    self.connection.sendmail(from_email, recipients, message.as_bytes(linesep='\r\n'))
  File "smtplib.py", line 865, in sendmail
    (code, resp) = self.mail(from_addr, esmtp_opts)
  File "smtplib.py", line 539, in mail
    return self.getreply()
  File "smtplib.py", line 391, in getreply
    line = self.file.readline(_MAXLINE + 1)
  File "socket.py", line 669, in readinto
    return self._sock.recv_into(b)
  File "ssl.py", line 1241, in recv_into
    return self.read(nbytes, buffer)
  File "ssl.py", line 1099, in read
    return self._sslobj.read(len, buffer)
  File "gunicorn/workers/base.py", line 201, in handle_abort
    sys.exit(1)