cURL 冻结 Apache 并出现 404 错误超时

Question

我对 cURL 请求有一个非常奇怪的问题。基本上，我有一些代码用于在 Symfony2 (http://symfonybricks.com/it/brick/wrap-legacy-php-code-by-a-symfony2-application) 上包装旧版 PHP 应用程序。它们是应该拉网页并显示它的基本 cURL 命令。但是，我注意到以下内容：

• 如果我对现有文件进行查询，它工作正常
• 如果我对一个不存在的文件进行查询，cURL 超时（因为我设置了一个 8 秒的超时），并且在此期间，它冻结了整个服务器，我无法访问我的从任何其他设备访问网站，直到它实际超时。

这是我的代码：

/**
 * @Route("/", defaults={"controller" = "index.php", "controller2" = "", "controller3" = ""})
 * @Route("/{controller}", defaults={"controller2" = "index.php", "controller3" = ""})
 * @Route("/{controller}/", defaults={"controller2" = "index.php", "controller3" = ""})
 * @Route("/{controller}/{controller2}", defaults={"controller3" = ""})
 * @Route("/{controller}/{controller2}/", defaults={"controller3" = ""})
 * @Route("/{controller}/{controller2}/{controller3}", defaults={"controller3" = "index.php"})
 */
public function getLegacyResourceAction($controller, $controller2, $controller3, Request $request)

{


    $path_to_legacy_code = "http://XXX/";

    $originalController = $request->getPathInfo();

    $originalQueryString = $request->getQueryString();

   $url = "{$path_to_legacy_code}{$originalController}?{$originalQueryString}";

    //open connection

    $ch = curl_init();

    curl_setopt($ch, CURLOPT_URL, $url);

    curl_setopt($ch, CURLOPT_RETURNTRANSFER, 1);

    curl_setopt($ch, CURLOPT_FOLLOWLOCATION, 1);

    curl_setopt($ch, CURLOPT_HEADER, false);

    curl_setopt($ch, CURLOPT_VERBOSE, 1);

    curl_setopt($ch, CURLOPT_USERAGENT, $_SERVER['HTTP_USER_AGENT']);

    //Timeout
    curl_setopt($ch, CURLOPT_CONNECTTIMEOUT, 8);
    curl_setopt($ch, CURLOPT_TIMEOUT, 8); 
    curl_setopt($ch,  CURLOPT_MAXREDIRS, 5);       

    $stderr = fopen("{$this->container->getParameter('kernel.root_dir')}/logs/curl.txt", "a");
    curl_setopt($ch, CURLOPT_STDERR, $stderr);


    //echo "Login stuff in ".$this->container->getParameter('kernel.root_dir')."/logs/curl.txt";


    curl_setopt($ch, CURLOPT_COOKIESESSION, 0);

    curl_setopt($ch, CURLOPT_COOKIEFILE, 'cookies.txt');

    curl_setopt($ch, CURLOPT_COOKIEJAR, 'cookies.txt');  

    $result = curl_exec($ch);


    if (false === $result) {
        echo curl_error($ch);
        exit;
    }

    curl_close($ch);
    fclose($stderr);

    $Response = new Response($result);


    return $Response;

这是我从有效响应中得到的日志：

* About to connect() to www.xxx.com port 80 (#0)
*   Trying 178.32.223.113...
* connected
* Connected to www.xxx.com (178.32.223.113) port 80 (#0)
> GET /web/legacy/index.php HTTP/1.1
User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:40.0) Gecko/20100101 Firefo$
Host: www.xxx.com
Accept: */*
Cookie: idto=116; PHPSESSID=a159rcjvh0fk6otukqqq9bkrd5

* additional stuff not fine transfer.c:1037: 0 0
* HTTP 1.1 or later with persistent connection, pipelining supported
< HTTP/1.1 200 OK
< Date: Sat, 05 Sep 2015 04:26:32 GMT
< Server: Apache/2.2.22 (Debian)
< X-Powered-By: PHP/5.5.28-1~dotdeb+7.1
< Expires: Thu, 19 Nov 1981 08:52:00 GMT
< Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
< Pragma: no-cache
< Vary: Accept-Encoding
< Transfer-Encoding: chunked
< Content-Type: text/html
<
* Connection #0 to host www.xxx.com left intact
* Closing connection #0

这是来自无效响应的代码：

* About to connect() to www.xxx.com port 80 (#0)
*   Trying 178.32.223.113...
* connected
* Connected to www.xxx.com (178.32.223.113) port 80 (#0)
> GET /web/legacy/whatever.php HTTP/1.1
User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:40.0) Gecko/20100101 Firefo$
Host: www.xxx.com
Accept: */*
Cookie: idto=116; PHPSESSID=a159rcjvh0fk6otukqqq9bkrd5

* additional stuff not fine transfer.c:1037: 0 0
* additional stuff not fine transfer.c:1037: 0 0
* additional stuff not fine transfer.c:1037: 0 0
* additional stuff not fine transfer.c:1037: 0 0
* additional stuff not fine transfer.c:1037: 0 0
* additional stuff not fine transfer.c:1037: 0 0
* additional stuff not fine transfer.c:1037: 0 0
* additional stuff not fine transfer.c:1037: 0 0
* additional stuff not fine transfer.c:1037: 0 0
* Operation timed out after 8001 milliseconds with 0 bytes received
* Closing connection #0
* About to connect() to www.xxx.com port 80 (#0)
*   Trying 178.32.223.113...
* connected
* Connected to www.xxx.com (178.32.223.113) port 80 (#0)
> GET /web/legacy/legacy/whatever.php HTTP/1.1
User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:40.0) Gecko/20100101 Firefo$
Host: www.xxx.com
Accept: */*
Cookie: idto=116; PHPSESSID=a159rcjvh0fk6otukqqq9bkrd5

* additional stuff not fine transfer.c:1037: 0 0
* additional stuff not fine transfer.c:1037: 0 0
* additional stuff not fine transfer.c:1037: 0 0
* additional stuff not fine transfer.c:1037: 0 0
* additional stuff not fine transfer.c:1037: 0 0
* additional stuff not fine transfer.c:1037: 0 0
* additional stuff not fine transfer.c:1037: 0 0
* additional stuff not fine transfer.c:1037: 0 0
* additional stuff not fine transfer.c:1037: 0 0
* Operation timed out after 8001 milliseconds with 0 bytes received
* Closing connection #0
* About to connect() to www.xxx.com port 80 (#0)
*   Trying 178.32.223.113...
* connected
* Connected to www.xxx.com (178.32.223.113) port 80 (#0)
> GET /web/legacy/legacy/legacy/whatever.php HTTP/1.1
User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:40.0) Gecko/20100101 Firefo$
Host: www.xxx.com
Accept: */*

下面的所有内容 curl_exec($ch);直到超时才执行，没有给我机会检查 404 错误或其他东西。我一直在寻找几天，到目前为止没有运气。

非常感谢！

编辑：

好的，所以我通过删除这一行解决了这个问题：

curl_setopt($ch, CURLOPT_COOKIEFILE, 'cookies.txt');

现在它给出了正确的 404 错误。我不知道为什么它在没有这条线的情况下工作。问题是，如果没有这条线，我会从我的遗留代码中破坏一些会话内容！

编辑 2：

我变了：

• curl_setopt($ch, CURLOPT_COOKIESESSION, 0);

到

• curl_setopt($ch, CURLOPT_COOKIESESSION, 1);

现在它在 404 错误和我的会话中运行良好。我不知道为什么。

编辑 3：

好吧，我终于明白是怎么回事了：

• 在每个 cURL 请求上，它都会写入 cookie.txt 文件
• 如果有人查询 404 url​​，在超时之前，它会文件锁定 cookie.txt 文件，这就是为什么整个事情似乎被冻结了。

据我了解，最好的解决方案是为每个用户生成不同的 cookie.txt 文件，以防止文件锁定。

Answer 1

我终于弄明白了，原来我有两个问题：

• 没有配置超时，所以如果我尝试查询一个不存在的网页，它会无限循环。
• 我对每个人都使用相同的 cookie 文件，如果有人陷入前面提到的这种循环，它将文件锁定 cookie 文件，阻止其他用户访问该站点。