php从链接下载网页的所有图像

Question

当我使用 curl 或 file_get_contents 下载 html 时，我没有得到 https://www.tumbex.com/memes.tumblr/posts?page=2

和代码（第一次尝试）

$html = file_get_contents('https://www.tumbex.com/memes.tumblr/posts?page=2');

和代码（第二次尝试）

$html = get_dataa('https://www.tumbex.com/memes.tumblr/posts?page=2');

    echo($html);

function get_dataa($url) {
  $ch = curl_init();
  $timeout = 5;
  curl_setopt($ch, CURLOPT_URL, $url);
  curl_setopt($ch, CURLOPT_USERAGENT, "Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.0)");
  curl_setopt($ch, CURLOPT_RETURNTRANSFER, 1);
  curl_setopt($ch, CURLOPT_SSL_VERIFYHOST,false);
  curl_setopt($ch, CURLOPT_SSL_VERIFYPEER,false);
  curl_setopt($ch, CURLOPT_MAXREDIRS, 10);
  curl_setopt($ch, CURLOPT_FOLLOWLOCATION, 1);
  curl_setopt($ch, CURLOPT_CONNECTTIMEOUT, $timeout);
  $data = curl_exec($ch);
  curl_close($ch);
  return $data;
}

Answer 1

只需在您的 chrome 上按 F12，然后转到“网络”标签。
在那里找到tumbex的api url，然后将其与请求头一起复制。

如果完成，
您可以使用 curl 到该 url (api url) 来获得响应..
这是我的代码

<?php
$page = 1; //change number of page here
$url = "https://api.1.tumbex.com/api/tumblr/posts?tumblr=memes&type=posts&page=$page&tag=";
$ch = curl_init();
curl_setopt($ch, CURLOPT_URL, $url);
curl_setopt($ch, CURLOPT_CUSTOMREQUEST, "GET");
curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);
$headers = array(
    'Accept: */*',
    'Authorization: Bearer 0fae0f237b33e781a6884295b39c6e903484ef1ee3190bd51f07dd9881bdccbd',
    'content-type: application/json; charset=UTF-8',
    'Referer: https://www.tumbex.com/',
    'Accept: application/json, text/plain, */*',
    'User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/86.0.4240.75 Safari/537.36',
    'x-csrf-token: MVMyb2hLTWtQdEJEYjJ0SER1dEwvZz09',
    'x-requested-with: XMLHttpRequest'
);
curl_setopt($ch, CURLOPT_HTTPHEADER, $headers);
$res = curl_exec($ch); //result is json

$json = json_decode($res, true);
$edan = $json['response']['posts'];

for($i=0; $i<count($edan); $i++){

    $get_post       = $edan[$i];
    $type           = $get_post['detected_type']; //get type

    //$get_photo = $get_post['blocks'][0]['content'][0]['hd'];  -> get image url
    //$get_video = $get_post['blocks'][0]['content'][0]['media']['url']; -> get video url
    //$get_text1 = $get_post['blocks'][0]['content'][0]['text']; -> get text 1
    //$get_text2 = $get_post['blocks'][0]['content'][1]['text']; -> get text 2

    if($type == 'photo'){
        $get_photo  = $get_post['blocks'][0]['content'][0]['hd'];
        echo "<img src='".$get_photo."' height='120' width='160'><br>";
    }

}

你要知道，bearer token和x-csrf-token总是在变化
如果结果为空，那就是Bearer token 和 x-csrf-token 已过期
但是，您可以手动解决该问题或使用其他 curl 自动获取 承载令牌 和 x-csrf-token..