【问题标题】:Prerender not detecting the token with NginxPrerender 未使用 Nginx 检测令牌
【发布时间】:2018-04-28 15:33:28
【问题描述】:

我们有一个 Angular 应用程序,我们正在尝试实现 prerender.io 以用于 SEO 目的。

我们使用站点地图缓存了所有 url,并遵循官方 Nginx 教程:https://gist.github.com/thoop/8165802

但 prerender.io 一直显示此消息: 我们尚未看到使用您的 Prerender 令牌的请求。

您可以在这里查看我们的 Nginx 代码:

server {
  listen 443;
  server_name example.com;
  access_log /var/log/nginx/example.com.ssl.access.log;
  error_log /var/log/nginx/example.com.ssl.error.log debug;

  #SSL conf

  location / {

    try_files $uri @prerender;

    if ($request_filename ~* ^.*?/([^/]*?)$)
    {
        set $filename $1;
    }

    if ($filename ~* ^.*?\.(eot)|(ttf)|(woff)$){
        add_header Access-Control-Allow-Origin *;
    }

    proxy_redirect off;
    proxy_set_header   X-Real-IP            $remote_addr;
    proxy_set_header   X-Forwarded-For  $proxy_add_x_forwarded_for;
    proxy_set_header   X-Forwarded-Proto $scheme;
    proxy_set_header   Host                   $http_host;
    proxy_set_header   X-NginX-Proxy    true;
    proxy_set_header   Connection "";
    proxy_http_version 1.1;
    proxy_cache one;
    proxy_cache_key sfs$request_uri$scheme;

    proxy_pass http://example.com;
  }

  location @prerender {
      #proxy_set_header X-Prerender-Token YOUR_TOKEN;

      set $prerender 0;
      if ($http_user_agent ~* "baiduspider|twitterbot|facebookexternalhit|rogerbot|linkedinbot|embedly|quora link preview|showyoubot|outbrain|pinterest|slackbot|vkShare|W3C_Validator") {
          set $prerender 1;
      }
      if ($args ~ "_escaped_fragment_") {
          set $prerender 1;
      }
      if ($http_user_agent ~ "Prerender") {
          set $prerender 0;
      }
      if ($uri ~* "\.(js|css|xml|less|png|jpg|jpeg|gif|pdf|doc|txt|ico|rss|zip|mp3|rar|exe|wmv|doc|avi|ppt|mpg|mpeg|tif|wav|mov|psd|ai|xls|mp4|m4a|swf|dat|dmg|iso|flv|m4v|torrent|ttf|woff|svg|eot)") {
          set $prerender 0;
      }

      #resolve using Google's DNS server to force DNS resolution and prevent caching of IPs
      resolver 8.8.8.8;

      if ($prerender = 1) {

          #setting prerender as a variable forces DNS resolution since nginx caches IPs and doesnt play well with load balancing
          set $prerender "service.prerender.io";
          rewrite .* /$scheme://$host$request_uri? break;
          proxy_pass http://$prerender;
      }
      if ($prerender = 0) {
          rewrite .* /index.html break;
      }
  }

}

我们尝试了从stackoverflow 到类似问题的不同解决方案,但没有任何效果......

【问题讨论】:

  • 我昨天回答这个问题时可能错过了这个问题,但你的令牌也被注释掉了:#proxy_set_header X-Prerender-Token YOUR_TOKEN;确保从该行中删除 #
  • 感谢您的回答,但这是复制粘贴错误 :) 我们没有评论令牌,对此感到抱歉。

标签: angularjs node.js nginx prerender


【解决方案1】:

我想知道 try_files 是否由于某种原因在这里不起作用。您可以尝试将预渲染配置改为内联吗?

server {
  listen 443;
  server_name example.com;
  access_log /var/log/nginx/example.com.ssl.access.log;
  error_log /var/log/nginx/example.com.ssl.error.log debug;

  #SSL conf

  location / {

    if ($request_filename ~* ^.*?/([^/]*?)$)
    {
        set $filename $1;
    }

    if ($filename ~* ^.*?\.(eot)|(ttf)|(woff)$){
        add_header Access-Control-Allow-Origin *;
    }

    #proxy_set_header X-Prerender-Token YOUR_TOKEN;

    set $prerender 0;
    if ($http_user_agent ~* "baiduspider|twitterbot|facebookexternalhit|rogerbot|linkedinbot|embedly|quora link preview|showyoubot|outbrain|pinterest|slackbot|vkShare|W3C_Validator") {
        set $prerender 1;
    }
    if ($args ~ "_escaped_fragment_") {
        set $prerender 1;
    }
    if ($http_user_agent ~ "Prerender") {
        set $prerender 0;
    }
    if ($uri ~* "\.(js|css|xml|less|png|jpg|jpeg|gif|pdf|doc|txt|ico|rss|zip|mp3|rar|exe|wmv|doc|avi|ppt|mpg|mpeg|tif|wav|mov|psd|ai|xls|mp4|m4a|swf|dat|dmg|iso|flv|m4v|torrent|ttf|woff|svg|eot)") {
        set $prerender 0;
    }

    #resolve using Google's DNS server to force DNS resolution and prevent caching of IPs
    resolver 8.8.8.8;

    if ($prerender = 1) {

        #setting prerender as a variable forces DNS resolution since nginx caches IPs and doesnt play well with load balancing
        set $prerender "service.prerender.io";
        rewrite .* /$scheme://$host$request_uri? break;
        proxy_pass http://$prerender;
    }

    proxy_redirect off;
    proxy_set_header   X-Real-IP            $remote_addr;
    proxy_set_header   X-Forwarded-For  $proxy_add_x_forwarded_for;
    proxy_set_header   X-Forwarded-Proto $scheme;
    proxy_set_header   Host                   $http_host;
    proxy_set_header   X-NginX-Proxy    true;
    proxy_set_header   Connection "";
    proxy_http_version 1.1;
    proxy_cache one;
    proxy_cache_key sfs$request_uri$scheme;

    proxy_pass http://example.com;
  }

}

【讨论】:

  • 感谢您的回答,但似乎也不起作用 :( 它一直显示此消息:我们还没有看到带有您的 Prerender 令牌的请求。
  • 已修复!我们在 $http_user_agent 中添加了“Googlebot”,如果:)
  • 您不想通过他们的用户代理检查 Googlebot,因为这可能会让您因伪装而​​受到处罚。如果您将 放在页面的 中,那么 Google、Bing 和其他抓取工具将抓取 ?_escaped_fragment_= URL。
  • 感谢您的信息!我们将元标记放在 上,当我们将 ?_escaped_fragment_ 放在 URL 上时,它会正确收费。但是我们使用 Google 网站管理员工具“获取”了网络,但它没有显示呈现的 html……似乎 google 没有抓取 ?_escaped_fragment_= URL
  • Fetch as Google 有一个已知错误,即他们不会自动检查 标签,因此使用 Fetch as Google 你想输入 ? _escaped_fragment_= URL 手动。真正的 Googlebot 会看到片段元标记并自行重新请求 ?_escaped_fragment_= 网址。
猜你喜欢
  • 1970-01-01
  • 1970-01-01
  • 2021-05-05
  • 1970-01-01
  • 1970-01-01
  • 1970-01-01
  • 2012-05-23
  • 1970-01-01
  • 1970-01-01
相关资源
最近更新 更多