[SEO] Google爬蟲機器人與防火牆設定
發表於 : 2022-07-26, 18:15
參考資料：https://developers.google.com/search/do ... q?hl=zh-tw
https://www.lifewire.com/what-is-the-ip ... gle-818153
https://search.google.com/
網址明明就對外公開且SEO都有設定搜尋引擎卻怎麼樣都找不到你的網站？
0.測試工具
https://search.google.com/test/rich-results
https://search.google.com/test/mobile-friendly
https://transparencyreport.google.com/s ... h?hl=zh_TW
1.透過Google站長工具發現到
原來是Google找不到robot.txt
2.Google 網路檢索器的IP位於國外，檢查防火牆設定並將google服務的IP加入白名單
Googlebot IP Addresses
Besides serving Google.com, some of Google's IP addresses are used by its Googlebot web crawlers.
Website administrators like to monitor when Google's crawler visits their domains. Google does not publish an official list of Googlebot IP addresses but instead recommends users follow these instructions for verifying Googlebot addresses.
Many of the active addresses can be captured from lookups:
64.68.90.1 – 64.68.90.255
64.233.173.193 – 64.233.173.255
66.249.64.1 – 66.249.79.255
216.239.33.96 – 216.239.59.128
注意：以上IP隨時會更動且不另行公告
3.使用站長工具將網址加入索引
https://www.lifewire.com/what-is-the-ip ... gle-818153
https://search.google.com/
網址明明就對外公開且SEO都有設定搜尋引擎卻怎麼樣都找不到你的網站？
0.測試工具
https://search.google.com/test/rich-results
https://search.google.com/test/mobile-friendly
https://transparencyreport.google.com/s ... h?hl=zh_TW
1.透過Google站長工具發現到
原來是Google找不到robot.txt
2.Google 網路檢索器的IP位於國外，檢查防火牆設定並將google服務的IP加入白名單
Googlebot IP Addresses
Besides serving Google.com, some of Google's IP addresses are used by its Googlebot web crawlers.
Website administrators like to monitor when Google's crawler visits their domains. Google does not publish an official list of Googlebot IP addresses but instead recommends users follow these instructions for verifying Googlebot addresses.
Many of the active addresses can be captured from lookups:
64.68.90.1 – 64.68.90.255
64.233.173.193 – 64.233.173.255
66.249.64.1 – 66.249.79.255
216.239.33.96 – 216.239.59.128
注意：以上IP隨時會更動且不另行公告
3.使用站長工具將網址加入索引