{"id":1812,"date":"2024-05-09T01:21:06","date_gmt":"2024-05-09T05:21:06","guid":{"rendered":"https:\/\/www.rfdm.com\/blog\/?p=1812"},"modified":"2024-05-16T20:06:17","modified_gmt":"2024-05-17T00:06:17","slug":"unacknowledged-syns-by-as-autonomous-system-may-8-2024","status":"publish","type":"post","link":"https:\/\/www.rfdm.com\/blog\/?p=1812","title":{"rendered":"Unacknowledged SYNs by AS (autonomous system) May 8, 2024"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">The only interesting thing about this day&#8230; one of Google&#8217;s crawlers tripped one of my automatic blockers (by loading my blog login page).  So 66.249.66\/24 got blocked.  And as I expect (and blogged about before), Google is far and away the leading consumer of my web site.  Just their crawlers in 66.249.66\/24 account for 9,177 connection attempts per day.  Yes, some of the SYNs are retries.  But just the same&#8230; if your web site is around for a while, it&#8217;ll get hammered by Google day in and day out.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">I already know their crawlers are not particularly smart.  For example, I&#8217;ve blocked them from pulling PDF files because they grab the same ones over and over (often in the same week), including PDFs that haven&#8217;t changed in over 10 years.  So I&#8217;m going to leave the block in place for a while to see what happens.  I suspect nothing; I don&#8217;t think the crawlers are smart enough to stop trying, despite getting nothing in response.<\/p>\n\n\n\n<canvas id=\"synChart20240509\" style=\"height:600px;width:100%;display:flex;flex-flow:column;\"><\/canvas>\n<script src=\"https:\/\/cdn.jsdelivr.net\/npm\/chart.js\"><\/script>\n<script>\nnew Chart(document.getElementById('synChart20240509'),\n{type:'bar',data:{labels: ['15169 Google (US)','16509 Amazon.com, Inc. (US)','8075 Microsoft Corporation (US)','215766 Emanuel Hosting Ltd. (GB)','13335 Cloudflare, Inc. (US)','32934 Facebook, Inc. (US)','21859 Zenlayer Inc (US)','396982 Google Cloud (US)','209366 SEMrush CY LTD (CY)','7922 Comcast Cable (US)','136907 Huawei cloud (HK)','4134 China Telecom (CN)','14061 DigitalOcean, LLC (US)','14618 AMAZON-AES (US)','4837 China Unicom (CN)','36183 Akamai Technologies, Inc. (US)','398324 Censys, Inc. (US)','132203 Tencent (CN)','4766 Korea Telecom (KR)','202425 IP Volume inc (SC)','57523 Chang Way (HK)','50360 Tamatiya EOOD (BG)','45899 VNPT Corp (VN)','4808 China Unicom (CN)','398705 Censys, Inc. (US)'],datasets:[{label:'Unacknowledged SYNs by AS',data:[9177,4080,3521,1508,1488,1403,1384,1055,1048,951,860,745,648,453,392,372,369,339,327,272,246,244,242,232,216],borderWidth:1,backgroundColor:\"rgba(255,160,0,0.7)\"}]},options:{plugins:{legend:{labels:{color:\"white\"}},title:{color:'white',display:true,font:{size:14},text:'May  8, 2024 00:00 - May  9, 2024 00:00'}},scales:{x:{ticks:{autoSkip:false,color:'white'},title:{text:'autonomous system',color:'white',display:true}},y:{ticks:{color:'white'},title:{text:'Unacknowledged SYNs',color:'white',display:true}}},y:{beginAtZero:true}}});\n<\/script>\n","protected":false},"excerpt":{"rendered":"<p>The only interesting thing about this day&#8230; one of Google&#8217;s crawlers tripped one of my automatic blockers (by loading my blog login page). So 66.249.66\/24 got blocked. And as I expect (and blogged about before), Google is far and away the leading consumer of my web site. Just their crawlers in 66.249.66\/24 account for 9,177 &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/www.rfdm.com\/blog\/?p=1812\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Unacknowledged SYNs by AS (autonomous system) May 8, 2024&#8221;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[93,85,86,12],"tags":[],"class_list":["post-1812","post","type-post","status-publish","format-standard","hentry","category-cloud","category-network-security","category-networks","category-software-development"],"_links":{"self":[{"href":"https:\/\/www.rfdm.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/1812","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.rfdm.com\/blog\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.rfdm.com\/blog\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.rfdm.com\/blog\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.rfdm.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1812"}],"version-history":[{"count":4,"href":"https:\/\/www.rfdm.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/1812\/revisions"}],"predecessor-version":[{"id":1830,"href":"https:\/\/www.rfdm.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/1812\/revisions\/1830"}],"wp:attachment":[{"href":"https:\/\/www.rfdm.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1812"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.rfdm.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1812"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.rfdm.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1812"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}