Google Search will no longer make site backups while crawling the web.
  • alyaza [they/she]M
    28•1 year ago

    Google “Search Liaison” Danny Sullivan confirmed the feature removal in an X post, saying the feature “was meant for helping people access pages when way back, you often couldn’t depend on a page loading. These days, things have greatly improved. So, it was decided to retire it.”

    okay but… has it? this seems like an unfounded premise, intuitively speaking

    • Semi-Hemi-Demigod
      12•1 year ago

      “What excuse could we use for this cost-cutting measure?”

      “Uh, we could just say that people don’t need it anymore.”

      “Johnson, get that man a promotion!”

    • OtterEnglish
      6•1 year ago

      Yea I’ve been using it more and more recently, although part of that is sites like Twitter or Reddit randomly hiding content

    • @Smoke@beehaw.orgEnglish
      3•1 year ago

      There’s ways to rate limit, like increasing response time per IP address per hour to make rapid, massed requests slower and easier to handle. Taking them all down at once is an extreme move.

  • bedrooms
    6•1 year ago

    Maybe they don’t want to give rival AI devs data access? It’s not typical for Google to give up data.