• floofloof@lemmy.ca
    link
    fedilink
    English
    arrow-up
    1
    ·
    15 hours ago

    Well that is an alternative. But I bet each query to a local 27b model takes less energy anyway than the same query to Claude Opus or Fable in some data centre. So it is also a case of improving energy efficiency by running smaller models.