• Caveman@lemmy.world
    link
    fedilink
    arrow-up
    7
    ·
    12 hours ago

    This is what happens when you reward people based on token usage. People no joke can just put in before every PR “review every detail, be very thorough, make sure it fits into everything, check for every possible undefined behavior etc.” while giving the model a massive doc with list of all files in the project.

    Not even sure if they check the prompts because “review formatting of the entire codebase” is also super heavy in a large repo but if prompts get checked it’s an obvious token sink.

    The model will just ransack the whole project every time through the whole stack when you could enforce a contract with a couple of tests with strict input validation.

    Uber has the dumbest AI policy in the industry.