He asked AI to count carbs 27000 times. It couldn't give the same answer twice

rsynnott

I am... unsure why anyone would think LLMs would be able to do this. They are not magic oracles. Like I think even most humans would be extremely bad at this. Like, are people actually using LLMs for this? Please do not, it won't work.

DontchaKnowit

Not remotely surprising to anyone whose ever counted calories or carbs

alexdns

Non deterministic AI returns non deterministic results who could've guessed

tom1337

random number generator returns random numbers on each call. more news at 11

jaccola

It’s just an impossible problem. Photons don’t provide sufficient information to determine calories (at least not in any way they could practically be captured). Inside that sandwich could be drenched with olive oil or it could be hollow cheese with lettuce. It’s impossible to tell.

monooso

Tomorrow on HN, "water is wet."

bethekidyouwant

I asked an AI to guess how much a picture of a rock weighed 500 times… But it does propose an interesting idea. Which is burn after labelling. (maybe it could be really good at this)

christkv

LLMs going to llm.

sathish316

Feel the AGI of next-word or next-number carbs prediction

feverzsj

Bullshit machine can't even do bullshit job?

jan_Sate

Oh. I read "crabs" and I was confused until I clicked into the article. Guess I need coffee.

fHr

ASI/AGI reached kap

amazingamazing

With mass information you could infer much more from pictures. With some sort of standard cube in the picture as well as taking a picture at an angle that emphasizes all three dimensions you could also better estimate the relative volume. It’s tractable I think, but not from a pic alone.

voidUpdate

> "The prompt was adapted from the one used in the iAPS open-source automated insulin delivery system — it’s a real production prompt, not a toy example." This idea is seriously being implemented in a production app? And people are using that app to make health choices? Oh god...

jchw

> 42.9 units of insulin from a single photo. That’s not a rounding error. That’s a potential fatality. Shit like this is why you shouldn't involve AI output in your writing process. It's especially ironic in an article about LLMs being unreliable... but it's pointless when the pre-print seems just fine at least to my eyes.

nextlevelwizard

I used LLMs to count calories, but not based on photos, I mean I also did that, but primarily I fed in my exact ingredients and then used weights to get calorie estimates. Was it always correct? Certainly not. But it helped me lose 30kg of weight since keeping even some track of calories was so much easier with LLM than any app I had used before. Also of course it didn’t matter if I was exactly on point since it wasn’t about any kind of medicine

engineer_22

To me, someone without a full understanding of the AI systems, it seems like the problem is most strongly influenced by image classification. The next logical step in this research is to remove image classification from the loop, since it's a confounding factor.

dyauspitr

What a dumb article. The picture of the sandwich is essentially just a picture of bread. You can’t see what’s inside. A human wouldn’t be able to tell you. These are essentially AI hit pieces.

a-dub

i've found that multiple queries with the same prompt that requests a short answer is an excellent way to gain a confidence style measure that actually works.