a thoughtful web.
Good ideas and conversation. No ads, no tracking.   Login or Take a Tour!
comment
kleinbl00  ·  4282 days ago  ·  link  ·    ·  parent  ·  post: How far should we trust scientific models?

It's interesting. Nate Silver basically wrote a book about this article, even touching on all the same examples, and drew the exact opposite conclusions. Weather modeling, for example, lends itself well to computation because the phenomena are well understood, but mathematically intensive. Epidemiology is poorly understood mathematically, so entire towns are modeled down to ages, occupations, blood types and hobbies of individual "vectors" (sims, basically). Economic modeling is utterly devoid of real world data, making it mostly nonsensical.

Silver's argument is that models should be trusted as far as you can understand them and as far as you can verify them, no further, and that the more you verify their behavior, the more closely they will approximate the actual conditions under which they are tested. Which is to say, push your model out of its verified box and it's nonsense again. He basically argued for statistical determinism - test something enough and you'll have a good idea what your test results are likely to be if nothing else.