I find all this very hard to square with my understanding. I mean, what kind of "business operating constraints" stay the same over months or years? Or do you mean that, when constraints change, you just train a new model?
I think basically what you're saying is "we choose the data we want to reprsent, so we know when we're representing it well". But that's just what I say above, about measuring progress by hitting the targets you choose, completely arbitrarily.
It's as if I shot a bunch of arrows and then painted targets around them, then claimed I'm a great archer because I always hit bullseye.
I don't think that's the result of some fundamental difference in understanding between academia and industry, either. Perhaps, in the industry, assuming that reality will comply with your assumptions helps achieve business aims, but that's not because the systems work. It's becaus they can be made to look like they do and there's no good way to show they don't, as there's no good way to show they do.
I think basically what you're saying is "we choose the data we want to reprsent, so we know when we're representing it well". But that's just what I say above, about measuring progress by hitting the targets you choose, completely arbitrarily.
It's as if I shot a bunch of arrows and then painted targets around them, then claimed I'm a great archer because I always hit bullseye.
I don't think that's the result of some fundamental difference in understanding between academia and industry, either. Perhaps, in the industry, assuming that reality will comply with your assumptions helps achieve business aims, but that's not because the systems work. It's becaus they can be made to look like they do and there's no good way to show they don't, as there's no good way to show they do.