Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

It might be a stretch but some people say that the weights learned by a neural network is somewhat like a language. For example if you look at the weights of a random middle layer it would seem like gibberish. Much like how aliens would react when looking at humans making gibberish noises (aka talking) to each other. In both cases they are just compressing signals based on learned primitives.


Not sure if there is any case where this thought is useful. The only thing this says is the primitives are correlated and we don’t understand them. It’s similarly not useful to think about atoms “talking” when they exchange heat.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: