Sep 6, 2024
How Subjective is Entropy Really?
Posted by Dan Breeden in categories: computing, particle physics
Physics stack exchange has recently been debating the question of the subjectivity of entropy.
I recommend Andrew Steane answer.
I’m a computer scientist doing some research that touches on basic concepts in statistical mechanics: macrostate, microstate and entropy. The way I’m currently conceiving of it is that the microstate includes all the information to perfectly the describe the state of a system, the macrostate provides some of the information, allowing you to narrow down the possibilities to a subset of states and a distribution over them, and the entropy roughly says how much information is still missing after you specify the macrostate.