Yes, exactly. If one of the bits inside the EPROM ends up changing, the calculated checksum won't match the stored checksum.
Now, there are finer points that can be dependent on the checksum algorithm that is used. A machine from the 80's or older probably just used a simple sum of bytes checksum. With that simple algorithm, two bit flips could cancel each other out and the simple checksum would not pick it up.
