I may have an answer for myself. I think the issue was happening when the display went to sleep. I just set that to never. And actually it looks like the screen saver is coming up. I have a 4 month old baby and typically when I've ran into this it was because I was preoccupied with her so I wasn't keeping an eye on the computer.
Anyway, still back to the same question, is there a fix for this other than disabling sleep mode for the display and the computer itself?