What Your Computer Can't Know