What happens when an app exceeds the memory limit, even briefly?

When you go over the memory limit on a replica, your pod will get OOMKilled and restarted. Alhtough not instantaneous, the timing is pretty close to it.