CPU is not relevant (unless you get to 100% usage). Latency depends on audio card and plug-in used.
I'm currently having a latency of less than 512 samples. At 48 KHz is 10 milliseconds. One frame at 24fps (blu ray) is 41 milliseconds.
No way you can notice it
.