Speculative RAG with a flush gate reduced P90 latency by 38%

Start the RAG answer before routing finished, then used a small gate to either flush the buffered tokens or throw them away.