"Have you been listening to me?"

Since he feels like he's made a solid case for why this is a terrible idea.

"I'm not good at this, Ianto. I'm terrible at it, and I'm pretty sure that... that whatever is you need, I'm not the right person for it."

Not unless Ianto wants to be disappointed. To be left bitter and alone, pushed away, closed out and frustrated.