He pulls away because it still feels wrong, as if he is cheating, which is... silly. But he has a dramatic heart, and he does realize he shouldn't be playing hot and cold with Wei Ying.

He takes a breath and then... and then Wei Ying sticks a leg out for him to see and he finds himself smiling, ever so lightly, probably imperceptible for anyone except for Wei Ying.

"If you hadn't, I could still carry you. It would be less embarrassing to be seen, if you were a rabbit." In case he's still feeling shy.