[He wasn't trying to hem Raylan in semantically; he just thought he needed to know that James wasn't the only person he mattered to. That he's needed. That he matters.]

I won't tell your secrets. Just. Don't... resign yourself to being alone, okay? I did that and it was proven wrong when I least expected it. The right person will come along and you'll wish they were always there.