Ah, I do see what you mean to ask now. In that case, my answer will be a simple one.

They are with me because I grew up with them in the palace. You may think of them as part of the family -- [and here comes the part that sounds rather forced to say, but he speaks for the sake of clarification alone] for I was once considered an Odinson, a prince of the realm.

[The part about Odin sending them to Loki is oh-so-laughable, but he makes no comment on it.]