Really attracted to a good guy friend. what should I do?

I've known him for a while.. he is really cute, smart, and so caring of others. we have been.friends a while and I actually got dumped by his best friend a couple of months ago and he was there for me through it. He has a girlfriend and a baby with her... and I would never do anything with him to make him cheat on her. But she is crazy and she treats him so horribly and he does everything and more for her. He isn't overall happy with her but she threatens him that she will take their daughter and never let her see him again if he leaves. But he really loves his daughter and says he will be miserable just to have his daughter in his life. We talked the other night and he kept poking my arm like when he made a joke and he hugged me before he left and he was like I don't care who sees this (he isn't allowed to have girl friends) you're the first girl I've hugged other than my gf and mom in a long time.. it felt good. He kept joking with me which he does with everyone he is a goofy guy but he made a lot of eye contact with me and playful pokes. I don't know if it is a real crush I know I just care about his well being as a person and me and my friends hate seeing him stuck like this. We are getting to be better friends and we have both established a physical attraction to each other. I talked about theoretically being with someone in different scenarios and his response was "I think about that stuff too about girls being pretty and who I would date if I were single and theoretically just means if the opportunity is presented". and he kept doing this thing where I turn around and his eyes are closed and his lips are puckered. And we laugh. And he said let's hold hands and see what it feels like and we did for a second and he was like uh oh it feels great! He is like a flirt/joker type guy though. Even though he doesn't do this with other girls around.I've been really confused with my feelings anyway since my heart wrenching breakup. Any advice?