I just want to give up sometimes, but I love him. What should I do?

My husband and I have been together for 7 years and married for 1year. It feels depressing to know that he doesn't "want me" anymore. The first 5 years together were great, he uses to touch me all the time and wanted to make lovie almost twice a day everyday, then he started drifting away around the end of the 5th year. He started looking at and not wanting to touch me anymore, we had a fight then talked and things were good after that..then we had our baby. So now he blames not making lovie because we sometimes sleep with baby in bed. BUT, I feel he doesn't "love" me anymore, it saddens me to say, but he only kisses me once a day if I'm lucky. I rarely get hugs from him, and he doesn't like it when I touch him down under. It doesn't arouse him if I start giving him an Aussie kiss. He used to just get so hard when I only ran my finger over his pants. Now nothing works, and I just saw the after effects of him pleasig himself with . I'm devasted and I try so hard, I do not know what else to do.. :[