Can I be with a Muslim woman?

It is usually ok for a Muslim man to marry a non-Muslim woman (as long as she is a woman of the book, i.e. Christian or Jewish) because in Islam the religion of the child comes from the father, regardless of his religion, just like in Christianity. It is for this same reason that it's not lawful for a Muslim woman to marry a non-Muslim man unless he converts to Islam. I hope this helped.