Was it improper of me to visit his apartment?

i met this really nice guy in my college apt building; he & his roommate told me to come hang out anytime. yesterday i was bored/lonely so i went up to see if they were busy...they told me i could stay & hang out so i did. but some of my girl friends thought it was weird since i don't know them that well...is it that weird??