I feel like I do not even have a brother?

I'm not going to lie--I get immensely jealous when one of my friends tells me that they did something with their brother--ANYTHING! My brother and I look very much alike (facially + bodily); however, I am taller than him, and I know this gets to him. He is 3 years older than me, so when he was going to be a senior in HS, I was going to be freshman. He told me that I wouldn't get a good education at his current school, so I decided to go to a different school, which was probably the worst decision I have ever made. It was very run down, and ghetto...for example, someone got stabbed at homecoming my freshman year. When I confronted him about this when I was almost ending HS, he told me that he just didn't want somebody that looked like him walking around. This angers me a lot, and I know he still feels this way. He's turning 22 and there still have been very little changes. Whenever we go out as a family, I can't even talk to him. He'll get angry for no reason. He also treats his friends better than me--this summer, I have to take a few summer courses, and I was going to live in our family-owned apartment that's about 2 minutes from campus, but he told me that I would have to wait so he could talk to his friend who is his roommate. Okay, first of all, I am your brother, and secondly, it's just for a week! I would rather traverse 45 minutes to school every morning for summer school because I know he will be a complete while I live with him. He doesn't get this, or else there's something else about it. I really don't know what to do beyond this point. He is nice to EVERYBODY except me. I am fed up with this and I am losing him in having a real brother. It makes me so jealous when I hear about how two brothers talk about the girls they've been with or done this and that...ya. So much for that with my brother. Any ideas on what's up with him or what I can do?