Is this bullying? What should I do?

Avi is right. Get on with your life and don't try to be friends with them - you can never stop bullying by being nice to the bully.