Is my boyfriend being racist towards me?

so I am from colombia, south america and my boyfriend sometimes make coments that make me feel sad all the sudden and a lil bit uncomfortable... I can't remember the prior coments but today we were eating lunch and my son grabed a lil american flag that he won at the carnival the 4th of july and he started wiggling it so I thought in making a joke by putting it upside down and wiggling it telling him, "no silly you are doing it wrong, is like this (me giggling)"( by the way, it was obvious I was making a joke, in no way I wanted to disrespect the flag, I could understand why would some stranger feel disrespected by it but it was a family time and some times we joke like that, as when my boyfriend tells me I am from a lil village and we didn't have pure water and blablabla) anyways, he ended up saying: I served this country and a lil colombian girl that doesn't appreciate anything this country gives her can't joke like this.... I do appreciate I was able to come to the USA and have a better education here and he know that. his dad always raised him as the white is the right way and didn't like his ex wife because she is from japan. is he expressing some of that against me?