No. People around the globe can look at someone and determine the COLOR of their skin relatively easily, unless they are blind.
The term African-American has been historically used in America to describe black people because slaves from Africa were stripped of their roots, origin, and culture. It was done purposely as an oppressive measure.
Those people couldn't claim "Nigerian-American" like people today who have parents from Nigeria but they were born in the US.
You are a black, Dominican-American? No? If not, what is the color of your skin? Dominican isn't a color last time I checked.
No one is calling your ethnicity/culture black, they're calling your skin black. Because they look at you and you have black skin. If they assume you are an "African-American" based on your skin color then they are ignorant and they are at fault for that assumption, not you. However, it doesn't change the COLOR of your skin.