Idris Elba frequently points out this difference when Americans call him an African American