This reflects some of the dangers of the process by which AI services are designed. Ultimately, this issue would be about the training data fed into the systems and how well the human operators set the objective function. AI systems could thoughtlessly amplify prejudices (latent or explicit) in the real world or simply be designed to chase some biased outcome.
(😋I will host an Exponential Dinner on AI ethics in London in September. If interested, please email me now with suggested agenda items and speakers/attendees.)