The Department told Bloomberg that the investigation would both look at any legal wrongdoing and guarantee that all customers would be treated equally. Any algorithmic bias (including unintentional bias) "violates New York law," said Department Superintendent Linda Lacewell.
Goldman maintained in a statement that credit decisions were based only on "creditworthiness" and not characteristics such as gender or ethnicity, although it did not. It is uncertain how long the investigation will take, and there is no guarantee that Goldman will be asked to make adjustments. However, the incident underscores the concern that algorithms bias creates serious disadvantages for some groups, such as denying adequate medical coverage. It also clouds an otherwise strong debut for the Apple Card ̵
@AppleCard is such a damn sexist program. My wife and I provided joint tax returns, live in a community estate and have been married for a long time. Still, Apple's black box algorithm thinks I deserve 20 times the credit limit she does. No appeals.
– DHH (@dhh) November 7, 2019