Now playing
02:44
Apple VP on why Apple Card is a game changer
screengrab US social media
screengrab US social media
PHOTO: Getty Images
Now playing
04:35
Tech companies ban Trump, but not other problematic leaders
PHOTO: Samsung
Now playing
01:53
See Samsung's new Galaxy S21 lineup
PHOTO: CNN
Now playing
02:47
Extremists and conspiracy theorists search for new platforms online
This illustration picture shows the social media website from Parler displayed on a computer screen in Arlington, Virginia on July 2, 2020. - Amid rising turmoil in social media, recently formed social network Parler is gaining with prominent political conservatives who claim their voices are being silenced by Silicon Valley giants. Parler, founded in Nevada in 2018, bills itself as an alternative to "ideological suppression" at other social networks. (Photo by Olivier Douliery/AFP/Getty Images)
This illustration picture shows the social media website from Parler displayed on a computer screen in Arlington, Virginia on July 2, 2020. - Amid rising turmoil in social media, recently formed social network Parler is gaining with prominent political conservatives who claim their voices are being silenced by Silicon Valley giants. Parler, founded in Nevada in 2018, bills itself as an alternative to "ideological suppression" at other social networks. (Photo by Olivier Douliery/AFP/Getty Images)
PHOTO: Olivier Douliery/AFP/Getty Images
Now playing
03:49
Parler sues Amazon in response to being deplatformed
PHOTO: Twitter
Now playing
02:39
Twitter permanently suspends Donald Trump from platform
Panasonic
Panasonic's Augmented Reality Heads-up Display
PHOTO: Panasonic USA
Now playing
01:06
This tech gives drivers directions on the road in front of them
PHOTO: LG Display
Now playing
01:10
See LG's transparent TV
PHOTO: Twitter/@gregdoesthings
Now playing
02:06
Internet gets creative with empty iPhone boxes
NEW YORK, NY - JUNE 3: The Google logo adorns the outside of their NYC office Google Building 8510 at 85 10th Ave on June 3, 2019 in New York City. Shares of Google parent company Alphabet were down over six percent on Monday, following news reports that the U.S. Department of Justice is preparing to launch an anti-trust investigation aimed at Google. (Photo by Drew Angerer/Getty Images)
NEW YORK, NY - JUNE 3: The Google logo adorns the outside of their NYC office Google Building 8510 at 85 10th Ave on June 3, 2019 in New York City. Shares of Google parent company Alphabet were down over six percent on Monday, following news reports that the U.S. Department of Justice is preparing to launch an anti-trust investigation aimed at Google. (Photo by Drew Angerer/Getty Images)
PHOTO: Drew Angerer/Getty Images North America/Getty Images
Now playing
03:25
Google employee on unionizing: Google can't fire us all
Now playing
02:01
Watch 'deepfake' Queen deliver alternative Christmas speech
This photo taken on August 4, 2020 shows Prince, a member of the hacking group Red Hacker Alliance who refused to give his real name, using a website that monitors global cyberattacks on his computer at their office in Dongguan, China
This photo taken on August 4, 2020 shows Prince, a member of the hacking group Red Hacker Alliance who refused to give his real name, using a website that monitors global cyberattacks on his computer at their office in Dongguan, China's southern Guangdong province. - From a small, dingy office tucked away in an industrial city in southern China, one of China's last "volunteer hacker" groups maintains a final outpost in its patriotic hacking war. (Photo by NICOLAS ASFOURI / AFP) / TO GO WITH China-hacking-security,FOCUS by Laurie Chen / The erroneous mention[s] appearing in the metadata of this photo by NICOLAS ASFOURI has been modified in AFP systems in the following, we removed the HOLD HOLD HOLD in the main caption. Please immediately remove the erroneous mention[s] from all your online services and delete it (them) from your servers. If you have been authorized by AFP to distribute it (them) to third parties, please ensure that the same actions are carried out by them. Failure to promptly comply with these instructions will entail liability on your part for any continued or post notification usage. Therefore we thank you very much for all your attention and prompt action. We are sorry for the inconvenience this notification may cause and remain at your disposal for any further information you may require. (Photo by NICOLAS ASFOURI/AFP via Getty Images)
PHOTO: NICOLAS ASFOURI/AFP/AFP via Getty Images
Now playing
03:30
Russia claims cyberattack may be plot to hurt ties with Biden
Now playing
01:42
Watch father leave daughter dozens of surprise Ring messages
PHOTO: Photo Illustration: Kena Betancur/Getty Images
Now playing
04:50
Zoom's founder says he 'let down' customers. Here's why
Now playing
00:48
See Walmart's self-driving delivery trucks in action
Now playing
01:25
This robotaxi from Amazon's Zoox has no reverse function
(CNN Business) —  

The New York Department of Financial Services is looking into allegations of gender discrimination against users of the Apple Card, which is administered by Goldman Sachs.

The allegations blew up on Twitter Saturday after tech entrepreneur David Heinmeier Hansson wrote that Apple (AAPL) Card offered him twenty times the credit limit as his wife, although they have shared assets and she has a higher credit score. Many other users voiced similar experiences — including Apple (AAPL) co-founder Steve Wozniak.

Wozniak said his credit limit was 10 times that of his wife, despite the fact that they share all assets and accounts.

“Some say the blame is on Goldman Sachs, but the way Apple is attached, they should share responsibility,” Wozniak tweeted.

Hansson wrote that after reaching out to Apple in an attempt to rectify the situation, he was told credit limits are determined by an algorithm.

The situation throws a shadow over the Apple Card, which launched with much fanfare in August as a partnership between the tech giant’s Apple Pay program and a new retail consumer-focused effort at Goldman Sachs (FADXX). The companies had boasted that the card would be available to consumers that might otherwise struggle to access credit, including those with no credit history or below-average credit scores. But these allegations highlight the challenges inherent in letting artificial intelligence, which has been shown in a number of contexts to be biased, make decisions like how much credit to extend to a user.

Linda Lacewell, superintendent of the Department of Financial Services, said on Twitter Saturday the department would “take a look” into the allegations.

In a response to a request for comment on this story, an Apple spokesperson directed CNN Business to Goldman Sachs.

A spokesperson for Goldman Sachs said the company does not consider gender in determining credit limits.
“As with any other individual credit card, your application is evaluated independently,” the company said in a statement to CNN Business. “We look at an individual’s income and an individual’s creditworthiness, which includes factors like personal credit scores, how much debt you have, and how that debt has been managed. Based on these factors, it is possible for two family members to receive significantly different credit decisions.”

Hansson, in his Twitter thread, said the program’s decision to offer his wife such a low credit limit was so striking that they feared her identity had been stolen and they paid to check her credit score, finding it was higher than his. Hansson is the founder and chief technology officer at web development firm Basecamp.

Wozniak, who co-founded Apple with Steve Jobs and continues to work for the company, said on Twitter he and his wife had a similar experience with the Apple Card. Though they share all of their assets and accounts, he was offered ten times the credit limit of his wife.

“Some say the blame is on Goldman Sachs but the way Apple is attached, they should share responsibility,” Wozniak said.

AI-powered algorithms have been problematic in the past, researchers have found. Facial recognition software has trouble identifying women of color, and software used to sentence criminals was found to be biased against black Americans.

That could be an issue as AI technology underpins everything from the speech recognition that makes smart speakers like Siri work to the technology that allows autonomous vehicles to drive themselves; and in the case of the Apple Card, consumer credit assessments.

“Financial services companies are responsible for ensuring the algorithms they use do not unintentionally discriminate against protected groups,” Lacewell said on Twitter.

And it’s not the first time a tech company has been accused of facilitating discrimination in access to financial services. Facebook is facing a proposed class action lawsuit that alleges that ads for financial services such as loans and insurance coverage on the platform were targeted away from women and older people over the past three years.