Romance scams have long plagued the online world, preying on individuals seeking love and companionship. However, the emergence of deepfake technology has added a dangerous layer to these schemes, creating a new wave of deception that is increasingly difficult to detect.

Deepfakes leverage artificial intelligence to fabricate incredibly realistic fake images, videos, and even voices, making it easier than ever for scammers to construct convincing false identities and manipulate their victims. These heavily manipulated pieces of digital content can make it appear a person has said or done something they never did, blurring the lines between reality and fabrication.

While sometimes used for fun or entertainment, deepfakes are increasingly being used for more malicious purposes—such as misinformation and scams.

One recent case that highlights the devastating impact of deepfakes involves a French woman who was tricked out of $850,000 by a scammer using deepfake photos and videos of Brad Pitt.

Their correspondence was packed with AI-generated materials like pictures and even videos, adding to the believability of the scam. This is not an isolated incident. In Hong Kong, a similar scam using deepfake technology resulted in victims losing more than $46 million.

The scammers would brag about their luxurious lifestyles and engage in live chats using deepfakes to gain victims’ trust . Once the scammers had developed an online relationship with their victims, they would ask the victims to transfer cryptocurrencies to fake overseas crypto platforms before disappearing.

How Deepfakes Work

Deepfakes are created using sophisticated AI algorithms trained on extensive datasets of images and videos. These algorithms can swap faces, manipulate expressions, and even generate entirely new videos that appear incredibly realistic. The technology has advanced to the point where it can be difficult, even for experts, to distinguish between real and fake content.

Deepfakes can also be used in other types of scams, such as phishing attacks. Scammers may leverage deepfake voices to create realistic voicemail messages instructing you to call back and provide confidential information or login credentials to your accounts.

Cloning Voices

Voice cloning is another facet of deepfake technology that is rapidly becoming more sophisticated. By analyzing a person’s voice, AI algorithms can learn to mimic their vocal patterns, intonations, and nuances. This allows scammers to create fake phone calls or voice messages that sound like they are coming from a real person, such as a celebrity or a trusted friend.

Voice cloning is just one way to produce human-sounding speech using AI. It’s also possible to create natural-sounding speech using a library of synthetic voices. These synthetic voices are created from lots of datasets, as opposed to speech data from one existing individual, and still sound entirely human.

How Romance Scams Target Victims

Romance scammers are often present on dating and social media sites. They typically operate on dating apps and social media platforms, where they create fake profiles using stolen photos and fabricated personal information. They often target people who are vulnerable or lonely, and they use emotional manipulation and promises of love and companionship to gain their trust. Scammers may propose marriage and make plans to meet in person, but that will never happen.

These criminals are experts at what they do and will seem genuine, caring, and believable. They want to establish a relationship as quickly as possible, endear themselves to the victim, and gain trust. They may also try to isolate you from friends and family.

Some romance scammers take an extra step and profile their potential victims before contacting them. With information they’ve gathered online, they can fine-tune their approach. For example, we’ve seen cases where scammers target widowers with bogus profile pics that share similarities with the widower’s deceased spouse.

Once they have established a relationship with their victim, scammers will often invent elaborate scenarios and ask for financial help to get them out of trouble. They may ask you to send cash or gift cards, invest in a cryptocurrency scheme, or share sensitive photos. They may claim to be in financial distress, have a medical emergency, or need help with travel expenses. In some cases, they may even use deepfake videos to create fake scenarios that appear to support their claims.

Some common excuses scammers use to request money include:

• Urgent medical bills
• Fees to leave military service
• Payment for travel expenses (alleging they want to come to see you in person)
• Payment for gambling or other types of debts so they can start over and begin a new life with you

Scammers often claim to be using a “private” or “secret” account to explain why their profile differs from the celebrity’s official account. For some, the dream of having a relationship with a famous and admired person is sufficient to completely remove any rational thought about it.

Scammers may also introduce victims to a “manager” who asks for money to cover administrative costs or to prove the victim is worthy of meeting the celebrity. They will tell you how to pay, often requesting gift cards or cryptocurrency.

The Cost of Romance Scams

Romance scams have a significant financial and emotional impact on victims. In the UK, romance scams have resulted in losses of over £92 million in a single year, with the average victim losing £11,500. In the US, over 64,000 people reported romance scams in 2023, with losses totaling $1.1 billion. Americans lost over $1 billion to romance scams in 2022.

Criminals can trick victims into sending them money in many ways, not just via a bank transfer. Victims have lost money via bank transfer, money transfer, sending fraudsters gift cards and vouchers or presents such as phones and laptops, and providing them with access to their bank account or card.

These scams not only cause financial hardship but can also lead to feelings of shame, embarrassment, and betrayal. Victims may experience long-term psychological effects, such as anxiety, depression, and difficulty trusting others. In some extreme cases, victims have had to remortgage their homes.

When looking at the age of people who had fallen victim, men and women aged between 55 and 64 were most likely to be tricked by fraudsters masquerading as love interests.

Real-World Examples

The case of the French woman who lost €830,000 (approximately $850,000) to a scammer posing as Brad Pitt highlights the devastating impact deepfakes can have in romance scams. The scammer used AI-generated images and videos to convince the victim that she was communicating with the real Brad Pitt, exploiting her admiration for the celebrity. This elaborate scheme involved promises of a future together and requests for financial assistance, ultimately leading to a significant financial loss for the victim.

In another case, a woman in Hong Kong was scammed out of HK$1.5 million (approximately US$190,000) by a fraudster who used deepfake technology to impersonate a South Korean celebrity. The scammer contacted the victim through social media and gained her trust by sending her personalized messages and videos that appeared to show the celebrity interacting with her. The scammer then convinced the victim to invest in a fake cryptocurrency scheme, promising her high returns. The victim eventually realized she had been scammed when she tried to withdraw her money and discovered that the investment platform was fake.

How to Identify and Avoid Romance Scams

It is important to be aware of the signs of a romance scam and to take steps to protect yourself. Here are some red flags to watch out for:

If you suspect that you are being targeted by a romance scammer, it is important to:

• Stop communicating with the person immediately.
• Report the scam to the dating site or social media platform where you met the person.
• Contact your bank or credit card company if you have sent any money.
• Report the scam to Action Fraud (in the UK) or the Federal Trade Commission (in the US).

If you want to communicate outside of the dating site, set up an alternate email address or utilize an instant messaging app that isn’t connected to personal information like your primary email and phone number.

There is also a collaborative initiative, called the Banking Protocol, to provide a rapid response to consumers where bank staff spot warning signs that a customer is falling victim to a scam.

Conclusion

Deepfake technology is making it easier than ever for scammers to deceive their victims, blurring the lines between reality and fabrication in the online world. These scams prey on individuals seeking connection, exploiting their emotions and vulnerabilities for financial gain. The increasing sophistication of deepfakes, coupled with the manipulative tactics employed by scammers, makes it crucial to exercise vigilance and caution when interacting with people online. By being aware of the red flags, taking proactive steps to verify identities, and seeking advice from trusted sources, individuals can reduce their risk of falling victim to these devastating schemes. Remember to be skeptical, protect your personal information, and never send money to someone you have not met in person.

In addition to the steps outlined above, it is essential to stay informed about the latest scams and trends in deepfake technology. Share this information with friends and family, especially those who may be more vulnerable to online deception. By raising awareness and promoting critical thinking in the digital age, we can collectively combat the growing threat of deepfake romance scams and foster a safer online environment for everyone.