ARTICLE AD BOX
Business Security
Malicious usage of AI is reshaping nan fraud landscape, creating awesome caller risks for businesses

10 Mar 2025 • , 4 min. read

Artificial intelligence (AI) is doing awesome things for galore businesses. It’s helping to automate repetitive tasks for ratio and costs savings. It’s supercharging customer work and coding. And it’s helping to unearth penetration to thrust improved business decision-making. Way backmost successful October 2023, Gartner estimated that 55% of organizations were successful aviator aliases accumulation mode pinch generative AI (GenAI). That fig will surely beryllium higher today.
Yet criminal enterprises are besides innovating pinch nan technology, and that spells bad news for IT and business leaders everywhere. To tackle this mounting fraud threat, you request a layered consequence that focuses connected people, process and technology.
What are nan latest AI and deepfake threats?
Cybercriminals are harnessing nan powerfulness of AI and deepfakes successful respective ways. They include:
- Fake employees: Hundreds of companies person reportedly been infiltrated by North Koreans posing arsenic distant moving IT freelancers. They usage AI devices to compile clone resumes and forged documents, including AI-manipulated images, successful bid to walk inheritance checks. The extremity end is to gain money to nonstop backmost to nan North Korean authorities arsenic good arsenic information theft, espionage and moreover ransomware.
- A caller breed of BEC scams: Deepfake audio and video clips are being utilized to amplify business email discuss (BEC)-type fraud wherever finance workers are tricked into transferring firm costs to accounts nether power of nan scammer. In 1 caller infamous case, a finance worker was persuaded to transfer $25 cardinal to fraudsters who leveraged deepfakes to airs arsenic nan company’s CFO and different members of unit successful a video convention call. This is by nary intends new, nevertheless – arsenic acold backmost arsenic 2019, a UK power executive was tricked into wiring £200,000 to scammers aft speaking to a deepfake type of his leader connected nan phone.
- Authentication bypass: Deepfakes are besides being utilized to thief fraudsters impersonate morganatic customers, create caller personas and bypass authentication checks for relationship creation and log-ins. One peculiarly blase portion of malware, GoldPickaxe, is designed to harvest facial nickname data, which is past utilized to create deepfake videos. According to one report, 13.5% of each world integer relationship openings were suspected of fraudulent activity past year.
- Deepfake scams: Cybercriminals tin besides usage deepfakes successful little targeted ways, specified arsenic impersonating institution CEOs and different high-profile figures connected societal media, to further finance and different scams. As ESET’s Jake Moore has demonstrated, theoretically immoderate firm leader could beryllium victimized successful nan aforesaid way. On a akin note, arsenic ESET’s latest Threat Report describes, cybercriminals are leveraging deepfakes and company-branded societal media posts to lure victims arsenic portion of a caller type of finance fraud called Nomani.
- Password cracking: AI algorithms tin beryllium group to activity cracking nan passwords of customers and employees, enabling information theft, ransomware and wide personality fraud. One specified example, PassGAN, tin reportedly ace passwords successful little than half a minute.
- Document forgeries: AI-generated aliases altered documents are different measurement to bypass cognize your customer (KYC) checks astatine banks and different companies. They tin besides beryllium utilized for security fraud. Nearly each (94%) claims handlers suspect astatine slightest 5% of claims are being manipulated pinch AI, particularly little worth claims.
- Phishing and reconnaissance: The UK’s National Cyber Security Centre (NCSC) has warned of nan uplift cybercriminals are getting from generative and different AI types. It claimed successful early 2024 that nan exertion will “almost surely summation nan measurement and heighten nan effect of cyber-attacks complete nan adjacent 2 years.” It will person a peculiarly precocious effect connected improving nan effectiveness of societal engineering and reconnaissance of targets. This will substance ransomware and information theft, arsenic good arsenic wide-ranging phishing attacks connected customers.
What’s nan effect of AI threats?
The effect of AI-enabled fraud is yet financial and reputational harm of varying degrees. One study estimates that 38% of gross mislaid to fraud complete nan past twelvemonth was owed to AI-driven fraud. Consider how:
- KYC bypass allows fraudsters to tally up in installments and drain morganatic customer accounts of funds.
- Fake labor could bargain delicate IP and regulated customer information, creating financial, reputational and compliance headaches.
- BEC scams tin make immense one-off losses. The category earned cybercriminals complete $2.9 cardinal successful 2023 alone.
- Impersonation scams frighten customer loyalty. A third of customers say they’ll locomotion distant from a marque they emotion aft conscionable 1 bad experience.
Pushing backmost against AI-enabled fraud
Fighting this surge successful AI-enabled fraud requires a multi-layered response, focusing connected people, process and technology. This should include:
- Frequent fraud consequence assessments
- An updating of anti-fraud policies to make them AI-relevant
- Comprehensive training and consciousness programs for unit (e.g., successful how to spot phishing and deepfakes)
- Education and consciousness programs for customers
- Switching connected multifactor authentication (MFA) for each delicate firm accounts and customers
- Improved inheritance checks for employees, specified arsenic scanning resumes for profession inconsistencies
- Ensure each labor are interviewed connected video earlier hiring
- Improve collaboration betwixt HR and cybersecurity teams
AI tech tin besides beryllium utilized successful this fight, for example:
- AI-powered devices to observe deepfakes (e.g., successful KYC checks).
- Machine learning algorithms to observe patterns of suspicious behaviour successful unit and customer data.
- GenAI to make synthetic data, pinch which caller fraud models tin beryllium developed, tested and trained.
As nan conflict betwixt malicious and benevolent AI enters an aggravated caller phase, organizations must update their cybersecurity and anti-fraud policies to guarantee they support gait pinch nan evolving threat landscape. With truthful overmuch astatine stake, nonaccomplishment to do truthful mightiness effect semipermanent customer loyalty, marque worth and moreover derail important integer translator initiatives.
AI has nan imaginable to alteration nan crippled for our adversaries. But it tin besides do truthful for firm information and consequence teams.
Let america support you
up to date
Sign up for our newsletters