GenAI_prompts_risk_harmonic

One in ten GenAI prompts puts sensitive data at risk

Share:

Despite their potential, many organizations hesitate to fully adopt GenAI tools due to concerns about sensitive data being inadvertently shared and possibly used to train these systems, according to Harmonic.

Sensitive data exposure in GenAI prompts

A new study, based on tens of thousands of prompts from business users, reveals that nearly one in ten potentially disclose sensitive data.

The prompts have been analyzed by Harmonic Security during Q4 of 2024 and monitor the use of GenAl tools including Microsoft Copilot, OpenAl ChatGPT, Google Gemini, Anthropic’s Claude, and Perplexity.

In the vast majority of cases, employee behavior when using GenAI tools is straightforward. Users commonly ask to summarize a piece of text, edit a blog, or write documentation for code. However, 8.5% of prompts are a concern and put sensitive information at risk.

Of this number, 45.8% of prompts potentially disclosed customer data, such as billing information and authentication data. A further 26.8% contained information on employees, including payroll data, PII, and employment records. Some prompts even asked GenAI to conduct employee performance reviews.

Of the remainder, legal and finance data accounted for 14.9%. This included information on sales pipeline data, investment portfolios, and M&A activity. Security-related information, comprising 6.9% of sensitive prompts, is particularly concerning.

Examples include penetration test results, network configurations, and incident reports. Such data could provide attackers with a blueprint for exploiting vulnerabilities. Finally, sensitive code, such as access keys and proprietary source code, constituted the remaining 5.6% of sensitive prompts potentially disclosed.

Free GenAI services pose security threat

Also of concern is the number of employees using the free tiers of GenAI services that typically don’t have the security features that ship with enterprise versions. Many free-tier tools explicitly state they train on customer data, meaning sensitive information entered could be used to improve models.

Of the GenAI models assessed 63.8% of ChatGPT users used the free tier, compared with 58.6% of those using Gemini, 75% for Claude, and 50.5% for Perplexity.

“Most GenAI use is mundane but the 8.5% of prompts we analyzed potentially put sensitive personal and company information at risk. In most cases, organizations were able to manage this data leakage by blocking the request or warning the user about what they were about to do. But not all firms have this capability yet. The high number of free subscriptions is also a concern, the saying that ‘if the product is free, then you are the product’ applies here and despite the best efforts of the companies behind GenAI tools there is a risk of data disclosure,” said Alastair Paterson, CEO at Harmonic Security.

Organizations must move beyond “block” strategies to manage GenAl risks effectively.

Source

Leave a Comment

Your email address will not be published. Required fields are marked *

loader-image
London, GB
2:55 am, Jul 11, 2025
weather icon 19°C
L: 17° | H: 19°
broken clouds
Humidity: 78 %
Pressure: 1021 mb
Wind: 5 mph E
Wind Gust: 0 mph
UV Index: 0
Precipitation: 0 mm
Clouds: 60%
Rain Chance: 0%
Visibility: 10 km
Sunrise: 4:56 am
Sunset: 9:15 pm
DailyHourly
Daily ForecastHourly Forecast
Today 10:00 pm
weather icon
17° | 19°°C 0 mm 0% 8 mph 78 % 1021 mb 0 mm/h
Tomorrow 10:00 pm
weather icon
19° | 30°°C 0 mm 0% 10 mph 66 % 1019 mb 0 mm/h
Sun Jul 13 10:00 pm
weather icon
18° | 30°°C 0 mm 0% 7 mph 71 % 1015 mb 0 mm/h
Mon Jul 14 10:00 pm
weather icon
18° | 28°°C 1 mm 100% 15 mph 84 % 1016 mb 0 mm/h
Tue Jul 15 10:00 pm
weather icon
14° | 20°°C 1 mm 100% 14 mph 81 % 1017 mb 0 mm/h
Today 4:00 am
weather icon
16° | 19°°C 0 mm 0% 3 mph 78 % 1021 mb 0 mm/h
Today 7:00 am
weather icon
19° | 19°°C 0 mm 0% 2 mph 74 % 1021 mb 0 mm/h
Today 10:00 am
weather icon
24° | 27°°C 0 mm 0% 2 mph 56 % 1021 mb 0 mm/h
Today 1:00 pm
weather icon
30° | 30°°C 0 mm 0% 3 mph 32 % 1020 mb 0 mm/h
Today 4:00 pm
weather icon
32° | 32°°C 0 mm 0% 4 mph 26 % 1018 mb 0 mm/h
Today 7:00 pm
weather icon
30° | 30°°C 0 mm 0% 6 mph 29 % 1017 mb 0 mm/h
Today 10:00 pm
weather icon
23° | 23°°C 0 mm 0% 8 mph 49 % 1019 mb 0 mm/h
Tomorrow 1:00 am
weather icon
21° | 21°°C 0 mm 0% 5 mph 57 % 1019 mb 0 mm/h
Name Price24H (%)
Bitcoin(BTC)
€99,149.63
4.27%
Ethereum(ETH)
€2,520.58
6.29%
Tether(USDT)
€0.85
-0.02%
XRP(XRP)
€2.18
5.12%
Solana(SOL)
€140.57
4.47%
USDC(USDC)
€0.85
0.00%
Dogecoin(DOGE)
€0.167253
8.32%
Shiba Inu(SHIB)
€0.000011
8.15%
Pepe(PEPE)
€0.000010
13.18%
Peanut the Squirrel(PNUT)
€0.245548
22.13%
Scroll to Top