GenAI_prompts_risk_harmonic

One in ten GenAI prompts puts sensitive data at risk

Share:

Despite their potential, many organizations hesitate to fully adopt GenAI tools due to concerns about sensitive data being inadvertently shared and possibly used to train these systems, according to Harmonic.

Sensitive data exposure in GenAI prompts

A new study, based on tens of thousands of prompts from business users, reveals that nearly one in ten potentially disclose sensitive data.

The prompts have been analyzed by Harmonic Security during Q4 of 2024 and monitor the use of GenAl tools including Microsoft Copilot, OpenAl ChatGPT, Google Gemini, Anthropic’s Claude, and Perplexity.

In the vast majority of cases, employee behavior when using GenAI tools is straightforward. Users commonly ask to summarize a piece of text, edit a blog, or write documentation for code. However, 8.5% of prompts are a concern and put sensitive information at risk.

Of this number, 45.8% of prompts potentially disclosed customer data, such as billing information and authentication data. A further 26.8% contained information on employees, including payroll data, PII, and employment records. Some prompts even asked GenAI to conduct employee performance reviews.

Of the remainder, legal and finance data accounted for 14.9%. This included information on sales pipeline data, investment portfolios, and M&A activity. Security-related information, comprising 6.9% of sensitive prompts, is particularly concerning.

Examples include penetration test results, network configurations, and incident reports. Such data could provide attackers with a blueprint for exploiting vulnerabilities. Finally, sensitive code, such as access keys and proprietary source code, constituted the remaining 5.6% of sensitive prompts potentially disclosed.

Free GenAI services pose security threat

Also of concern is the number of employees using the free tiers of GenAI services that typically don’t have the security features that ship with enterprise versions. Many free-tier tools explicitly state they train on customer data, meaning sensitive information entered could be used to improve models.

Of the GenAI models assessed 63.8% of ChatGPT users used the free tier, compared with 58.6% of those using Gemini, 75% for Claude, and 50.5% for Perplexity.

“Most GenAI use is mundane but the 8.5% of prompts we analyzed potentially put sensitive personal and company information at risk. In most cases, organizations were able to manage this data leakage by blocking the request or warning the user about what they were about to do. But not all firms have this capability yet. The high number of free subscriptions is also a concern, the saying that ‘if the product is free, then you are the product’ applies here and despite the best efforts of the companies behind GenAI tools there is a risk of data disclosure,” said Alastair Paterson, CEO at Harmonic Security.

Organizations must move beyond “block” strategies to manage GenAl risks effectively.

Source

Leave a Comment

Your email address will not be published. Required fields are marked *

loader-image
London, GB
11:46 pm, Jul 11, 2025
weather icon 22°C
L: 21° | H: 23°
clear sky
Humidity: 64 %
Pressure: 1018 mb
Wind: 6 mph ESE
Wind Gust: 0 mph
UV Index: 0
Precipitation: 0 mm
Clouds: 1%
Rain Chance: 0%
Visibility: 10 km
Sunrise: 4:56 am
Sunset: 9:15 pm
DailyHourly
Daily ForecastHourly Forecast
Tomorrow 10:00 pm
weather icon
21° | 23°°C 0 mm 0% 10 mph 65 % 1018 mb 0 mm/h
Sun Jul 13 10:00 pm
weather icon
17° | 29°°C 0 mm 0% 7 mph 66 % 1015 mb 0 mm/h
Mon Jul 14 10:00 pm
weather icon
19° | 28°°C 0 mm 0% 14 mph 71 % 1017 mb 0 mm/h
Tue Jul 15 10:00 pm
weather icon
15° | 25°°C 0 mm 0% 13 mph 68 % 1020 mb 0 mm/h
Wed Jul 16 10:00 pm
weather icon
18° | 25°°C 1 mm 100% 13 mph 83 % 1019 mb 0 mm/h
Tomorrow 1:00 am
weather icon
20° | 23°°C 0 mm 0% 3 mph 64 % 1018 mb 0 mm/h
Tomorrow 4:00 am
weather icon
17° | 21°°C 0 mm 0% 4 mph 63 % 1018 mb 0 mm/h
Tomorrow 7:00 am
weather icon
19° | 20°°C 0 mm 0% 5 mph 65 % 1018 mb 0 mm/h
Tomorrow 10:00 am
weather icon
26° | 26°°C 0 mm 0% 6 mph 44 % 1017 mb 0 mm/h
Tomorrow 1:00 pm
weather icon
29° | 29°°C 0 mm 0% 6 mph 32 % 1016 mb 0 mm/h
Tomorrow 4:00 pm
weather icon
29° | 29°°C 0 mm 0% 10 mph 30 % 1014 mb 0 mm/h
Tomorrow 7:00 pm
weather icon
25° | 25°°C 0 mm 0% 9 mph 41 % 1014 mb 0 mm/h
Tomorrow 10:00 pm
weather icon
21° | 21°°C 0 mm 0% 6 mph 55 % 1015 mb 0 mm/h
Name Price24H (%)
Bitcoin(BTC)
€100,562.39
1.41%
Ethereum(ETH)
€2,516.93
-0.71%
Tether(USDT)
€0.86
0.03%
XRP(XRP)
€2.30
6.14%
Solana(SOL)
€138.13
-1.79%
USDC(USDC)
€0.86
0.01%
Dogecoin(DOGE)
€0.169957
3.15%
Shiba Inu(SHIB)
€0.000011
0.07%
Pepe(PEPE)
€0.000010
1.21%
Peanut the Squirrel(PNUT)
€0.246234
7.19%
Scroll to Top