ChatGPT doesn’t discriminate – it’s like an eager puppy, trying to fulfill its owner’s every demand, all for that little treat (or in ChatGPT’s case, a little “thumbs up” click). ChatGPT, the AI language model that knows all the answers, has been causing a sensation in all the right and wrong ways. Yes, this robot can enrich our professional lives, so despite the worries about potentially lost jobs and taking over the world, everyone’s buzzing about it. You, us, and unfortunately, cybercriminals too.

The language model has good intentions – to help the human! – which sounds wonderful... not just for the good guys but for cybercriminals as well. It can be misused, accidentally or maliciously, becoming a potential threat to your business and its data.

In this article, we’ll explore some of the ways ChatGPT is used to help businesses, how it can be a threat to data security, and provide tips on how businesses can protect themselves.

How can ChatGPT be used for business?

ChatGPT is a great tool for many things in day-to-day business operations, from replying to emails to data analysis and processing, and even much more complicated tasks. You could even use it to create a chatbot for your business, or have it organize tons of data for you without breaking a sweat.

Sound enticing? Some of these tasks would take a human hours to complete, and a bot can do it in less than a minute... Are you yelling “Sign me up!” as you read this?

But while using a bot to analyse your company’s latest financial information seems like a great time-saving idea, it could backfire pretty quickly.

Why can ChatGPT be a threat for data security?

ChatGPT tries to simulate how the human brain works. It absorbs information into its robot “brain” and can recall that information when it needs to and use in consequent analyses and interactions. But as they say, with great power comes great responsibility – ChatGPT “knows” an incredible amount of information.

Why should you be worried?

It’s impossible to keep your sensitive information confidential

While there are thousands of prompts you can give ChatGPT, “keep my sensitive data confidential” isn’t one of them.

ChatGPT is a deep learning model, which allows it to learn from its conversations with users. In other words, your conversations will not stay between the two of you. No matter how personable ChatGPT may sound, it’s just a heartless, emotionless program with no regard for you or your business.

Consider these tasks that you or your IT department could ask ChatGPT to assist with:

  • Help write or find a bug in source code.
  • Create notes from a board meeting transcript.
  • Optimize a test sequence for identifying internal system vulnerabilities.
  • Sort customer payment information into a spreadsheet.

Can you spot the threats?

But wait, there’s more! Not only does ChatGPT remember any input you give it for its future analysis, OpenAI employees are able to access data from your ChatGPT chats, adding an extra layer of human factor to this whole data security situation. Remember, the human factor is involved in 82% of all data security breaches in 2022 (based on the 2022 Verizon Data Breach Investigations Report). And this was before ChatGPT became a part of our everyday lives.

And that’s still not everything – if you aren’t careful and, say, use an unsecured or public wifi network to have a conversation with ChatGPT, someone with ill intentions could potentially access your chat and see what data you’re sharing.

Those examples at the beginning of this section? They come from real life situations that could’ve easily resulted in data breaches caused by ChatGPT (most of them are from an investigation at Samsung!).

Overreliance on AI and ChatGPT can lead to neglecting important aspects of data security, such as manual review and verification.

Mitigation measures: Long story short, don’t let ChatGPT’s promise of a quick and easy data analysis cloud your judgement. Adopt a security-first mindset, educate your employees, not only about your company’s data security policies, but also about AI and the potential threats it can mean for businesses. Remember, there are extra considerations when it comes to remote workers.

Cyber criminals use ChatGPT to exploit vulnerabilities in security systems

There is an entire dark network thriving and making millions from stolen data belonging to organizations and individuals worldwide. In fact, ransomware groups are run like regular businesses, complete with marketing departments and RaaS (ransomware as a service) products! It's safe to assume that once ChatGPT became available for everyone to explore back in November 2022, cyber criminals had a field day.

And explore they did. The bad guys quickly jumped on the language bot bandwagon, using it to find data security system vulnerabilities, write convincing phishing emails, help create ransomware and even custom malware to evade security systems.

All of this faster, less detectable, and more grammatically correct than ever before (phishing emails are known to raise red flags with their grammar mistakes).

ChatGPT is making it easier for cyber criminals to execute attacks and steal sensitive data form businesses. As companies increasingly rely on AI and ChatGPT for data processing and analysis, the attack surface for potential data breaches expands. This means that there are more potential points of entry for cyber criminals to exploit.

Cyber attacks also have the potential to become more sophisticated. Can ChatGPT be used to evade detection by traditional security measures? Probably. Would a hacker do everything they can to use ChatGPT in their malicious favour? Definitely.

Mitigation measures: Businesses should implement appropriate DLP security measures, such as encryption, access controls, and regular security audits. If security threats are getting more sophisticated, so should your DLP measures. A dedicated data loss prevention software (such as Safetica NXT) could be a game-changer for any SMB or larger organization.

ChatGPT can be used as a tool for insider threats

AI and ChatGPT can also be used by insiders to carry out data breaches. For example, an employee could use AI to identify sensitive data and then use ChatGPT to generate well-written phishing emails to other employees or business partners.

Insider threats can be difficult to detect because the insider already has access to sensitive data that they can use to steal more data.

Mitigation measures: To reduce the risk of insider threats, businesses use the Zero Trust approach to limit access to sensitive data only to those who need it. Safetica ONE is one of the best DLP products out there, and it includes Insider Threat Protection mechanisms.

It’s (possibly) violating privacy regulations

In addition to the potential damage to a business's reputation and finances, data breaches, including those caused or assisted by ChatGPT, can lead to legal consequences and regulatory compliance failures. For example, businesses may be subject to fines and other penalties if they are found to be in violation of data protection laws such as GDPR, CCPA, or HIPAA. There are no exceptions saying it’s not your fault if the robot did it!

Italy has even banned ChatGPT over privacy concerns. Whether or not those concerns are justified is yet to be seen, as investigations are currently underway.

Mitigation measures: Businesses have to stay up-to-date on regulations that they need to comply to and have a comprehensive information security management system in place (ISO 27001 can help with that). Talk to your employees about privacy policies and data protection, and discuss the threats of using ChatGPT with them.


Safetica’s tips for protecting your business

Here are some tips for businesses looking to protect themselves from the potential threats posed by ChatGPT:


  • Understand the risks: Be aware of the potential risks associated with using AI and ChatGPT and share this information with your management and employees. Don’t forget to consider the special circumstances of hybrid work environments.
  • Identify sensitive data: Identify the sensitive data that your business handles, such as customer information, trade secrets, or financial records. A smart DLP solution can assist with data discovery and classification.
  • Implement strong security measures: Implement appropriate DLP measures, such as encryption, and access controls, to protect sensitive data. Make sure you have automated detection and reporting systems in place.
  • Conduct regular security audits: A best practice in DLP is to conduct regular security audits to identify and address any vulnerabilities in your data security systems. This way, you are able to rectify any problems before cyber criminals or inside actors are able to take advantage of them.
  • Train employees on data security: Educate your employees on data security best practices, including how to handle sensitive data and recognize security threats.
  • Be aware of legal and regulatory requirements: Be aware of any legal and regulatory requirements for data security, such as GDPR, CCPA, or HIPAA, and ensure compliance.
  • Keep up to date with data security news: Stay informed about the latest developments and news related to the capabilities of AI.
  • Seek professional advice: As a business owner or IT professional, you may want to consult with a data protection expert to ensure that your business is adequately protected.


  Talk to us

Petra Tatai Chaloupka
Cybersecurity Consultant

Next articles

Data Loss Prevention in Logistics

In the logistics sector, DLP plays a pivotal role in securing the multiple data streams involved in supply chain operations. Learn how you can protect your data in logistics with Safetica.

Securing Slack: The Power of Data Loss Prevention

Slack has become the go-to cloud-based collaboration tool for companies of all sizes. Read how to secure Slack with Safetica.

Data Loss Prevention in Government

Governments house a wealth of sensitive information, from classified data to citizens' records. Explore the complex world of government data breaches and learn how data loss prevention protects governmental institutions.