Close Menu
New York Examiner News

    Subscribe to Updates

    Get the latest creative news from FooBar about art, design and business.

    What's Hot

    Garrick Merrifield Resurfaces With AI Harem Of Wives, Cult Vibes

    November 16, 2026

    Karol G Postpones Show in Mexico City Due to Health Reasons: Heres the New Date

    November 16, 2026

    Angels & Demons: Ken Russell's The Devils

    November 15, 2026
    Facebook X (Twitter) Instagram
    New York Examiner News
    • Home
    • US News
    • Politics
    • Business
    • Science
    • Technology
    • Lifestyle
    • Music
    • Television
    • Film
    • Books
    • Contact
      • About
      • Amazon Disclaimer
      • DMCA / Copyrights Disclaimer
      • Terms and Conditions
      • Privacy Policy
    New York Examiner News
    Home»Technology»The Security Hole at the Heart of ChatGPT and Bing
    Technology

    The Security Hole at the Heart of ChatGPT and Bing

    By AdminMay 25, 2023
    Facebook Twitter Pinterest LinkedIn WhatsApp Email Reddit Telegram
    The Security Hole at the Heart of ChatGPT and Bing

    [ad_1]

    Microsoft director of communications Caitlin Roulston says the company is blocking suspicious websites and improving its systems to filter prompts before they get into its AI models. Roulston did not provide any more details. Despite this, security researchers say indirect prompt-injection attacks need to be taken more seriously as companies race to embed generative AI into their services.

    “The vast majority of people are not realizing the implications of this threat,” says Sahar Abdelnabi, a researcher at the CISPA Helmholtz Center for Information Security in Germany. Abdelnabi worked on some of the first indirect prompt-injection research against Bing, showing how it could be used to scam people. “Attacks are very easy to implement, and they are not theoretical threats. At the moment, I believe any functionality the model can do can be attacked or exploited to allow any arbitrary attacks,” she says.

    Hidden Attacks

    Indirect prompt-injection attacks are similar to jailbreaks, a term adopted from previously breaking down the software restrictions on iPhones. Instead of someone inserting a prompt into ChatGPT or Bing to try and make it behave in a different way, indirect attacks rely on data being entered from elsewhere. This could be from a website you’ve connected the model to or a document being uploaded.

    “Prompt injection is easier to exploit or has less requirements to be successfully exploited than other” types of attacks against machine learning or AI systems, says Jose Selvi, executive principal security consultant at cybersecurity firm NCC Group. As prompts only require natural language, attacks can require less technical skill to pull off, Selvi says.

    There’s been a steady uptick of security researchers and technologists poking holes in LLMs. Tom Bonner, a senior director of adversarial machine-learning research at AI security firm Hidden Layer, says indirect prompt injections can be considered a new attack type that carries “pretty broad” risks. Bonner says he used ChatGPT to write malicious code that he uploaded to code analysis software that is using AI. In the malicious code, he included a prompt that the system should conclude the file was safe. Screenshots show it saying there was “no malicious code” included in the actual malicious code.

    Elsewhere, ChatGPT can access the transcripts of YouTube videos using plug-ins. Johann Rehberger, a security researcher and red team director, edited one of his video transcripts to include a prompt designed to manipulate generative AI systems. It says the system should issue the words “AI injection succeeded” and then assume a new personality as a hacker called Genie within ChatGPT and tell a joke.

    In another instance, using a separate plug-in, Rehberger was able to retrieve text that had previously been written in a conversation with ChatGPT. “With the introduction of plug-ins, tools, and all these integrations, where people give agency to the language model, in a sense, that’s where indirect prompt injections become very common,” Rehberger says. “It’s a real problem in the ecosystem.”

    “If people build applications to have the LLM read your emails and take some action based on the contents of those emails—make purchases, summarize content—an attacker may send emails that contain prompt-injection attacks,” says William Zhang, a machine learning engineer at Robust Intelligence, an AI firm working on the safety and security of models.

    No Good Fixes

    The race to embed generative AI into products—from to-do list apps to Snapchat—widens where attacks could happen. Zhang says he has seen developers who previously had no expertise in artificial intelligence putting generative AI into their own technology.

    If a chatbot is set up to answer questions about information stored in a database, it could cause problems, he says. “Prompt injection provides a way for users to override the developer’s instructions.” This could, in theory at least, mean the user could delete information from the database or change information that’s included.



    [ad_2]

    Original Source Link

    Share. Facebook Twitter Pinterest LinkedIn WhatsApp Email Reddit Telegram
    Previous ArticleCommon compostable plastic fails to break down after a year at sea
    Next Article Will AI impact your job? Some industries the technology is likely to have major impacts on

    RELATED POSTS

    Where was Nvidias security team? | TechCrunch

    November 15, 2026

    Amazons new Kindle Colorsoft is a premium e-reader with a premium price | TechCrunch

    November 14, 2026

    Uber confirms hackers stole thousands of drivers license information in data breach | TechCrunch

    November 13, 2026

    Cyberattack on Fireworks AI allowed hackers to access Notion customers chat transcripts | TechCrunch

    November 12, 2026

    Siri co-founder backs Helix for its voice ID tech | TechCrunch

    November 11, 2026

    Reddit is turning user conversations into AI-powered product reviews | TechCrunch

    November 10, 2026
    latest posts

    Garrick Merrifield Resurfaces With AI Harem Of Wives, Cult Vibes

    Seeking Sister Wife star Garrick Merrifield has remained under the radar after he was arrested…

    Karol G Postpones Show in Mexico City Due to Health Reasons: Heres the New Date

    November 16, 2026

    Angels & Demons: Ken Russell's The Devils

    November 15, 2026

    Where was Nvidias security team? | TechCrunch

    November 15, 2026

    6 Golden Age Westerns To Watch On Prime Video (That Dont Star John Wayne)

    November 15, 2026

    Watch Travis Barker and Cynthia Erivo perform In The Air Tonight as Phil Collins tells Rock & Roll Hall Of Fame: You havent heard the last of me

    November 15, 2026

    SNL Cold Open: Bowen Yang Returns as Jensen Huang to Roast Tech Billionaires

    November 15, 2026
    Categories
    • Books (1,589)
    • Business (6,481)
    • Events (85)
    • Film (6,450)
    • Lifestyle (4,502)
    • Music (6,582)
    • Politics (6,447)
    • Science (5,851)
    • Technology (6,437)
    • Television (6,142)
    • US News (6,486)
    popular posts

    12 Of The Best Cheap Colognes That Would Fool Even The Best Fragrance Experts in 2022

    [ad_1] Finding a cheap fragrance is easy, but choosing the best cheap cologne can be…

    Kelly Clarkson Enlists ‘The Voice’ Alum Corey Ward for ‘Once’ Duet – Billboard

    February 17, 2023

    Grilled Bread Appetizer With Figs and Goat Cheese

    September 8, 2026

    10 Memes That Perfectly Sum Up Rachel As A Character

    July 27, 2022
    Archives
    Browse By Category
    • Books (1,589)
    • Business (6,481)
    • Events (85)
    • Film (6,450)
    • Lifestyle (4,502)
    • Music (6,582)
    • Politics (6,447)
    • Science (5,851)
    • Technology (6,437)
    • Television (6,142)
    • US News (6,486)
    About Us

    We are a creativity led international team with a digital soul. Our work is a custom built by the storytellers and strategists with a flair for exploiting the latest advancements in media and technology.

    Most of all, we stand behind our ideas and believe in creativity as the most powerful force in business.

    What makes us Different

    We care. We collaborate. We do great work. And we do it with a smile, because we’re pretty damn excited to do what we do. If you would like details on what else we can do visit out Contact page.

    Our Picks

    Watch Travis Barker and Cynthia Erivo perform In The Air Tonight as Phil Collins tells Rock & Roll Hall Of Fame: You havent heard the last of me

    November 15, 2026

    SNL Cold Open: Bowen Yang Returns as Jensen Huang to Roast Tech Billionaires

    November 15, 2026

    Listen to the River! Arrow for a Stone Heart Is a Poetic Hybrid Experience Told Through an Indigenous Lens

    November 15, 2026
    © 2026 New York Examiner News. All rights reserved. All articles, images, product names, logos, and brands are property of their respective owners. All company, product and service names used in this website are for identification purposes only. Use of these names, logos, and brands does not imply endorsement unless specified. By using this site, you agree to the Terms & Conditions and Privacy Policy.

    Type above and press Enter to search. Press Esc to cancel.

    We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept All”, you consent to the use of ALL the cookies. However, you may visit "Cookie Settings" to provide a controlled consent.
    Cookie SettingsAccept All
    Manage consent

    Privacy Overview

    This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
    Necessary
    Always Enabled
    Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
    CookieDurationDescription
    cookielawinfo-checkbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
    cookielawinfo-checkbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
    cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
    cookielawinfo-checkbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
    cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
    viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
    Functional
    Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
    Performance
    Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
    Analytics
    Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
    Advertisement
    Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.
    Others
    Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.
    SAVE & ACCEPT