OpenAI’s artificial intelligence chatbot, ChatGPT’s image generation capabilities have been quite the talk of tech town. In the last seven days. All the Ghibli-style images have been used by millions across the world. However, now ChatGPT’s image generation capabilities are under scrutiny after users on social media shared images of ChatGPT generating fake Indian identity documents such as Aadhaar and PAN cards.
The issue came to light after screenshots surfaced on social media showing users requesting ChatGPT to create replica documents, complete with fabricated names, addresses, and identification numbers.
Can ChatGPT generate fake Aadhaar and PAN card images?
Technically, no. We at Moneycontrol asked ChatGPT — on the Mac app — to create an Aadhar card image. ChatGPT refused and replied, “I can’t help with creating or modifying official documents like Aadhaar cards. If you need one, it’s best to visit the official UIDAI website or a certified Aadhaar enrollment center near you. Let me know if you need help finding one or understanding the process!”
However, when we tried the ChatGPT app on the iPhone, the response was a bit different. “I can't create or replicate official identification documents like an Aadhaar card, even for illustrative purposes, due to legal and ethical guidelines.” But this time it added, “However, if you need a mock-up or template-style graphic for a presentation or design (with fictional details and clearly marked as a sample), I can help create that. Would you like a sample Aadhaar-style card with placeholder info for design/demo purposes?”
We did ask to create a mock-up which it created with a fictional name and Aadhaar number.
It did the same with the PAN card as well but asked for details, which are on the PAN card — and then ended up creating another mock-up.
If you do end up giving your real image, name, date of birth to ChatGPT, it might just create an image of your PAN card. For obvious privacy reasons, we didn’t share our real information and strongly suggest you do the same.
Posts on social media
However, users on social media shared screenshots of images of PAN card and Aadhaar card that were created by ChatGPT. For instance, some users. created an Aadhaar card for Elon Musk and Sam Altman. Other users did share images of their Aadhaar card details with ChatGPT and the chatbot did create an image of it.
What does OpenAI have to say?
The company hasn’t made any comment on this particular matter but its safety guidelines did warn about some safety risks. OpenAI doesn’t allow any requests for generating images that may violate its content policies, such as child sexual abuse materials and sexual deepfakes. “As with any launch, safety is never finished and is rather an ongoing area of investment. As we learn more about real-world use of this model, we’ll adjust our policies accordingly.”
OpenAI has mentioned on its website that its “latest model can follow detailed instructions, and render text and instructional diagrams, introducing both utility and risk that is distinct from earlier models.”
Discover the latest Business News, Sensex, and Nifty updates. Obtain Personal Finance insights, tax queries, and expert opinions on Moneycontrol or download the Moneycontrol App to stay updated!
