The finding about the Windows activation keys is particularly embarrassing for Microsoft, which has poured billions into ChatGPT's maker OpenAI and is its largest financial backer.

A Reddit user tricked ChatGPT into generating fake Windows 7 activation keys by fabricating a weird bedtime story about his late grandmother.

Microsoft will stop old Windows product keys from activating new Windows installs Windows 7 and 8 keys still seem to work for now, but that may be ending.