📌 MAROKO133 Eksklusif ai: Researchers Invented a Fake Disease to Trick AI and the
In 2024, a team led by University of Gothenburg medical researcher Almira Osmanovic Thunström invented a fake disease that called “bixonimania.” The fictional skin condition, they said, was caused by staring at screens for too long and rubbing one’s eyes too much.
As Nature reports, the team uploaded two fake studies (both since been taken down) about the condition to a preprint server at the time in an effort to trick large language models into thinking it was real.
It didn’t take long for their ruse to take off. Within just weeks of uploading the fake studies, frontier AI models including Google’s Gemini and OpenAI’s ChatGPT started talking about bixonimania as if it were real. Not much later, researchers found that the fake papers had even started to be cited in other peer-reviewed academic literature.
The experiment highlights how profoundly AI is changing the face of human knowledge. AI slop has invaded almost every facet of the peer-review process. Researchers have previously found that a vast portion of scientific papers being indexed by journals each year could be heavily relying on AI, raising thorny questions over their validity, not to mention the erosion of rigor and trust.
Meanwhile, AI chatbots continue to dole out dangerous health advice to often unsuspecting users. A quick perusal of Osmanovic Thunström’s papers by virtually anybody, scientist or not, would’ve immediately clocked the ruse. The fake papers make peculiar references to “Star Trek,” “The Simpsons,” and “The Lord of the Rings” to raise obvious red flags.
But despite all that, AI chatbots including Microsoft’s Bing Copilot, Google’s Gemini, and Perplexity’s AI search engine became convinced that “bixonimania” was real.
While ChatGPT had a momentary lapse of reason, informing Nature last month that the condition “is probably a made-up, fringe, or pseudoscientific label,” it changed its mind when asked just a few days later, saying the disease was real.
In a statement to the magazine, an OpenAI spokesperson argued that the tech had gotten “better at providing safe, accurate medical information.”
Now that the cat is out of the bag, it’s up to journals to clean up any errant peer-reviewed papers that lean on Osmanovic Thunström’s fictional research. After Nature reached out to one them over several papers that alluded to “bixonimania,” the journal promptly posted a retraction notice, admitting the “presence of three irrelevant references, including one reference to a fictitious disease.”
“It is worrying when these major claims are just passing through the literature unchallenged, or passing through peer review unchallenged,” Osmanovic Thunström told Nature. “I think there’s probably a lot of other issues that haven’t been uncovered.”
Users on the r/medicine subreddit had a far more pessimistic take.
“We are cooked,” one of them wrote.
More on AI and healthcare: AI Is Causing Healthcare Costs to Surge
The post Researchers Invented a Fake Disease to Trick AI and the Funniest Possible Thing Happened appeared first on Futurism.
🔗 Sumber: futurism.com
📌 MAROKO133 Update ai: Doctors awarded science ‘Oscar’ for curing inherited blindn
It began with a phone call from a lab technician: “They can see!”
The dogs, blind since birth and once stumbling through obstacle courses, suddenly twirled and moved around easily with their newly restored eyes. That call, decades ago, was the first sign that a bold idea two physician-scientists had imagined in medical school could actually work.
Jean Bennett, Albert Maguire, and Katherine High received the Breakthrough Prize in Life Sciences, often called science’s version of the Academy Awards.
They were honored for their idea and the 40 years of work it took to create Luxturna, the world’s first FDA-approved gene therapy for an inherited disease.
Three scientists, one vision
Bennett, 71, and Maguire, 66, are married emeritus professors of ophthalmology at the University of Pennsylvania’s Perelman School of Medicine. They met as students at Harvard Medical School, where they were paired together to dissect a brain.
High, 74, is a former emeritus professor of pediatrics at the Children’s Hospital of Philadelphia (CHOP) and is now CEO of RhyGaze, a gene therapy company.
While Bennett and Maguire were developing their therapy, High was working on a similar path at CHOP, focusing on gene therapy for hemophilia, a life-threatening bleeding disorder. She showed long-term disease reversal in dogs and moved into early human trials.
The disease they set out to beat
Leber Congenital Amaurosis, or LCA, is a rare inherited retinal disease caused by mutations in the RPE65 gene, which produces a protein critical to the visual cycle — the biological process by which the retina responds to light.
Children born with faulty copies of this gene can typically detect only very bright light at birth. Most progress to complete blindness by early adulthood, often before their 20s, and sometimes as early as kindergarten.
When Bennett and Maguire started their work in the early 1990s, only a few retinal disease genes had been identified. The technology to treat them was not available yet.
They spent about ten years developing the basic tools, learning how to deliver a corrected gene into retinal cells using a modified virus as the carrier, and how to measure the results.
Their first test subjects were blind dogs housed at the University of Pennsylvania School of Veterinary Medicine, whose condition was very similar to human LCA.
They injected the experimental therapy into one eye of each of three dogs. The call from the lab technician came soon after. Two of those dogs, Venus and Mercury, later became the couple’s pets.
What the trials showed
The results from 37 eligible clinical trial participants were remarkable. Seventy-two percent reported the greatest possible improvement on a standard test of low-light vision, which simulates night conditions. Many also gained both peripheral and central vision.
One patient who had previously been able to detect only changes in light became capable of walking unaided through Philadelphia at night and could make out the clock on City Hall. Another saw a star for the first time in her life, six days after the procedure.
In 2017, the therapy, then developed by Spark Therapeutics, a company spun out from CHOP, was approved by the U.S. Food and Drug Administration under the name Luxturna. It was the first time the FDA approved a gene therapy for any inherited disease.
A foundation for the entire field
The impact of this work goes far beyond LCA. According to Penn Medicine, the therapy has paved the way for more than 140 gene therapy trials for retinal conditions, including macular degeneration and diabetic retinopathy. These diseases together affect about 30 million people in the U.S. Another 80 trials are now underway. A separate treatment based on High’s hemophilia research received its own FDA approval in 2024.
For Bennett, Maguire, and High, this recognition marks the end of what they called a difficult journey through a field that sometimes seemed to be falling apart around them.
🔗 Sumber: interestingengineering.com
🤖 Catatan MAROKO133
Artikel ini adalah rangkuman otomatis dari beberapa sumber terpercaya. Kami pilih topik yang sedang tren agar kamu selalu update tanpa ketinggalan.
✅ Update berikutnya dalam 30 menit — tema random menanti!