Assessing concerns about potential weaponization of medical AI
Artificial Intelligence could revolutionize the life sciences, but some argue it might also be weaponized (1400 words, 7 minutes)
NPC Healthbiz Weekly is presented to you with support from Impres, Canada’s Next Generation Commercial Partner
Artificial intelligence (AI) has transformed many industries and even revolutionized some aspects of everyday life. The medical field has experienced significant advancements through the integration of AI technology, which can now assist in diagnosing diseases, predicting patient outcomes, and even suggesting personalized treatment plans. Medical AI can also analyze large amounts of data and identify patterns that are sometimes difficult for humans to recognize.
However, as medical AI becomes increasingly sophisticated, experts are raising red flags about its potential misuse and weaponization. The World Health Organization, for one, is raising a warning about the risks of bias, misinformation, and privacy breaches during the implementation of large language models in healthcare.
One major concern over the use of AI in the medical field: privacy and data security. Medical AI relies on vast amounts of patient data to train and refine its algorithms. While efforts are being made to protect this data, the possibility of data breaches or unauthorized access remains a threat.
An article published in BMC Medical Ethics urged that regulations for AI should prioritize patient agency and consent. The authors say technological innovation and regulatory measures are necessary to ensure patient data remains private. Technology is advancing so rapidly that there is a risk of falling behind if regulatory efforts do not maintain pace, the authors say.
Another consideration: AI and machine learning models could be susceptible to bias. These algorithms have sometimes perpetuated long-standing health inequities. In a case cited by The Hastings Center for Bioethics, a widely-used algorithm for distributing health resources prioritized White patients over Black patients, reducing the number of Black patients identified for extra care by more than half.
Synthetic biology and escaped viruses are also significant concerns. With more artificial organisms being created, there are more chances for the accidental release of antibiotic-resistant viruses. Through engineered tolerance to high temperatures, salt, and alkaline conditions, escaped artificial organisms could overrun existing species or disturb ecosystems.
Experts note that steps are being taken to mitigate these risks. Regulatory bodies and organizations such as UNESCO and the World Health Organization are working to establish guidelines and frameworks for the ethical development and deployment of medical AI. Collaborations between computer scientists, medical professionals, and policymakers are fostering a multidisciplinary approach to addressing these complex issues. Moreover, increased transparency and accountability in the AI development process can help ensure the integrity and safety of these systems.
Sources:
https://bmcmedethics.biomedcentral.com/articles/10.1186/s12910-021-00687-3
https://www.who.int/news/item/16-05-2023-who-calls-for-safe-and-ethical-ai-for-health
https://www.axios.com/2023/05/22/medical-ai-weaponization-artificial-intelligence-healthcare
THIS WEEK 07/04/23
The U.S. FDA has approved Pfizer’s ritlecitinib (Litfulo) for treatment of severe alopecia areata in patients 12 years of age and older.
Endo International received approval from Health Canada for its cenobamate tablets (Xcopri) as adjunctive therapy in adults with epilepsy experiencing partial-onset seizures that are inadequately managed with conventional treatments.
Amylyx Pharmaceuticals Canada announced the company has entered a Product Listing Agreement with Ontario for the public reimbursement of its sodium phenylbutyrate and ursodoxicoltaurine (Albrioza) for the treatment of amyotrophic lateral sclerosis.
The U.S. FDA granted approval to UCB’s rozanolixizumab-noli (Rystiggo) for the treatment of generalized myasthenia gravis in adult patients who are anti-acetylcholine receptor or anti-muscle-specific tyrosine kinase antibody positive.
LISTEN UP
In season 10 of the NPC Podcast, Justin Bates, CEO of the Ontario Pharmacists Association, discusses starting his position just before Covid, shifting pharmacies to a service model, and alternative payment models to National Pharmacare. Hear him in conversation with podcast hosts Mitch Shannon, Jim Shea and Mark McElwain.
HEALTHBIZ REWIND
This feature of NPC Healthbiz Weekly looks back at some of the most insightful moments from previous NPC Podcast episodes. In Healthbiz Rewind, you’ll read bold life sci predictions made during the renowned “Prognostication Korner” segment of the NPC Podcast.
Danielle Portnik
Senior Director, Commercial
Emergent BioSolutions
Toronto
Season 9, episode 01
Listen to this episode here
Could you describe an area where genetic testing might be transforming the life sciences industry?
I have a very recent update that I think will change quite a bit in the next month or so. One of the major sequencing suppliers or manufacturers announced a new sequencer. For anyone familiar with Illumina, they’re sort of the major player in the market, and what this new sequencer means is that projects could go from costing $3 billion and taking 13 years to costing hundreds of dollars and taking a month or two. So, it is completely changing the way that we think about genetics.
There’s talk about completely getting rid of Sanger Sequencing, which was the original sequencing being used. When I think about some of the work we’re doing in terms of therapeutic development or patient identification or a lot of the ultra-rare conditions that we still have a challenging time diagnosing because of looking at specific genes versus looking at the entire genome, I think our diagnostic and therapeutic capabilities are going to expand exponentially. This will happen because not only are we going to be able to look at the entire genome, but we’re going to be able to do it at scale.
NEXT WEEK
It’s easy to get your no-charge subscription to NPC Healthbiz Weekly, and we’ll send each issue to your phone or inbox each Tuesday at 6:00 a.m. sharp.
You are receiving this newsletter because you are a client of Chronicle Companies, attended a National Pharmaceutical Congress live event or webinar, or previously requested a subscription to one of our newsletters. If you no longer wish to subscribe to this newsletter, please email the subject line “Unsubscribe NPC Healthbiz” to health@chronicle.org.
NPC Healthbiz Weekly is published by Chronicle Companies, 701 Ellicott Street, Buffalo, N.Y. 14203. Canadian Office: 1460 The Queensway, Suite 212, Etobicoke, Ont. M8Z 1S4
Mitchell Shannon, Publisher; R. Allan Ryan, Editorial Director; John Evans, Kylie Rebernik, Jeremy Visser, Editors; Cristela Tello Ruiz, New Business Development
Content is copyright (c) 2023, Chronicle LifeSci America Corp., except as indicated. Are you interested in contributing to this newsletter or learning about Chronicle’s services? Please write to us at health@chronicle.org.
Thanks for reading NPC Healthbiz Weekly. Be sure to subscribe to receive new posts directly to your inbox.