Please login or create an account. If you do not have access to this content, you will be shown a 30 second preview and licensing options.

  • Presentation

Cautionary Side of AI in Dermatology: Education, Human-Computer Interaction, and Unintended Consequences

Description

The speaker discusses the cautionary side of AI in dermatology, emphasizing that while AI tools are rapidly proliferating, education, evidence, and real-world validation are lagging behind. She highlights the need for formal AI training in medical curricula so trainees learn safe, ethical, and effective use, including protecting patient privacy and understanding that AI should augment rather than replace learning. She warns about de-skilling in experienced clinicians and never-skilling in trainees who rely too heavily on AI, especially when tools lack dermatologist involvement, transparency, or clear validation across skin types and patient populations. To help clinicians evaluate tools, she describes the idea of dermatology-specific model cards that would summarize intended use, data sources, limitations, and bias concerns. The talk also covers human-computer interaction issues, noting that AI can distort clinical reasoning, that expert users can still be misled, and that clinicians often lack training in using LLMs in practice. She then reviews unintended consequences such as sycophancy, misinformation, deepfakes, security vulnerabilities, and unsafe chatbot behavior, including examples where systems were manipulated to provide dangerous or false medical advice. Finally, she notes environmental costs from AI’s energy and pollution footprint and concludes that AI in dermatology must be evaluated cautiously, with attention to safety, fairness, privacy, generalizability, and regulation.

View more

Conclusions

  • AI tools are rapidly increasing in dermatology, but clinician education on their safe, ethical, and effective use is still lagging behind.
  • Without proper training, AI may contribute to de-skilling in experienced clinicians and never-skilling in trainees who become overly dependent on it.
  • Dermatology AI tools should be evaluated cautiously using transparent information about training data, intended use, validation, limitations, bias, and skin-tone representation.
  • Current evidence suggests many AI tools, especially app-based ones, lack adequate supporting data and dermatologist involvement.
  • Image quality issues such as blur, brightness changes, and surgical ink markers can meaningfully reduce AI performance.
  • Dermatologic AI systems often perform worse on darker skin tones, raising major fairness and generalizability concerns.
  • Human-AI interaction can be unreliable because faulty AI can mislead experts and even accurate AI may perform better alone than when combined with physicians in some settings.
  • Generative AI can be sycophantic and may reinforce incorrect user beliefs, increasing the risk of misinformation.
  • Deepfakes, fake publications, and AI-generated medical fraud create serious risks for patients, clinicians, and public trust.
  • Medical chatbots and AI health products can be hacked or manipulated to produce dangerous advice, false medical claims, or unsafe prescribing guidance.
  • The environmental cost of generative AI is substantial and should be considered part of the technology’s harms.
  • Overall, AI in dermatology may be useful, but its adoption must be guided by strong standards for safety, privacy, fairness, transparency, and regulation.
  • Berzin & Topol, Lancet, 2025
  • Gao & Zhang H. Proceedings of the 33rd ACM International Conference on Multimedia. 2025.#10.1145/3746027
  • Ethical considerations regarding environmental impact of generative artificial intelligence in dermatology. Journal of the American Academy of Dermatology. Available online 3 March 2026; In Press, Corrected Proof.#10.1016/j.jaad.2026.02.098
  • McLellan, Lancet, 2026
  • Endoscopist deskilling risk after exposure to artificial intelligence in colonoscopy: a multicentre, observational study.#10.1016/s2468-1253(25)00290-0
  • Human-computer collaboration for skin cancer recognition. Nature Medicine.
  • Large Language Model Influence on Diagnostic Reasoning: A Randomized Clinical Trial. JAMA Network Open.#10.1001/jamanetworkopen.2024.40969
  • Disparities in dermatology AI performance on a diverse, curated clinical image set. Science Advances.#10.1126/sciadv.abq6147
  • AI and Digital Tools in Dermatology: Addressing Access and Misinformation. JMIR Dermatology.#10.2196/79044