Introduction
Kinney Drugs, a well-known pharmacy chain, recently decided to pull back its AI-based phone assistant, Burt, after being flooded with complaints from dissatisfied customers. Launched in May 2026, Burt was intended to revolutionize how customers interact with their prescriptions. However, issues quickly surfaced, highlighting the challenges companies face when integrating AI into sensitive services like healthcare.
Challenges of AI in Healthcare
AI offers incredible opportunities in the healthcare sector, particularly in optimizing prescription management and personalizing patient experiences. However, as the Kinney Drugs case shows, there are also significant challenges. Customers reported incoherent calls, wrong dosages, and missed prescription notifications. These errors can have serious consequences in the medical field, where precision is paramount.
Privacy and Security Concerns
Another major issue raised by customers was data privacy. Although John Marraffa, President of Kinney Drugs, assured that Burt is HIPAA compliant, concerns persist. Managing sensitive data with AI can be perceived as risky, especially if the tool is not open-source, making independent security evaluations difficult.
Returning to Traditional Models
Faced with these challenges, Kinney Drugs chose to revert to a classic touch-tone phone system for incoming patient calls. This decision underscores a crucial point: adopting new technologies must be balanced by flawless user experience. Kinney will, however, continue to use Burt for outbound communications, like prescription refill texts, but only for patients who explicitly opt in to receive these notifications.
Conclusion: Lessons Learned
The Kinney Drugs experience highlights the importance of rigorously testing new technologies before deploying them on a large scale. Companies must not only ensure data security and privacy but also provide a seamless user experience. Decision-makers in the tech sector must be cautious when integrating AI into customer services, especially in critical sectors like healthcare.
Let's discuss your project in 15 minutes.