This study explores the feasibility and safety of using the AI system AMIE for pre-visit information gathering in primary care. AMIE, an AI-powered system, conducted patient interviews via text before appointments, with physician oversight. The study involved 100 patients, assessing safety, clinical reasoning, and user experience. Zero safety stops were required during AMIE's interactions, indicating conversational safety. AMIE's diagnostic accuracy was high, matching final diagnoses in most cases. Patient trust in AI increased after interacting with AMIE, and clinicians found the pre-visit summaries helpful. Clinicians and patients reported positive experiences after using AMIE, reporting higher satisfaction. AMIE's differential diagnoses ranked on par with doctors. While the study showed promising results, the text-only interface and lack of control groups are limitations. Future research could investigate multimodal interactions and efficacy compared to standard workflows.