AI researcher Jacob Coxon resigned from Anthropic, warning that AI companies like OpenAI and Anthropic are irresponsibly accelerating towards self-improving superintelligence. He expressed that many within these companies privately fear AI could lead to existential risks by the end of the decade. Coxon's resignation post gained significant traction, highlighting internal concerns about the rapid pace of AI development. This sentiment is echoed by other AI staffers who admit these existential fears keep them awake at night. The urgent discussions about AI safety and pace are becoming common within the Silicon Valley AI community. Some researchers believe there's a substantial chance AI could cause widespread harm or even end humanity. Coxon specifically criticized Anthropic for initiating the race to self-improving AI, driven by a belief in its inevitability. He suggested that a delay in development could reduce AI risks to zero, but this requires drastic action from industry leaders. Coxon proposes shifting focus from raw economic value to applications that benefit humanity, like in healthcare. He also notes the looming threat of mass unemployment as a precursor to potentially deadlier superintelligence. Coxon encourages transparency and advocacy from those who feel disempowered by the rapid progress in AI development.