Dear Editor, we would like to share ideas on the publication “From ChatGPT to Treatment: the Future of AI and Large Language Models in Surgical Oncology [1]”. The potential of Large Language Models (LLMs) like GPT-4 in surgical oncology is highlighted in this paper, with an emphasis on their ability to provide real-time support throughout the cancer journey when integrated into a Generalist Medical AI (GMAI) framework. The paper recognizes the transformative opportunities provided by LLMs, but emphasizes the importance of addressing ethical, privacy, and efficacy concerns, such as data drift and potential biases. Collaboration among healthcare providers, AI developers, and regulatory bodies is critical to ensuring the safe and effective use of LLMs in surgical oncology. Further advancements in LLMs to improve their understanding and generation skills specific to surgical oncology, as well as addressing ethical and privacy concerns through robust regulatory frameworks and guidelines, could be the future direction.