AI is a crucial technology, and protecting individual rights, promoting transparency, and holding AI companies accountable are essential. However, discussions about AI policy have also focused on privacy. The EU AI Act is more important than the General Data Protection Regulation (GDPR), which has safeguarded the privacy of millions of people. The GDPR's upcoming evaluation may leave it vulnerable to certain interests. Sound data privacy regulations are necessary for AI regulation, as large language models dominate policy agendas and news headlines. In 2022, over 1,800 data breaches affected 422 million people worldwide. Major AI companies like Microsoft are cautious about how they use data to train AI. Strategic opportunities exist to put privacy principles at the forefront of AI regulatory frameworks. In the US, passing legislation like the American Data Privacy and Protection Act (ADPPA) would provide privacy guarantees for responsible AI.