Over the last decade, Artificial Intelligence (AI) has become increasingly popular, especially with the use of chatbots such as ChatGPT, Gemini, and DALL-E. With this rise, large language models (LLMs) and Generative AI (GenAI) have also become more prevalent in everyday use. These advancements strengthen cybersecurity's defensive posture and open up new attack avenues for adversaries as well. This paper provides a comprehensive overview of the current state-of-the-art deployments of GenAI, covering assaults, jailbreaking, and applications of prompt injection and reverse psychology. This paper also provides the various applications of GenAI in cybercrimes, such as automated hacking, phishing emails, social engineering, reverse cryptography, creating attack payloads, and creating malware. GenAI can significantly improve the automation of defensive cyber security processes through strategies such as dataset construction, safe code development, threat intelligence, defensive measures, reporting, and cyberattack detection. In this study, we suggest that future research should focus on developing robust ethical norms and innovative defense mechanisms to address the current issues that GenAI creates and to also further encourage an impartial approach to its future application in cybersecurity. Moreover, we underscore the importance of interdisciplinary approaches further to bridge the gap between scientific developments and ethical considerations.

翻译：过去十年，人工智能（AI）日益普及，尤其是ChatGPT、Gemini和DALL-E等聊天机器人的应用。随着这一趋势，大型语言模型（LLMs）和生成式人工智能（GenAI）在日常使用中也变得更加普遍。这些进展在增强网络安全防御能力的同时，也为攻击者开辟了新的攻击途径。本文全面概述了GenAI的最新部署现状，涵盖攻击、越狱、提示注入和逆向心理学的应用。本文还阐述了GenAI在网络犯罪中的多种应用，例如自动化黑客攻击、钓鱼邮件、社会工程、逆向密码学、生成攻击载荷以及创建恶意软件。GenAI可通过数据集构建、安全代码开发、威胁情报、防御措施、报告和网络攻击检测等策略，显著提升网络安全防御流程的自动化水平。在本研究中，我们建议未来研究应侧重于制定稳健的伦理规范和创新的防御机制，以应对GenAI当前引发的问题，并进一步推动其在网络安全应用中采取公正的立场。此外，我们强调跨学科方法的重要性，以弥合科学进展与伦理考量之间的鸿沟。