This paper explores the regulatory awakening regarding generative AI (GenAI) in the United States and European Union (EU) institutions with the release of ChatGPT. Based on a thematic analysis of regulatory documents, it investigates how governments have approached the deployment and use of this emerging technology within their classic government activities. The analysis shows several layers of regulatory approaches, ranging from command-and-control to an experimental approach, combined with risk- and management-based approaches. It also reveals different perspectives. The EU institutions have notably adopted more restrictive guidelines on the use of publicly available Large Language Models (LLMs) - a type o GenAI that is trained on vast amounts of text data to understand, generate, and respond in human-like language. This approach reflects greater caution about data security and confidentiality and the risks of foreign interference. However, the American and EU documents share a common concern about the risk of reinforcing discrimination and the protection of human rights. Interestingly, considering the administrative environment, neither the administrative activities in which GenAI may be used nor the key legal principles embedded by the rule of law are explicitly used for guiding administration in their development and use of GenAI. In this context, the paper calls for future research that could help contribute to the renewal of administrative law theory in the context of the digital transformation of public administration.