Title page
Contents
Key Takeaways 1
What is generative AI? 1
What is model architecture, and what types of model architectures are used in generative AI? 4
What factors enabled commercial development of generative AI systems? 5
What are some examples of commercially developed generative AI products? 6
How can generative AI be used in selected industries? 9
How GAO Did This Study 10
List of Addressees 11
GAO Contact Information 11
Table 1. Capabilities of Selected Commercially Developed Generative Artificial Intelligence Models, as of April 2024 8
Figure 1. Compute Required to Train Notable Machine Learning Systems Over Time 3
Figure 2. Simple Transformer Architecture 5
Figure 3. Prompt Answer Generation with versus without Retrieval-Augmented Generation 6
Figure 4. Process Flow for Multimodal Generative AI Models 7
Figure 5. Example of a Generative AI System Creating an Image from Prompts 7
Figure 6. Summary of Potential Applications for Generative Artificial Intelligence 9