At the end of 2022, OpenAI, the American AI laboratory, launched the AI chat program ChatGPT, which is the strongest AI in history, and can write papers or code at one time. Once launched, ChatGPT quickly became popular and attracted much attention, with more than 1 million users and 21 million monthly visits in one week. According to the statistics of Brett Winton, the chief futurist of ARK venture capital company, the daily activity of ChatGPT has exceeded ten million in less than two months. It took 355 days for Instagram, which also caused a sensation that year, to achieve this achievement. Since the launch of ChatGPT, its capabilities have been continuously unlocked by people, such as writing neural networks, answering interview questions, and making smart speakers. However, people slowly found that math ability is a major weakness of ChatGPT, and even the simple "chicken and rabbit in the same cage" problem can be miscalculated. With this in mind, ChatGPT recently announced an important update: improving authenticity and mathematical ability. I have to sigh, it's too "voluminous"! ChatGPT is a language model that is trained to model conversations. It can conduct dialogue by learning and understanding human language, interact according to the context of chat, chat and communicate like humans, and even complete tasks such as writing email, video script, copywriting, translation, code, etc. It is understood that ChatGPT uses a neural network architecture called Trans-former, which is a model for processing sequence data and can capture long-term dependencies in the input sequence. It also uses a large number of corpora to train the model, which contain dialogues in the real world, so that the model can better understand human language. The good use experience and business prospects of ChatGPT have also attracted wide attention of the capital. On January 12, at an event in the United States, Bill Gates, who served as the chairman of Microsoft, said that he did not think Web3 was so important or that the metauniverse itself was revolutionary, but AI was quite subversive. When asked what he thought of ChatGPT, he said: "This gives me a glimpse into the future. I am impressed by the method and innovation speed of the whole platform." On January 23, local time, Microsoft announced in its official blog that Microsoft will make a multi-year, multi-billion dollar investment in OpenAI to accelerate its technological breakthroughs in the field of artificial intelligence. It is reported that Microsoft invested in OpenAI in 2019 and 2021. In 2019, Microsoft invested $1 billion in it. It is understood that ChatGPT has significantly improved compared with the previous generation of products, and the dialogue mode has better interactive experience. First, from the technical point of view, GPT model is based on Transformer and obtains general text through pre-training. The key contents of the model include base model capability, real data and learning algorithm. GPT has evolved through multiple versions, and the number of pre-training