Google Unveils Gemini 1.5 Pro With 1 Million Token Context Window

Google announced Gemini 1.5 Pro on February 15, 2024, a new generation of its flagship AI model that boasts a groundbreaking 1 million token context window. This expanded capacity allows the model to process and analyze significantly larger amounts of information in a single input, a substantial leap from the 128,000 tokens available in Gemini 1.0 Pro. The company stated that this enhancement enables Gemini 1.5 Pro to understand and reason over extensive documents, hours of video, or lengthy codebases.

During a demonstration, Google showcased Gemini 1.5 Pro's ability to analyze a 402-page document and a 44-minute YouTube video, identifying specific details and answering complex questions about their content. The model successfully recalled information from the beginning of the video and pinpointed specific sections within the document. This capability is attributed to a new Mixture-of-Experts (MoE) architecture, which Google claims makes the model more efficient and performant, particularly for long context tasks.

While the 1 million token context window is currently in preview for developers and enterprise customers, Google indicated that a smaller 128,000 token version will be available more broadly. The company also highlighted that Gemini 1.5 Pro maintains the strong performance and multimodal capabilities of its predecessor, capable of processing text, images, audio, and video. The development signifies a major advancement in AI's ability to handle and interpret complex, lengthy data inputs, potentially transforming fields like research, content analysis, and software development.