Google I/O 2024, an annual developer conference was held on Tuesday and Sundar Pichai, CEO of Google, made several announcements on Gemini AI.
Google integrates Gemini AI functionality into various applications, spanning Google Maps, Chrome, Google Workspace, Gmail, and more. They upgraded the Gemini and brought a new Gemini era.
Introducing Ask Photos
This new feature enables any consumer to search for photos and makes the process a lot easier with the integration of AI. Gemini can go beyond a simple search and recognize different contexts. This enables the search functionalities to retrieve specific memories and information quickly and easily with the Gemini.
“Say you’re paying at the parking station, but you can’t recall your license plate number. Before, you could search Photos for keywords and then scroll through years’ worth of photos, looking for license plates. Now, you can simply ask Photos. It knows the cars that appear often, it triangulates which one is yours, and tells you the license plate number.”
Gemini 1.5 Pro
Google has brought a more sophisticated model for the premium members available in 25 languages. So, for the advanced members, Gemini 1.5 Pro is the sophisticated language model with the widest context window of any consumer chatbot in existence. The context window has now been expanded to 2 million tokens from 1 million.
It can now quickly summarize 100 emails or parse several lengthy documents up to 1,500 pages in total, into a few seconds. You will soon be able to oversee code bases with over 30,000 lines or an hour’s worth of video footage.
“The recording of the meeting is an hour long. If it’s from Google Meet, you can ask Gemini to give you the highlights.”
Gemini Nano
Sundar Pichai, Google’s CEO announced Gemini Nano on the Google I/O event. It is a lightweight version of Gemini Ai which user can also use in their browsers. It is specially designed to be used in the web browser as an extension. Instant chatbots embedded in websites, real-time content summarization, and personalized search experiences – all happening directly in your browser with the Gemini Nano.
Google’s Project Astra
This is a new model covering images, music and video. You can ask questions based on the combination of images, music and video searched and interact with the AI. It’s like a replacement for OpenAI’s GPT-4o and Microsoft’s Copilot.
Imagen 3, Music AI Sandbox & Veo AI generated video
Imagen 3 is a new addition where text can be entered as input and the AI returns an image for the search, like OpenAI’s Dalle-E. Music AI Sandbox is being made with integration with YouTube. It is a suite of professional Music tools to transfer styles between music. Veo is a video editing AI where prompts can be used to get the desired camera angle, cut and shots. It can generate longer scenes and Google is working on making it better.
Gmail Mobile features
The new update in the Gmail mobile feature is a new summarize feature, where instead of reading the entire thread, a small summary can be read. Specific Questions can also be asked to extract information from the entire database. It will do all the hard work of extracting information and doing all your work.
Gemini Live
A new feature that will help you whenever you go live. It will act like an assistant and analyse your surroundings in your life, giving you gems (personal experts to respond to your surroundings in real-time on any matter). You can determine your situation and the AI will give you real-time responses.
“This progress is only possible because of our incredible developer community. You are making it real, through the experiences and applications you build every day. So, to everyone here in Shoreline and the millions more watching around the world, here’s to the possibilities ahead and creating them together.”