
Google Try on you
Key Points
- 1Nano Banana, powered by Gemini, is a Google Shopping feature that enables users to create a digital avatar from their photo to virtually try on clothing items.
- 2The service offers a wide range of apparel categories, including dresses, winter wear, and footwear, allowing users to visualize how different styles and sizes appear on them.
- 3This generative AI tool is presented as experimental, noting potential for inaccuracies in fit and appearance, and operates under Google's prohibited use and privacy policies.
The paper introduces Nano Banana, a novel generative AI-powered virtual try-on service developed by Google, leveraging their Gemini image model. The primary objective of Nano Banana is to enhance the online shopping experience by enabling users to visualize how various clothing items would appear on their personalized digital avatar, addressing the common challenge of fit and aesthetics in e-commerce.
The core methodology of Nano Banana centers around advanced generative AI techniques for personalized avatar creation and garment rendering. Upon a user uploading a self-photograph, the system employs the Gemini image model to transform the input image into a digital avatar. This process likely involves:
- User Avatar Generation: This step takes the user's uploaded photo and generates a personalized digital representation. It is inferred that this involves sophisticated image analysis, potentially including human body pose estimation, segmentation, and feature extraction to create a realistic and adaptable avatar. The system allows users to select a body size (XS to 4XL+) for their avatar, suggesting either adaptive scaling of the generated avatar or the selection from a range of pre-trained body morphs that can be customized with the user's unique facial features and body contours.
- Virtual Garment Superimposition and Draping: Once the avatar is generated, users can browse and select various clothing items from integrated shopping catalogs (e.g., Google Shopping). The Gemini image model then performs a virtual try-on operation, which involves intelligently superimposing the selected garment onto the user's avatar. This is a complex task requiring models capable of:
- Garment-to-Avatar Mapping: Accurately mapping the 2D or 3D representation of the garment onto the 3D structure or 2D pose of the avatar.
- Realistic Draping and Wrinkle Generation: Simulating how the fabric would naturally drape and crease on the avatar's body, considering factors like material properties, gravity, and body posture. This likely involves conditional image generation, where the model generates an image of the avatar wearing the garment, maintaining the avatar's identity while seamlessly integrating the clothing.
- Contextual Integration: Ensuring the rendered garment integrates naturally with the avatar's existing features, skin tone, and background, accounting for lighting and shadows.
The service provides a wide array of clothing categories, including womenswear, menswear, specific styles like "Puff Sleeve Dress" or "Wool V-Neck," and footwear. Users can tap on any listed item to instantly see it on their digital self.
The paper acknowledges that the generative AI technology is experimental and may produce imperfections, stating that "Generative AI can make mistakes" and "Fit and appearance won't be exact." It emphasizes user privacy and adherence to Google's Generative AI prohibited use policy, strictly requiring users to upload only their own photos. This tool is integrated directly within the Google Shopping ecosystem, aiming to provide a dynamic and personalized pre-purchase visualization experience.