ShopTheLook is an AI-powered fashion assistant that transforms your mood, vibe, or occasion into stylish outfit imagesβand helps you shop the look instantly. Powered by Google's Gemini multimodal API, Stable Diffusion, and real-time product search via SerpAPI, this project delivers a seamless "mood-to-outfit-to-shopping-cart" experience.
- π― Prompt Refinement: Gemini refines vague user input (e.g., "cosmic streetwear") into detailed prompts for image generation.
- π¨ Outfit Generation: Uses Stable Diffusion to generate high-quality, on-theme fashion visuals.
- ποΈ Multimodal Image Analysis: Gemini vision analyzes images and produces SEO-friendly shopping phrases.
- ποΈ Real-Time Shopping Integration: Uses SerpAPI to fetch Google Shopping results for analyzed outfits.
- π§ Vector Caching: Pinecone stores prompt-image-search triplets for faster repeat queries.
- βοΈ Cloud-Based Storage: Google Cloud Storage hosts generated images and makes them instantly shareable.
- Gemini API (Text + Vision) β Prompt refinement and image description
- Stable Diffusion (HuggingFace) β Fashion image generation
- SerpAPI β Real-time product search
- OpenAI Embeddings + Pinecone β Smart caching for performance
- Google Cloud Storage β Hosting generated images
- LangChain β Workflow orchestration
- Python, Google Colab β Development environment
- User enters a mood, occasion, or style prompt.
- Gemini refines the input into a more detailed fashion concept.
- Stable Diffusion generates outfit images based on the refined prompt.
- Gemini vision analyzes images to generate search-optimized fashion phrases.
- SerpAPI fetches real-world shopping results based on those phrases.
- The output includes generated images and links to purchase similar styles.
Input Prompt: "Saturn vibes"
Gender: Male
Age: 24
Generated Images:
- Hosted on Google Cloud Storage
Gemini Analysis:
"lace midi fit and flare wedding dress""lace midi dress puff sleeves"
Shopping Results:
Project is currently built in Google Colab with access to external APIs.
- Clone or open the notebook in Google Colab.
- Install the required libraries:
pip install pillow torch diffusers google-cloud-storage langchain \
pinecone-client google-generativeai serpapi tiktoken