Ever stood in an art gallery and thought to yourself “I’d rather be watching a movie”? Well the Brooklyn Film Festival has the answer. The independent film festival, now in its 27th year, has created an AI led campaign based around the thought of ‘Art is Better When it Movies’. This comes to life as an AI backed mobile experience that allows gallery-goers to skip the art and watch footage from award winning films instead.

Our interactive, AI backed mobile site allows users in galleries to photograph a piece of art, upload it, and through an AI algorithm, get a matching, award-winning movie from the Brooklyn Film Festival’s archive.

How does it work

The web application is powered by OpenAI ChatGPT models. We prepared a robust dataset that includes recommendation examples, and fine-tuned a GPT model and a specific campaign tone of voice, so it can be equipped with the knowledge of the awarded films. The model takes an image as an input, outputs a paragraph of its image interpretation and a recommendation of a film, as well as a link to watch the film.

Tech Stack

• Image Interpretation and Captioning: Open AI GPT-4-Vision
• Conversation and Recommendation: Open AI GPT3.5
• Front-end framework: React NEXT.js
• Libraries: Three.js, WebGL/GLSL, GSAP Green Socks
• Hosting Dev and Production: AWS
• Content Moderation: Azure

Role

Dev Lead, developer