Modern GenAI vision models can describe scenes and identify objects impressively well, but their classifications can still shift depending on how they are prompted. This talk explores a GenAI system’s ability to detect smoking imagery in a visually busy ’80s sci-fi video by breaking the video into 1-second frames and evaluating two prompts: one that encourages detection and one that emphasizes neutrality. Multiple runs of each prompt are compared to examine changes in precision, recall, accuracy, and overall consistency. The session offers a practical look at how prompt phrasing and model variability affect real-world use cases, and what to keep in mind when using GenAI tools for content analysis.

Love Data Week
UC Love Data Week is a week-long offering of presentations and workshops focused on data access, management, security, sharing, and preservation. Whether you're working on qualitative or quantitative data, we've got events for you! All members of the University of California community are welcome to attend!

For more information and registration links to Love Data Week workshops and presentations please check the LDW 2026 site at: https://uc-love-data-week.github.io

Accessibility statement
UCSF welcomes all participants to our events. If you need a reasonable accommodation to participate in this event because of a disability, please contact Geoffrey Boushey at geoffrey.boushey@ucsf.edu as soon as possible.