Improving Quality of Recommend... Note

Improving Quality of Recommended Content through Pinner Surveys

In 2023, Pinterest committed to the Inspired Internet Pledge, focusing on user wellbeing and a safer online experience. Pinterest is using Pinner surveys to understand user perception of content quality and improve platform content. These surveys directly ask users to rate images, providing valuable feedback for improving recommendations. The goal is to promote high-quality content that inspires users and drives long-term engagement. Pinterest avoids promoting low-quality "clickbait" by training recommendation systems with survey data. A machine-learning model was developed to predict visual quality based on Pinner ratings, using image embeddings and a pairwise ranking approach. The model was trained on a dataset of 5,000 Pins, with multiple ratings per image to reduce noise. Offline evaluations demonstrated the model's ability to distinguish between higher and lower quality content. This model helped Pinterest de-bias the system, ensuring that rewarded engagement comes from high-quality content, aligning with their "Pinners First" value. The model has been successfully implemented across Pinterest's major surfaces, including Homefeed, Related Pins, and Search.