AI Content Filter for Photos

[ajbott]

Purpose

The feature aims to automatically filter out unwanted vulgar content from photos received in the app, enhancing user comfort and safety.

Description

This opt-in feature will leverage open-source AI models to assess received images for potentially vulgar content directly on the user's device. If such content is detected, the image will be blurred or blocked, with the user having the option to view it.

Functionality

• Opt-In Activation: Users can enable the feature in their privacy settings.
• On-Device Processing: Utilizes the user's device processing power to analyze images, ensuring privacy and reducing server load.
• Open-Source AI Models: Leverage and contribute to the advancement of open-source content filtering models.

Privacy and Load Management

• User Privacy: By processing images on the device, user data remains private and is not uploaded to servers.
• Server Cost Reduction: Distributes the computational load across user devices, optimizing server resource utilization.

User Interface

• A toggle switch in the privacy settings to activate the AI filter.
• Notifications for filtered content with the choice to view after acknowledgment of potential vulgar content.

User Empowerment

• Users retain control over what they see without unexpected exposure to inappropriate content.
• The feature supports a safer user experience while being mindful of privacy and server efficiency.