Dynjandi Webcam Processing Tool

This tool processes webcam input to allow for effects, mainly background masking so far.

Features

• CLI to toggle features, show FPS and processing times
  • Method of background identification
  • Simple background masking by comparing the current image with a base image
  • Tensorflow based approach
  • Background replacement
    • Replace background with a green screen for further processing
    • Replace background with a blurred version of the background

How-To (Ubuntu)

• Install v4l2loopback-dkms.
• Activate virtual webcam sudo modprobe v4l2loopback video_nr=3 card_label="Dynjandi Output"
• Install dependencies, python3 venv, and requirements
• Get base image ./get_base.py (try to remove yourself from the image)
• Download trained model from here
• Run main script ./get_diff.py
• Profit! You can further process the image, e.g. with OBS Studio and make yourself float in space!

Possible future features

• Better masking
  • A machine learning approach seems to work better ([1] [2]), but I'm not touching NodeJS with a ten-foot pole
• Improve speed, I currently get about 15 FPS at 1280x720

Naming

Dynjandi is named after the Icelandic waterfall of the same name.

License

The MIT License, copyright (c) 2020 wasmitnetzen