Video/screenshot action to grab pixel color

[UnderscoreSkyy]

I recently started to use SceneSwitcher to "remote" control my OBS by making some pixels of my source take an exact color and using the video check on those specific pixels.
A simple example would be :

• Macro 1 : Record
  • Condition : if pixel X:2490 Y:1390 have color #00ff00
  • Action : then start obs recording
• Macro 2 : Stop Record
  • Condition : if pixel X:2490 Y:1390 have color #ff0000
  • Action : then stop obs recording

For those simple example it's not that much taxing on my PC, but I now track a total of ~40 colors on 3 different pixels to control some variables value so I have 40 macros that use the video conditions and sometime on more intensive moment SceneSwitcher encounter a crash because my GPU is OOM with the content + 40 sequential pixel checking + video encoding.

In my use case if we had a video action similar to the video condition source matches color that would allow us to write the color of the pixel in a variable (or file or anything)
It would at least allow me to have only have 3 watcher running at all time and control the rest only with variable condition and OpenCV could may not even be needed to get the value of the pixel

I'm not to much versed yet into the SceneSwitcher ecosystem yet but I'll start looking into the custom script to create a POC at least for myself but I think It could also be a good addition in general.

Regards

[WarmUpTill]

Thanks for the suggestion!
I will try to look into it when I find the time to.

Just out of curiosity, why did you chose to remote control OBS using a video source and not e.g. OSB websocket messages or a file?

[UnderscoreSkyy]

My pleasure, will try to have a look too!

I successfully made a first python script with PIL and register it as action but it take pixel from all my screens not the source so went a bit into the code and I'm thinking of adding another choice from screenshot as it would be the easiest angle as of right now (maybe not the more performant one no idea on it) and will submit a PR if I arrive to something correct.

The main use at the moment is linked to World of Warcraft, The good side of it is that with Addons I'm capable of displaying pretty much everything I need but the counter part is that with the accessible framework no data can get out of the game from the user side, only blizzard vetted function are able to write to disk and or communicate to a remote service

So to avoid to forget to launch a record / Put a stream marker or update my file naming in the heat of the moment I went with the screen reading route