LiveVisionKit 1.3.0 Preview 1

This release is NOT stable and the project is no longer in development, please use LiveVisionKit 1.2.2 instead!

Install Guide: https://github.com/Crowsinc/LiveVisionKit/wiki/Install-Guide
Filter Wiki: https://github.com/Crowsinc/LiveVisionKit/wiki
Discord Support Server: https://discord.gg/8azsNh6rsX

Changes & Fixes

General

• Updated to OpenCV 4.8.0
• OpenCV is now compiled alongside LiveVisionKit and is no longer required as an external dependency.
• Added translations for Dutch, Russian, Ukranian, and Chinese Traditional. Thanks to Nunke1, goordoon, DrinkWater, and Tim885885 on Crowdin for contributing their translations.
• Cleaned up various filter user interfaces.
• Tweaked, upgraded, reworked, and optimized all internal systems.

Video Stabilizer

• Fixed an issue where the stabilizer caused a significant increase in CPU usage (the stabilizer is now a little slower as a result).
• Fixed an audio desync bug related to increasing the Smoothing Radius in small increments. The value is now chosen with a drop-down list of common values.
• Added adaptive filtering scheme to allow for less crop region contact and slightly lower stream delays.
• All warp and crop operations are now performed using a single AMD FSR 1.0 pass, leading to slightly higher output quality.
• Renamed Motion Model setting to Subsystem, with Homography as the default option.
• Added Vector Field (Experimental) subsystem. This subsystem is not finished yet, and is only supplied for the curious.
• Renamed Suppression Mode to Quality Assurance as a better representation of its use.
• Reworked the Quality Assurance systems to operate on single frames, allowing for the handling of video discontinuities.
• Fixed an issue where the stabilizer could sometimes ignore the crop region on video discontinuities.
• Added Independent X/Y Crop toggle, allowing for independent crop percentages across the width/X and height/Y directions of the frame.
• Added Auto-Apply Crop toggle to control whether the filter will apply cropping to the output or not.
• Added Background Color selector, allowing you to choose the background color around the warped frame when cropping is not auto-applied.
• Test Mode now shows timing uncertainty in brackets, and a blue grid representing the warp control points.
• Optimized the drawing of Test Mode tracking points.
• Removed all input frame pre-testing - the stabilizer will no longer attempt to restart when the queue is outdated (potential fix for #24)
• The internal OpenCL context will now always attempt to rebind to a new graphics thread (potential fix for #28)

Lens Correction

• Lens correction is now automatically applied the moment the Calibration Profile is chosen
• The correction warp now uses AMD's FSR 1.0 technology for a higher quality output.
• Added Test Mode option that draws a grid, allowing for visualization of the lens distortion.

Adaptive Deblocker

• Test Mode now shows timing uncertainty in brackets.

Development

• Added a CMake build system with automated build scripts.
• Split the project into a main LiveVisionKit library and OBS-Plugin sub-module.
• Started work on a Video Editor CLT sub-module that allows LiveVisionKit filters to be executed on video files without FPS restrictions.

LiveVisionKit 1.2.2

LiveVisionKit 1.2.2 updates OpenCV to version 4.7.0 and fixes a few small bugs.

Install Guide: https://github.com/Crowsinc/LiveVisionKit/wiki/Install-Guide
Filter Wiki: https://github.com/Crowsinc/LiveVisionKit/wiki
Issue/Bug Reporting: Please use the issues tab.
Discord Support Server: https://discord.gg/8azsNh6rsX
Contribute Translations: https://crowdin.com/project/livevisionkit

Changes & Fixes

• Updated to OpenCV 4.7.0
• Fixed crash when lowering stabilization filter smoothing radius while filter is disabled.
• Fixed unknown output size error in the FSR Video Scaling filter when OBS is changed to a different language.

LiveVisionKit 1.2.1

LiveVisionKit 1.2.1 is here! This update brings the Linux version into feature parity with the Windows release, along with initial support for language translations (Spanish and English only at the moment), and various fixes and improvements that aim to make the use of LiveVisionKit a bit more robust.

Please read the installation guide and the rest of the provided wiki to learn how to start using LiveVisionKit! Note that OBS-Studio 27.2.4 versions have been provided for backwards compatibility, named 'OBS27...' - these will be discontinued going forwards.

Issue/Bug Reporting: Please use the issues tab.
Discord Support Server: https://discord.gg/8azsNh6rsX
Contribute Translations: Crowdin

UPDATE-15//11/2022: Ubuntu 20.04 versions are now provided for those still on GLIBC 2.31

New Features

• Updated to support OBS-Studio 28.0.3.
• Updated the OpenCV library to version 4.6.0.
• Added language localization support for all filters.
• Added Spanish and English (UK) translations, with more to come in the future.
• Enabled OpenCL-OpenGL interoperability on Linux, allowing all filters to efficiently run as effect filters on systems which support the cl_khr_gl_sharing OpenCL extension (currently Nvidia only).
• Added a backup OpenCL-OpenGL compatibility layer for when the aforementioned interoperability functions are not supported, or fail to pass driver tests. This allows all filters to run as effect filters at the cost of worse performance.
• Filters which do not support HDR (introduced in OBS 28) will now automatically disable themselves when presented with HDR video, and must be manually re-enabled outside of HDR content.
• The Video Stabilization filter will now re-synchronize its internal queues they ever (somehow) become out of sync.
• The Video Stabilization filter no longer needs to completely restart when changing the smoothing radius.
• Video filters which introduce a stream delay will no longer crash if an expected frame goes missing and cannot be found.
• Added various new log messages.

Changes & Fixes

• Fixed the Video Stabilization filter's 'stream delay' value being one frame too long.
• Fixed an issue where the Video Stabilizer, running as a video filter, would sometimes fail to respect effect filters which resize the video.
• Reduced the chance of a crash when the Video Stabilizer is suddenly presented with a frame of a new size (while processing a '.webm' video).
• Increased the Video Stabilization filter's minimum smoothing radius from 2 to 4 for future maintainability reasons.
• Changed the default Video Stabilization suppression mode value to 'strict' in order to enforce better stabilization out of the box.
• Slightly optimized the Video Stabilizer's CPU usage when applying a crop.
• Removed any logic which could introduce potentially buggy behavior on different systems when presented with an unsigned integer underflow.
• Fixed various memory leaks and segfaults caused by improper termination of the OpenCL context on certain Linux distributions.
• Removed the use of AVX extensions for better CPU compatibility. This will be re-introduced in the future if the performance penalty increases.

LiveVisionKit 1.2.0

LiveVisionKit 1.2.0 has been released, bringing improvements to stabilization and DirectX11-OpenCL interop that allows all filters to be ran as effect filters on Windows. You can now run the stabilization filter on suitable VR games!

Read the install guide for installation procedures, and please consider reading the rest of the wiki to learn more about each filter.

Please use the issues tab to report any bugs or stability issues you come across. You may also make suggestions for new functionality to be added. LiveVisionKit exists to solve your problems, so I'm interested in learning about them!

Changes

Linux & Windows

• Added optional suppression functionality to the video stabilizer, allowing stabilization to automatically turn off when the video content is unsuitable.
• Added a dynamic motion model to the video stabilizer, which attempts to pick the best motion model on the fly.
• Added more sophisticated logging to help with issue diagnosis.
• Fixed lens correction crash when OBS is started with an invalid calibration profile.

Windows Only

• Added a Video Stabilizer effect filter. Please note that you will need to manually delay your audio when using this filter, check the wiki page for more information.
• Added an Adaptive De-Blocking effect filter.
• Added a Lens Correction effect filter.
• Added a Calibration Tool effect filter.

LiveVisionKit 1.1.1

LiveVisionKit 1.1.1 has been released, bringing updates to the FidelityFX filter names and fixing a few bugs.

As always I recommend reading the install guide and the rest of the wiki if this is your first time using LiveVisionKit.

Please use the issues tab to report any bugs/issues you come across. You may also make suggestions for new functionality to be added. LiveVisionKit exists to solve your problems, so I'm interested in learning about them!

Be aware that only a few hardware configurations have been tested at this point.

Changes

• Renamed the '(LVK) FidelityFX Super Resolution 1.0' filter to '(LVK) AMD FSR 1.0 Video Scaler' to represent the extensive scaling and cropping functionality that was added in LiveVisionKit 1.1.0.
• Renamed the '(LVK) FidelityFX Contrast Adaptive Sharpening' filter to '(LVK) AMD FidelityFX Sharpening' to keep the naming convention consistent and shorten the name.
• Fixed a crash that would sometimes occur when switching to a scene using the video stabilization filter.
• Fixed the 1 frame desync between source resolution and bounding box when changing the crop in the video scaler filter.
• Fixed the video scaler failing to properly initialize under specific circumstances, leading to no output.
• Slightly improved error detection capabilities.
• Reduced the size of the provided Windows zip.

LiveVisionKit 1.1.0

I recommend reading the install guide and the rest of the wiki before using LiveVisionKit.

Be aware that only a few hardware configurations have been tested at this point.
Feel free to request new features or voice issues you come across, but please make sure it isn't already covered by the wiki.

Changes

• Fixed issue #4 by adding extensive scaling and cropping functionality to the FidelityFx Super Resolution 1.0 filter. Check the updated wiki page to learn how to use it.

LiveVisionKit 1.0.1

I recommend reading the install guide and the rest of the wiki before using LiveVisionKit.

Be aware that only a few hardware configurations have been tested at this point.
Feel free to request new features or voice issues you come across, but please make sure it isn't already covered by the wiki.

Changes

• Fixed issue #1 by baking the FidelityFX Super Resolution 1.0 filter directly into the Video Stabilizer.
• Reduced the Video Stabilizer max smoothing radius from 30 to 20 to encourage the user to pick a more reasonable radius.
• Added version number to plugin description.

LiveVisionKit 1.0.0

The first public release of LiveVisionKit, things may be a little rough.

I strongly recommend reading through the wiki before using LiveVisionKit.

Be aware that only a few hardware configurations have been tested at this point.
Feel free to voice any issues and suggestions you come across, but please make sure it isn't already covered by the wiki.