Skip to content

supervisely-ecosystem/data-nodes

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

ML Pipelines

Overview • How To Run

GitHub release (latest SemVer) views runs

Overview

This application is a versatile tool designed for data transformation tasks (like filtering and augmentation). It allows you to create and manage Data transformation workflows by leveraging graphical nodes with settings.

Available Layers

Layers Description Images Videos
Input
Images Project Select a project with images to process. + -
Videos Project Select a project with videos to process. - +
Input Labeling Job Select a labeling job to process. + -
Filtered Project Predefined project with filtered images. + -
Pixel Level Transformations
Anonymize Anonymize objects on data. + -
Blur Blur data. + -
Contrast Brightness Change contrast and brightness of data. + -
Noise Add noise to data. + -
Random Color Change colors of data. + -
Spatial Level Transformations
Crop Crop data. + -
Flip Flip data vertically or horizontally. + -
Instance Crop Crop instances in data. + -
Multiply Multiply objects. + -
Resize Resize data. + -
Rotate Rotate data. + -
Sliding Window Apply sliding window to data. + -
ImgAug Augmentations
ImgAug Studio ImgAug Studio is a wrapper around great ImgAug Library. + -
ImgAug.ImgCorruptlike.Noise ImgAug imgcorruptlike Noise augmentators. + -
ImgAug.ImgCorruptlike.Blur ImgAug imgcorruptlike Blur augmentators. + -
ImgAug.ImgCorruptlike.Weather ImgAug imgcorruptlike Weather augmentators. + -
ImgAug.ImgCorruptlike.Color ImgAug imgcorruptlike Color augmentators. + -
ImgAug.ImgCorruptlike.Compression ImgAug imgcorruptlike Compression augmentators. + -
ImgAug.Geometric.ElasticTransformation ImgAug geometric Elastic Transformation augmentator. + -
ImgAug.Geometric.PerspectiveTransform ImgAug geometric Perspective Transform augmentator. + -
Annotation Transforms
Approximate Vector Approximate vector objects. + -
Background Add background to data. + +
Bounding Box Convert object classes to bounding boxes. + +
Bounding Box to Polygon Convert bounding boxes to polygons. + +
Bitwise Masks Bitwise operations on masks. + -
Change Class Color Change color of the object class. + -
Drop Lines by Length Remove lines by length. + -
Drop Noise Remove noise from masks. + -
Drop Object by Class Remove objects by class. + -
Duplicate Objects Duplicate objects. + -
Image Tag Add tag to data. + -
Line to Mask Convert lines to masks. + -
Mask to Lines Convert masks to lines. + -
Mask to Polygon Convert masks to polygons. + -
Merge Masks Merge few masks of the same object class into a single one. + -
Objects Filter Filter data by objects. + -
Objects Filter by Area Tag or remove filtered objects by area. + -
Polygon to Mask Convert polygons to masks. + -
Rasterize Rasterize objects. + -
Rename Classes Rename object classes. + -
Skeletonize Skeletonize masks. + -
Split Masks Split masks. + -
Split Videos by Duration Split videos by duration. - +
Filters and Conditions
Filter Image by Object Filter Image by Object. + -
Filter Image by Tag Filter Image by Tag. + -
Filter Images without Objects Filter Images without Objects. + -
Filter Videos by Duration Filter Videos by Duration. - +
Filter Videos by Objects Filter Videos by Objects. - +
Filter Videos by Tags Filter Videos by Tags. - +
Filter Videos without Annotations Filter Videos without Annotations. - +
Filter Videos without Objects Filter Videos without Objects. - +
IF Action Select one of the available conditions and filter data. + -
Neural Networks
Apply NN Inference Apply neural network inference. + -
Deploy YOLOv5 Deploy pretrained or custom YOLOv5 model. + -
Deploy YOLO (v8, v9, v10, v11) Deploy pretrained or custom YOLO (v8, v9, v10, v11) model. + -
Deploy MMDetection Deploy pretrained or custom MMDetection model. + -
Deploy MMSegmentation Deploy pretrained or custom MMSegmentation model. + -
Deploy RT-DETR Deploy pretrained or custom RT-DETR model. + -
Deploy RT-DETRv2 Deploy pretrained or custom RT-DETRv2 model. + -
Other
Dummy Dummy node. Do nothing. Can be used to merge layers. + -
Dataset All data will be put into a single dataset. + -
Split Data All data will be distributed across datasets based on split method. + -
Output
Output Project Save data to a new or existing project. + -
Create new Project Create a new project and save data there. + +
Add to Existing Project Add data to an existing project or dataset. + +
Export Archive Export data to TeamFiles as an archive. + +
Export Archive with Masks Export data to TeamFiles as an archive with masks. + -
Copy Annotations Copy annotations from one project to another. + -
Create Labeling Job Create a labeling job from data. + +

Key features:

  • Transform Data: Apply a wide variety of data transformation operations to images within a project. These transformations include rotation, cropping, blurring, resizing, and many more.

    transform-data

  • Use Neural Networks: Apply deployed models on your data to perform object detection, instance segmentation, and other tasks. You can use any of the neural network models available in the Supervisely Ecosystem, or train your custom models.

    apply-nn

  • Enhance Data: Improve the quality and usability of your image data by adjusting contrast, brightness, and noise levels.

  • Object-Level Manipulation: Perform operations on individual objects or instances within images, such as cropping, duplicating, or changing their color classes.

    object-transforms

  • Customize Workflows: Create complex data transformation workflows by combining multiple transformation nodes to meet your specific requirements.

  • Node Documentation: Detailed documentation is available for each transformation node, explaining how to use it effectively. These guides provide step-by-step instructions and examples for each node, making it easy for users to understand and leverage the full power of the application.

    node-docs

  • Save & Load Presets: Save your customized transformation workflows as presets for future use. This feature allows you to store and reuse your preferred configurations quickly.

    load-preset

  • Output Flexibility: Choose from multiple export options to save your transformed data in a format that best suits your needs.

    merge-projects

How To Run

There are several ways to run the application, depending on your needs and preferences:

1. Run App from Ecosystem

run-from-ecosystem

2. Run App from the context menu of the Project

run-from-project

3. Run App from the context menu of the Dataset

run-from-dataset

4. Run Pipeline from Project

run-pipeline-from-project

5. Run Pipeline from Dataset

run-pipeline-from-dataset

6. Run Pipeline with Filters

run-pipeline-from-filters