FiftyOne provides a powerful plugin framework that allows for extending and customizing the functionality of the tool.
With plugins, you can add new functionality to the FiftyOne App, create integrations with other tools and APIs, render custom panels, and add custom buttons to menus. You can even schedule long running tasks from within the App that execute on a connected workflow orchestration tool like Apache Airflow.
For example, here's a taste of what you can do with the @voxel51/brain plugin!
brain.mp4
This repository contains a curated collection of FiftyOne Plugins, organized into the following categories:
- Core Plugins: core functionality that all FiftyOne users will likely want to install. These plugins are maintained by the FiftyOne team
- Voxel51 Plugins: non-core plugins that are officially maintained by the FiftyOne team
- Example Plugins: these plugins exist to inspire and educate you to create your own plugins! Each emphasizes a different aspect of the plugin system
- Community Plugins: third-party plugins that are contributed and maintained by the community. These plugins are not officially supported by the FiftyOne team, but they're likely awesome!
🔌🤝 Contribute Your Own Plugin 🚀🚀
Want to showcase your own plugin here? See the contributing section for instructions!
| Name | Description |
|---|---|
| @voxel51/annotation | ✏️ Utilities for integrating FiftyOne with annotation tools |
| @voxel51/brain | 🧠 Utilities for working with the FiftyOne Brain |
| @voxel51/dashboard | 📊 Create your own custom dashboards from within the App |
| @voxel51/evaluation | ✅ Utilities for evaluating models with FiftyOne |
| @voxel51/io | 📁 A collection of import/export utilities |
| @voxel51/indexes | 📈 Utilities working with FiftyOne database indexes |
| @voxel51/plugins | 🧩 Utilities for managing and building FiftyOne plugins |
| @voxel51/delegated | 📡 Utilities for managing your delegated operations |
| @voxel51/runs | 🏃 Utilities for managing your custom runs |
| @voxel51/utils | ⚒️ Call your favorite SDK utilities from the App |
| @voxel51/zoo | 🌎 Download datasets and run inference with models from the FiftyOne Zoo, all without leaving the App |
| Name | Description |
|---|---|
| @voxel51/voxelgpt | 🤖 An AI assistant that can query visual datasets, search the FiftyOne docs, and answer general computer vision questions |
| @voxel51/mlflow | 📋 Track model training experiments on your FiftyOne datasets with MLflow! |
| @voxel51/huggingface_hub | 🤗 Push FiftyOne datasets to the Hugging Face Hub, and load datasets from the Hub into FiftyOne! |
| @voxel51/transformers | 🤗 Run inference on your datasets using Hugging Face Transformers models! |
| Name | Description |
|---|---|
| @voxel51/hello-world | 👋 An example plugin that contains both Python and JavaScript components |
| @voxel51/operator-examples | ⚙️ A collection of example operators showing how to use the operator type system to build custom FiftyOne operations |
| @voxel51/panel-examples | 📊 A collection of example panels demonstrating common patterns for building Python panels |
🔌🤝 Contribute Your Own Plugin 🚀🚀
Want to showcase your own plugin here? See the contributing section for instructions!
| Name | Description |
|---|---|
| @segmentsai/segments-voxel51-plugin | ✏️ Integrate FiftyOne with the Segments.ai annotation tool! |
| @jacobmarks/image_issues | 🌩️ Find common image quality issues in your datasets |
| @jacobmarks/concept_interpolation | 📈 Find images that best interpolate between two text-based extremes! |
| @jacobmarks/text_to_image | 🎨 Add synthetic data from prompts with text-to-image models and FiftyOne! |
| @jacobmarks/twilio_automation | 📲 Automate data ingestion with Twilio! |
| @wayofsamu/line2d | 📉 Visualize x,y-Points as a line chart. |
| @jacobmarks/vqa-plugin | ❔ Ask (and answer) open-ended visual questions about your images! |
| @jacobmarks/youtube_panel_plugin | 📺 Play YouTube videos in the FiftyOne App! |
| @jacobmarks/image_deduplication | 🪞 Find exact and approximate duplicates in your dataset! |
| @jacobmarks/keyword_search | 🔑 Perform keyword search on a specified field! |
| @jacobmarks/pytesseract_ocr | 👓 Run optical character recognition with PyTesseract! |
| @brimoor/pdf-loader | 📄 Load your PDF documents into FiftyOne as per-page images |
| @jacobmarks/zero_shot_prediction | 🔮 Run zero-shot (open vocabulary) prediction on your data! |
| @jacobmarks/active_learning | 🏃 Accelerate your data labeling with Active Learning! |
| @jacobmarks/reverse_image_search | ⏪ Find the images in your dataset most similar to an image from filesystem or the internet! |
| @jacobmarks/concept_space_traversal | 🌌 Navigate concept space with CLIP, vector search, and FiftyOne! |
| @jacobmarks/audio_retrieval | 🔊 Find the images in your dataset most similar to an audio file! |
| @jacobmarks/semantic_document_search | 🔎 Perform semantic search on text in your documents! |
| @allenleetc/model-comparison | ⚖️ Compare two object detection models! |
| @ehofesmann/filter_values | 🔎 Filter a field of your FiftyOne dataset by one or more values. |
| @jacobmarks/gpt4_vision | 🤖 Chat with your images using GPT-4 Vision! |
| @swheaton/anonymize | 🥸 Anonymize/blur images based on a FiftyOne Detections field. |
| @jacobmarks/double_band_filter |  Filter on two numeric ranges simultaneously! |
| @danielgural/semantic_video_search |  Semantically search through your video datasets using FiftyOne Brain and Twelve Labs! |
| @jacobmarks/emoji_search | 😏 Semantically search emojis and copy to clipboard! |
| @danielgural/img_to_video | 🦋 Bring images to life with image to video! |
| @ehofesmann/edit_label_attributes | ✏️ Edit attributes of your labels directly in the FiftyOne App! |
| @danielgural/audio_loader | 🎧 Import your audio datasets as spectograms into FiftyOne! |
| @jacobmarks/albumentations_augmentation | 🪞 Test out any Albumentations data augmentation transform with FiftyOne! |
| @jacobmarks/image_captioning | 🖋️ Caption all your images with state of the art vision-language models! |
| @jacobmarks/multimodal_rag | 🦙 Create and test multimodal RAG pipelines with LlamaIndex, Milvus, and FiftyOne! |
| @danielgural/optimal_confidence_threshold | 🔍 Find the optimal confidence threshold for your detection models automatically! |
| @danielgural/outlier_detection | ❌ Find those troublesome outliers in your dataset automatically! |
| @danielgural/clustering_algorithms | 🕵️ Find the clusters in your data using some of the best algorithms available! |
| @jacobmarks/clustering | 🍇 Cluster your images using embeddings with FiftyOne and scikit-learn! |
| @mmoollllee/fiftyone-tile | ⬜ Tile your high resolution images to squares for training small object detection models |
| @mmoollllee/fiftyone-timestamps | 🕒 Compute datetime-related fields (sunrise, dawn, evening, weekday, ...) from your samples' filenames or creation dates |
| @jacobmarks/florence2 | 🧙 Connect Microsoft's Florence-2 Vision-Language Model to your data! |
| @allenleetc/plotly-map-panel | 🌎 Plotly-based Map Panel with adjustable marker cosmetics! |
If you haven't already, install FiftyOne:
pip install fiftyoneIn general, you can install all plugin(s) in a GitHub repository by running:
fiftyone plugins download https://github.com/path/to/repoFor instance, to install all plugins in this repository, you can run:
fiftyone plugins download https://github.com/voxel51/fiftyone-pluginsYou can also install a specific plugin using the --plugin-names flag:
fiftyone plugins download \
https://github.com/voxel51/fiftyone-plugins \
--plugin-names <name>💡 Pro tip: Some plugins require additional setup. Click the plugin's link and navigate to the project's README for instructions.
You can use the CLI commands below to manage your downloaded plugins:
# List all plugins you've downloaded
fiftyone plugins list
# List the available operators and panels
fiftyone operators list
# Disable a particular plugin
fiftyone plugins disable <name>
# Enable a particular plugin
fiftyone plugins enable <name>If you plan to develop plugins locally, you can clone the repository and symlink it into your FiftyOne plugins directory like so:
cd /path/to/fiftyone-plugins
ln -s "$(pwd)" "$(fiftyone config plugins_dir)/fiftyone-plugins"Have a plugin you'd like to share with the community? Awesome! 🎉🎉🎉
Just follow these steps to add your plugin to this repository:
- Make sure your plugin repo has a
README.mdfile that describes the plugin and how to install it - Fork this repository
- Add an entry for your plugin to the Community Plugins table above
- Submit a pull request into this repository
You're also welcome to contribute to the plugins that live natively in this repository. Check out the contributions guide for instructions.
If you want join a fast-growing community of engineers, researchers, and practitioners who love computer vision, join the FiftyOne Slack community 🚀🚀🚀
💡 Pro tip: the #plugins channel is a great place to discuss plugins!
If you've made it this far, we'd greatly appreciate if you'd take a moment to check out FiftyOne and give us a star!
FiftyOne is an open source library for building high-quality datasets and computer vision models. It's the engine that powers this project.
Thanks for visiting! 😊