Sentiment analysis pipeline implementation bounty [$850]

[JJassonn69]

Overview

To enhance the feature set of our ai-subnet, we aim to implement a Sentiment Analysis pipeline. This new pipeline will create more opportunities for advanced text processing and emotional insights, thereby improving the quality and depth of our text analysis capabilities. This feature was specifically requested by one of the startups in our startup program to help them interpret the context from the output of the Whisper pipeline.

We are calling on the community to help implement this crucial pipeline on the AI-worker side of the ai-subnet project. Achieving this will not only improve the existing audio-to-text pipeline but also introduce a new pipeline that, with further optimisation, could potentially be integrated with the existing features to provide real-time sentiment analysis of textual data.

---

Required Skillset

• Familiarity with FastAPI.
• Strong Python programming skills.
• Familiar with docker and Hugging Face 🤗

---

Bounty Requirements

1. Implementation: Develop a working /sentiment-analysis route and pipeline in the AI-worker repository. This pipeline should be accessible on docker port 8007.
2. Functionality: The pipeline must accept a batch of text inputs and return sentiment analysis result that looks something like

Negative 0.7236
Neutral 0.2287
Positive 0.0477

---

Scope Exclusions

• This bounty does NOT cover the complete end-to-end implementation of this pipeline on the go-livepeer side, including payment logic and job routing. These aspects will be addressed by the AI SPE team or in a future bounty.

---

Implementation Tips

To understand how to create a new pipeline, you can refer to recent pull requests where new pipelines were added:

Pull Request #96
Pull Request #103

Additionally, make sure to:

• Utilize Earlier Work: There are implementation of sentiment analysis in huggingface spaces so review those work. This can provide valuable insights and a foundation for your work.
• Utilize Developer Documentation: Check out our developer documentation for the worker and runner. These resources provide valuable tips for speeding up your development process by mocking pipelines and enabling direct debugging.
• Generate OpenAPI Spec: Run the runner/gen_openapi.py file to generate the updated OpenAPI spec.
• Generate Go-Livepeer Bindings: In the main repository folder, run the make command to generate the necessary bindings, ensuring your implementation works seamlessly with the go-livepeer repository.

---

How to Apply

1. Express Your Interest: Comment on this issue to indicate your interest and explain why you're the ideal candidate for the task.
2. Wait for Review: Our team will review expressions of interest and select the best candidate.
3. Get Assigned: If selected, we'll assign the GitHub issue to you.
4. Start Working: Dive into your task! If you need assistance or guidance, comment on the issue or join the discussions in the #developer-lounge channel on our Discord server.
5. Submit Your Work: Create a pull request in the relevant repository and request a review.
6. Notify Us: Comment on this GitHub issue when your pull request is ready for review.
7. Receive Your Bounty: We'll arrange the bounty payment once your pull request is approved.
8. Gain Recognition: Your valuable contributions will be showcased in our project's changelog.

Thank you for your interest in contributing to our project! 💛

Warning

Please wait for the issue to be assigned to you before starting work. To prevent duplication of effort, submissions for unassigned issues will not be accepted.

[benya7]

Hello again!
Very interesting task. I would like to be assigned to it and start working as soon as possible
I've reviewed the previous pipeline implementations and already have an initial idea of how to achieve it.

Thank you!

[rickstaa]

Hello again! Very interesting task. I would like to be assigned to it and start working as soon as possible I've reviewed the previous pipeline implementations and already have an initial idea of how to achieve it.

Thank you!

Hey @benya7, thanks for your interest in tackling this important pipeline! 🚀 I've reviewed your background and assigned you to the bounty. If you have any questions or run into any issues, please don't hesitate to comment below or ping an AI core team member in the #developer-lounge.

[benya7]

Great, thanks for accepting me!
If I need help, I won’t hesitate to ask. 🙂

[benya7]

Hi @rickstaa, when you have time, please take a look at my pull request and let me know if I need to make any corrections or additions. Thanks!