Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unsupervised learning on feed #53

Open
Natasha-GB opened this issue Aug 29, 2024 · 4 comments
Open

Unsupervised learning on feed #53

Natasha-GB opened this issue Aug 29, 2024 · 4 comments
Assignees

Comments

@Natasha-GB
Copy link

No description provided.

@harshita-srivastava-yral
  • There are lot of hype parameters which is going to effect the feed.
  • We will need to use less complex model and then test it.
  • This will ensure we have not over fed.

@harshita-srivastava-yral
Copy link

harshita-srivastava-yral commented Sep 2, 2024

  • Needs help on prioritiy:
  • Komal and Jay working on ML feed improved the first feed
  • Duplication of the videos - Fuzzy hashing and use models top detect similarity in embedding
  • Moderation flow needs to be chalked out
  1. Dislike signal mechanism in the feed (Implementation of negative signal from user)
  2. Since HOT or NOT videos are mostly the videos not getting categrised we can look at running the categroisation on these videoas.
  3. Soft ban users who are regular offender.
  4. NU might be bad actors, who are uploading NSFW but not tagging it. Model to check uploaded video and categorise it to NSFW and then we need human moderation by rewarding team -Candidate generator finalising by EOW to improve recommendation (It will take time to get matured. It will not have immediate effect)

@jay-dhanwant-yral
Copy link

Video Processing requirements

  • scene change detection
  • embeddings generation
  • nsfw detection (high prio)
  • frame extraction & video decoding -> with gpu
  • intelligent watermark placement (not a huge prio)

@harshita-srivastava-yral
  • Some hiccups with Akash and GPU provisioning
  • Planning to sync-up to connect with SPOC of google.
  • Offering by google on CSM detection however unable to move further on this
  • Pricing etc isn't available and involve PM to get this resolved
  • Lets try out cloudflare
  • @jay-dhanwant to connect with @saikatdas0790 to walkthrough the process and check if we can create some login on cloudflare

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants