Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Add script to remove nearly empty products with quality issues #11058

Merged
merged 16 commits into from
Dec 9, 2024

Conversation

CharlesNepote
Copy link
Member

No description provided.

Copy link
Member

@teolemon teolemon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@CharlesNepote
Copy link
Member Author

@teolemon

What's the difference with : https://github.com/openfoodfacts/openfoodfacts-server/blob/main/scripts/remove_empty_products.pl ?

# This script is run to remove products with a data quality issue, 
# few information & no image at all (excluding imports)

See: https://openfoodfacts.slack.com/archives/C03H290LF/p1732539345020489

@CharlesNepote CharlesNepote changed the title Add script to remove nearly empty products with quality issues [feat] Add script to remove nearly empty products with quality issues Nov 28, 2024
@CharlesNepote CharlesNepote changed the title [feat] Add script to remove nearly empty products with quality issues feat: Add script to remove nearly empty products with quality issues Nov 28, 2024
@teolemon teolemon added 🧽 Data quality https://wiki.openfoodfacts.org/Quality script-writing labels Dec 4, 2024
@alexgarel alexgarel enabled auto-merge (squash) December 9, 2024 09:35
@alexgarel
Copy link
Member

/lint

Copy link

sonarqubecloud bot commented Dec 9, 2024

@alexgarel alexgarel merged commit 82726d5 into main Dec 9, 2024
14 checks passed
@alexgarel alexgarel deleted the remove_nearly_empty_products branch December 9, 2024 10:30
stephanegigandet pushed a commit that referenced this pull request Dec 11, 2024
🤖 I have created a release *beep* *boop*
---


##
[2.51.0](v2.50.0...v2.51.0)
(2024-12-10)


### Features

* Add script to remove nearly empty products with quality issues
([#11058](#11058))
([82726d5](82726d5))
* NOVA 4 attribute and knowledge panel improvements
([#11035](#11035))
([9048011](9048011))


### Bug Fixes

* additives table + clean HTML to remove some validation errors
([#11093](#11093))
([474f68d](474f68d))
* avoid crash if ingredients services called without ingredients_lc
([#11055](#11055))
([1db3e94](1db3e94))
* data quality, false positive, nutrition sum with lower symbol
([#11076](#11076))
([d389c87](d389c87))
* data quality, false positive, nutrition sum with lower symbol for milk
below the table
([#11098](#11098))
([7febb69](7febb69))
* display of usage in scripts/import_csv_file.pl
([#11091](#11091))
([91881f8](91881f8))
* improve parsing of 'category (type 1, type 2..)' ingredients
([#10999](#10999))
([42618ac](42618ac))
* letter A at end of string is not a stopword
([#11095](#11095))
([6eaeb26](6eaeb26))
* Load products in mongodb
([#11072](#11072))
([6787ba1](6787ba1))
* new images path
([#11096](#11096))
([8658959](8658959))
* pro platform product writes to the public platform MongoDB database
([#11065](#11065))
([f77eb82](f77eb82))
* product image move
[#11067](#11067)
([#11092](#11092))
([30257c1](30257c1))
* remove warning in ecobalyse matching of ingredients
([#11062](#11062))
([c29fce9](c29fce9))

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
🧽 Data quality https://wiki.openfoodfacts.org/Quality script-writing
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

4 participants