api.facet.get returns single page

[benbenben2]

Problem

>>> results = api.facet.get('country')
>>> print(results['count'])
575
>>> print(len(results['tags']))
100

Get a facet returns only a single page (equivalent of https://world.openfoodfacts.net/countries.json)

• Is there a way to access to the following pages? (like https://world.openfoodfacts.net/countries/2.json)
• Is there a way to filter on known=0? (like https://world.openfoodfacts.net/countries.json?status=unknown)

Proposed solution

something like that maybe?

  def get(self, facet_name: Union[Facet, str], full_load: bool = False, unknown: bool = False) -> JSONType:
      facet = Facet.from_str_or_enum(facet_name)
      facet_plural = facet.value.replace("_", "-")
      all_results = []
      page = 1
      page_size = 100

      params = {"json": "1"}
      if unknown:
          params["status"] = "unknown"

      while True:
          url = f"{self.base_url}/{facet_plural}"
          if page > 1:
              url = f"{url}/{page}"

          resp = send_get_request(
              url=url,
              params=params,
              api_config=self.api_config,
              auth=get_http_auth(self.api_config.environment),
          )
          resp = cast(JSONType, resp)
          results = resp.get("tags", [])

          all_results.extend(results)

          if not full_load or len(results) < page_size:
              break

          page += 1

      return {"tags": all_results}

It will probably face the request limitation after 5 or 10 pages.