[Support]: Cat detection - review filter on 'person/car' cannot be changed?

[Trashmee]

Describe the problem you are having

Hi,

I've used frigate for cat detection (are they sane also they don't come around for food..) for long, since 0.14 or so with very little luck. There are a couple of tickets in that regards, seems it might be an area where model tuning.. went sideway.

By accident I noticed that the frigate integration started to show me cats once in a while, however I cannot get the same events to appear in the frigate review tap.

Example:

• Frigate shows a nice pic of the cat 6am. Looks like a good, non trivial detection
• In Frigate /review view I have filters 'all / car / person' - neither of those three options will show the 6am event. 'Show reviewed' is also checked.

I ran through the full reference config, but did not see how I can expand the parameter section to include cat. I added this one (didn't make much sense to me, but seemed closest) - didn't make a difference.

review:
  # Optional: alerts configuration
  alerts:
    # Optional: labels that qualify as an alert (default: shown below)
    labels:
      - person
      - cat

I must have a valid detection setup (saw multiple detections in homeassistant integration) - so the question is really - how to remove an implicite filter that seems to be in place?

Version

frigate:0.15.0-beta1

What browser(s) are you using?

No response

Frigate config file

version: 0.15-0
logger:
  default: info
  logs:
    frigate.mqtt: error

mqtt:
  host: mqtt.domain.com
  topic_prefix: frigate
  client_id: frigate
  user: admin
  password: Password

detectors:
  coral:
    type: edgetpu
    device: usb


database:
  path: /media/frigate/database/frigate.db

semantic_search:
  enabled: True
  reindex: False

birdseye:
  enabled: true
  width: 1920
  height: 1080
  mode: continuous


go2rtc:
  streams:
    vorgarten:
      - rtsp://frigate:Password@192.168.190.53/cam/realmonitor?channel=1&subtype=0
    vorgarten_sub:
      - rtsp://frigate:Password@192.168.190.53/cam/realmonitor?channel=1&subtype=1
    eingang:
      - rtsp://frigate:Password@192.168.190.56/cam/realmonitor?channel=1&subtype=0
    eingang_sub:
      - rtsp://frigate:Password@192.168.190.56/cam/realmonitor?channel=1&subtype=1
    garten:
      - rtsp://frigate:Password@192.168.190.57/cam/realmonitor?channel=1&subtype=0
    garten_sub:
      - rtsp://frigate:Password@192.168.190.57/cam/realmonitor?channel=1&subtype=1
    terasse:
      - rtsp://frigate:Password@terasse.domain.com/cam/realmonitor?channel=1&subtype=0
    terasse_sub:
      - rtsp://frigate:Password@terasse.domain.com/cam/realmonitor?channel=1&subtype=1
    gartentor:
      - rtsp://frigate:Password@gartentor.domain.com:554/h265Preview_01_main
    gartentor_sub:
      - rtsp://frigate:Password@gartentor.domain.com:554/h264Preview_01_sub

record:
  enabled: true
  expire_interval: 60
  retain:
    days: 10
    mode: all
  alerts:
    retain:
      days: 11
    pre_capture: 5
    post_capture: 5
  detections:
    retain:
      days: 11
    pre_capture: 5
    post_capture: 5
cameras:
  vorgarten:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/vorgarten
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/vorgarten_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
    motion:
      mask:
        0.652,1,0.642,0.758,0.794,0.434,0.914,0.493,0.951,0.298,0.79,0.093,0.395,0.168,0.421,0.379,0.107,0.685,0.07,0.992,0.004,0.992,0.001,0.002,0.998,0.01,0.998,0.989
      threshold: 30
      contour_area: 25
      improve_contrast: 'true'
    objects:
      track:
        - person
        - car
        - cat
  eingang:
    detect:
      width: 704
      height: 576
      fps: 5
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/eingang
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/eingang_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
    motion:
      mask: 0,0.794,0.254,0.786,0.028,0.492,0.067,0.23,0.465,0.209,1,0.245,1,0,0,0
    objects:
      track:
        - person
        - cat
  terasse:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/terasse
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/terasse_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
    objects:
      track:
        - person
        - cat
    motion:
      mask: 0,0,1,0,1,1,0.906,1,0.938,0.779,0.97,0.245,0.736,0.223,0.465,0.343,0,0.651
  garten:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/garten
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/garten_sub
          input_args: preset-rtsp-restream
          roles:
            - detect

    motion:
      threshold: 30
      contour_area: 25
      improve_contrast: 'true'
      mask: 1,0.329,0.725,0.199,0.648,0.159,0.117,0.249,0,0.457,0,0,1,0
    objects:
      track:
        - person
        - cat
  gartentor:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/gartentor
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/gartentor_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
    objects:
      track:
        - person
        - cat

    motion:
      mask: 0.999,0.982,0.993,0.206,0.25,0.204,0,0.206,0,0,1,0



review:
  alerts:
    labels:
      - person
      - cat

Relevant Frigate log output

N/A

Relevant go2rtc log output

N/A

FFprobe output from your camera

N/A

Frigate stats

No response

Install method

Docker Compose

docker-compose file or Docker CLI command

N/A

Object Detector

Coral

Network connection

Wired

Camera make and model

Dahua + Reolinks

Screenshots of the Frigate UI's System metrics pages

No response

Any other information that may be helpful

No response

[Trashmee]

[hawkeye217]

If you added cat to the review config for alerts after the cat had already come by, be advised that Frigate does not re-classify tracked objects. You'll have to wait until another cat comes by to see it under Alerts.

[Trashmee]

@hawkeye217: I get your point.

Still - where's the place in "review" that I would find the option (alerts / detection / motion) tagged as 'cat'?
As frigate send it to homeassistant the tag must be there - what am I doing wrong to not be able to find / filter it someplace?

:-)

[NickM-27]

It will show up once a cat is detected as an alert. The filters only show content when it has filterable options

[Trashmee]

You're right, while the event was posted by frigate during a restart this morning the footage actually says its from Nov 11th.

Still doesn't add up to me, sorry:

• If i pick the right day (where cat was detect) I can filter for it
• I cannot find all cats for 7 days (maybe its me) - single day select only?
• detection rate seems low compared to ~2y ago

The one on 4th is not a very clear catch (good job, frigate - or is the tail such a big help?)
I'm very certain there is a lot of other instances that were missed. Any tuning that could be applied on my end?

[hawkeye217]

Are you trying to filter alerts/detections or are you looking at your tracked objects from the Explore view?

The free model Frigate ships with by default is trained on the COCO dataset and may need a lower threshold for cat in order to be more reliable at detecting them.