0.11.0 Beta 5

[blakeblackshear]

Major Changes for 0.11.0

Link to updated docs: https://deploy-preview-2829--frigate-docs.netlify.app/

Changes since beta 4

• Support for reading Frigate+ api key from hassos addon options
• Switch back to ffmpeg 4.4.1

Changes since beta 3

• Just a re-release with the frontend build updated

Changes since beta 2

• Switch to ffmpeg 4.3.2 in hopes of audio encoding and hwaccel fixes
• Fixes for UI not loading with addons
• Fix delete icon for firefox
• Warning when deleting favorite events
• Gracefully handle failed new version checks when frigate doesn't have internet access
• Add filtering for sub labels
• Remove deprecated max_seconds config option

BREAKING CHANGES

• Upgrading to the beta will run migrations on the database file that are not backwards compatible. In order to rollback to 0.10.0, you will either need to restore an old database file or delete the database files so they can be recreated.
• This version includes a significant rework of the docker build. This may have broken ffmpeg hardware acceleration for some hardware that was working previously. Please open an issue if this happens so we can try and track down what's missing.
• Some deployment approaches are overwriting the PATH environment value to an old value. If you see errors like No such file or directory: 'ffmpeg', then you need to stop overriding your PATH. This happens with both Proxmox LXC and Portainer ([Support]: Beta11 Can't Find FFMPEG #3223)
• The max_seconds config setting under events has been removed as it no longer has any effect

Frigate+ Integration

With this release, users can easily send snapshots to Frigate+ for labeling directly from the Events view. Note that Frigate+ is still in development, and custom models are not yet available. There is no cost to create an account and submit labeled images. Making it simpler to submit images should accelerate the build out of a robust training set.

To enable the Frigate+ functionality, you need to obtain an API Key from your Frigate+ account on the settings page and set it via the PLUS_API_KEY environment variable. I am working on getting this added into the Home Assistant Addon as well.

Here is the roadmap for Frigate+:

• Launch web version allowing manual upload of training examples and labeling
• Integrate submission in Frigate
• Launch Frigate optimized models
• Launch individually optimized models
• Integrate labeling and suggestions in Frigate

Updated Events View

• Speed. The events view has been completely revamped and should be much faster than it was before.
• Slightly larger thumbnails.
• You no longer have to refresh the page to see the latest events.
• You can "star" or "favorite" events to tell Frigate to keep associated recordings and the snapshot indefinitely.
• Sub labels have been added to allow setting arbitrary labels on events. For example, you can use deepstack to run facial recognition and update the event with the name of the person detected. (FEAT: Ability to set sub labels for specific events #2949)

Updated Recordings View

• Speed. The recordings view doesn't look different, but it has been completely overhauled. It should be much faster, and event data and thumbnails are lazy loaded to reduce the amount of data that is loaded when visiting the page.
• Smoother seeking and transitions. Re-renders of the player have been reduced and you should see smoother seek behavior when selecting events.
• 16x playback was added for browsers other than Firefox.

Updated Dockerbuild

• Frigate is now built on top of plain Debian containers and consolidated into a single multiarch image.

Experimental Timeline UI

Not recommended for use yet, but an alternative UI has been added. It has very limited browser/device support. #2830

Other changes

• MQTT sensors for any object type FEAT: MQTT support for all objects for each camera & zone #2908
• Update latest object endpoints to reference most recent event from database (you will no longer see black images for objects under the camera in live view) FEAT: Replace best jpg endpoint #2944
• Added a new ratio filter for object filters Add object filter ratio #2952
• Camera recordings always in sidebar Always show camera recordings in sidebar regardless of state #2846
• Enable and set mode per camera for birdseye Allow birdseye to be overridden at the camera level #3083
• Customize order and hide cameras from the UI FEAT: Ability to reorder & ability to hide Cameras in UI #2981
• Enable improve_contrast via MQTT Allow improve_contrast to be toggled via mqtt #3011
• Enable/disable motion detection independent of object detection via MQTT Ability to enable / disable motion detection via MQTT #3117
• MQTT topic for motion detection Send mqtt message when motion is detected #3152
• Batch deletes of recordings when more than 100,000 recordings need to be deleted
• Switch to jellyfin ffmpeg
• Improve cache handling for thumbnails and snapshots of completed events
• Fixes hwaccel issues for Raspberry Pi users
• Updates to debian 11 as a base image
• Consolidate Dockerfile to enable multiarch images
• Birdseye icno can now be customized FEAT: Ability to set custom birdseye icon and birdseye docs #2979
• Frigate now checks for a newer release on startup and exposes that in the stats endpoint Add latest frigate version to stats endpoints #3038
• Initial implementation of mypy and type checking
• Images from backend now have appropriate cache headers

Full Changelog: v0.10.0...v0.11.0-beta5

Image: blakeblackshear/frigate:0.11.0-beta5

---

This discussion was created from the release 0.11.0 Beta 5.

[DrSpaldo]

Whats the difference / why switching versions of ffmpeg?

[blakeblackshear]

Some users were reporting issues with hardware acceleration, and I was trying to find a version that worked for more users. Now this is the only ffmpeg 4 version available in the jellyfin repo where I now install from. It's the same as it was in beta 2.

[mdelecate]

Is the "Send to Frigate+" button for the Add-On also included in this release? As it doesn't show up after entering the Frigate+ API key.

[mdelecate]

Nope, no mention of that in the Add-on logs. It's basically just:

[s6-init] making user provided files available at /var/run/s6/etc...exited 0.
[s6-init] ensuring user provided files have correct perms...exited 0.
[fix-attrs.d] applying ownership & permissions fixes...
[fix-attrs.d] done.
[cont-init.d] executing container initialization scripts...
[cont-init.d] done.
[services.d] starting services
[services.d] done.
[2022-07-03 12:33:14] frigate.app                    INFO    : Starting Frigate (0.11.0-ef54cd6)
[2022-07-03 12:33:14] frigate.app                    INFO    : Creating directory: /tmp/cache
Starting migrations
[2022-07-03 12:33:14] peewee_migrate                 INFO    : Starting migrations
There is nothing to migrate
[2022-07-03 12:33:14] peewee_migrate                 INFO    : There is nothing to migrate
[2022-07-03 12:33:15] detector.coral1                INFO    : Starting detection process: 256
[2022-07-03 12:33:15] ws4py                          INFO    : Using epoll
[2022-07-03 12:33:15] frigate.edgetpu                INFO    : Attempting to load TPU as usb:0
[2022-07-03 12:33:18] frigate.edgetpu                INFO    : TPU found
[2022-07-03 12:33:15] frigate.app                    INFO    : Output process started: 267
[2022-07-03 12:33:15] frigate.app                    INFO    : Camera processor started for GardenFront: 283
[2022-07-03 12:33:15] frigate.app                    INFO    : Capture process started for GardenFront: 299

[NickM-27]

Looks like you got it sorted out?

[mdelecate]

Still unresolved unfortunately. I uploaded the other images to Frigate+ using "Add Image" on https://plus.frigate.video/dashboard/images/

[blakeblackshear]

@mdelecate And you have restarted the addon container, correct?

[mdelecate]

Correct. Add-on restart after every config change.

[LaurenceGough]

I upgraded from Beta 2 to Beta 4, and I lost all of the events. Could it still be migrating 20 minutes later?

The logs show the following when trying to access events:

[2022-07-13 00:52:48] frigate.http                   ERROR   : Exception on /sub_labels [GET]
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/dist-packages/flask/app.py", line 2077, in wsgi_app
    response = self.full_dispatch_request()
  File "/usr/local/lib/python3.9/dist-packages/flask/app.py", line 1525, in full_dispatch_request
    rv = self.handle_user_exception(e)
  File "/usr/local/lib/python3.9/dist-packages/flask/app.py", line 1523, in full_dispatch_request
    rv = self.dispatch_request()
  File "/usr/local/lib/python3.9/dist-packages/flask/app.py", line 1509, in dispatch_request
    return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args)
  File "/opt/frigate/frigate/http.py", line 259, in get_sub_labels
    sub_labels.remove(None)
ValueError: list.remove(x): x not in list

That's about all I can see that might be wrong.

Edit: Ignore me, just user error with media mappings.

[NickM-27]

sub_labels.remove(None)

this would be a frontend error when trying to get sub_labels with no events (fixed in the next beta).

This would be a symptom not underlying issue, do you have /media/frigate (or whatever directory the db is stored in) on the host somewhere? This usually happens when it is just inside the container and nowhere else

[LaurenceGough]

Thanks Nick you sorted it as always, I hadn't updated my stack in portainer to point to the correct mapping, whoops... corrected now and all ok. Thanks again :)

Looks like I had an issue with the NAS too so I am just checking that out, there was a fuse trip earlier today...

[ediguidedog]

Is there a known issue with video clips missing on beta5?

I've had a couple of occasions (and I had a few more last night) where snapshots are taken but no corresponding video clip is stored. When I try and play the clip I get an error (I forgot the actual text) and the below entry gets inserted in the frigate log

[2022-07-17 06:33:59] frigate.http      ERROR   : No recordings found for the requested time range

On subsequent attempts to play the clip a snapshot is displayed instead and the option to download video disappears

Curiously each time it seems to be late at night and when something has been incorrectly mis categorised as a person. Last night it was two foxes then later a planter. The snapshot was there but the video clip was missing. Each time the confidence level was in the 70%+ range

My thoughts
It's usually late at night and very dark so the cameras frame rate drops considerably so could this be an issue?

You will see from below on the camera in question I only capture video when people are detected and for the dog I only capture snapshots and had the foxes been identified as dogs the behaviour would (almost) be as expected but the foxes were categorised as people and the frigate gui offered a video clip for viewing

patio:
    ffmpeg:
        inputs:
            - path: rtsp://user:[email protected]:554/stream0
    motion:
        mask:
            - 300,46,346,147,258,200,220,85 # this is a plant that waves in the breeze
    objects:
        filters:
            dog:
                mask:
                    - 239,377,188,264,0,495,75,591 # this is the bottom half of the patio door where the dog often sleeps. without this I was getting long clips of nothing interesting
        track:
            - person
            - dog
    record:
        events:
            objects:
                - person

Other bits of interest from the config file

objects:
 filters:
    person:
      min_area: 5000
      min_score: 0.65
      threshold: 0.7

snapshots:
 enabled: True
 timestamp: False
 bounding_box: True
 crop: False
 retain:
    default: 14
    objects:
        person: 14
        dog: 7
        cat: 7
        car: 7
record:
 enabled: True
 expire_interval: 60
 events:
    retain:
        default: 14
        mode: active_objects
        objects:
            person: 14
            cat: 2
            dog: 2
            car: 7

I can provide more if needed but for now I was just wanting to understand if this is a known issue before I spend ages giving you info you don't actually need.

Please let me know if you need more or if it's already in hand.

Thanks

[NickM-27]

This is not a known issue. We need to see logs as it seems more like video is corrupted and not being saved or something. (I'd recommend moving this to an official issue)