[HW Accel Support]: Frigate on HAOS in Proxmox not detect hwaccel and ffmpeg crashing

[artinbastani]

Describe the problem you are having

I bought one of the frequently recommended Beelink S12s to move my HAOS setup to from a 8th Gen NUC who's fan keeps breaking. Trying to install HAOS in proxmox so I can add it to my cluster and make management easier. I used the proxmox helper script to install HAOS in a VM.

Version

0.14.1

Frigate config file

logger:
  default: info

go2rtc:
  streams:
    livingroom: rtsp://192.168.1.8:8554/livingroom

#OPENVINO

detectors:
  ov:
    type: openvino
    device: GPU
    model:
      path: /openvino-model/ssdlite_mobilenet_v2.xml

model:
  width: 300
  height: 300
  input_tensor: nhwc
  input_pixel_format: bgr
  labelmap_path: /openvino-model/coco_91cl_bkgr.txt

detect:
  width: 1280
  height: 720
  fps: 5

objects:
  track:
    - person

live:
  quality: 1

motion:
  threshold: 30
  improve_contrast: false

ffmpeg:
  output_args:
    record: preset-record-generic-audio-copy
  hwaccel_args: preset-vaapi

cameras:
  livingroom:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/livingroom
          roles:
            - detect
    motion:
      mask:
        - 1252,0,1252,35,912,35,909,0
    detect:
      enabled: true
version: 0.14

docker-compose file or Docker CLI command

none

Relevant Frigate log output

2024-12-02 19:22:08.079642762  [2024-12-02 14:22:08] frigate.app                    INFO    : Starting Frigate (0.14.1-f4f3cfa)
2024-12-02 19:22:08.080066189  [2024-12-02 14:22:08] frigate.app                    INFO    : Creating directory: /tmp/cache
2024-12-02 19:22:08.080388849  [2024-12-02 14:22:08] frigate.util.config            INFO    : Checking if frigate config needs migration...
2024-12-02 19:22:08.092615903  [2024-12-02 14:22:08] frigate.util.config            INFO    : frigate config does not need migration...
2024-12-02 19:22:08.106771900  [2024-12-02 14:22:08] frigate.config                 WARNING : Customizing more than a detector model path is unsupported.
2024-12-02 19:22:08.114519337  [2024-12-02 14:22:08] peewee_migrate.logs            INFO    : Starting migrations
2024-12-02 19:22:08.115344165  [2024-12-02 14:22:08] peewee_migrate.logs            INFO    : There is nothing to migrate
2024-12-02 19:22:08.119862121  [2024-12-02 14:22:08] frigate.app                    INFO    : Recording process started: 274
2024-12-02 19:22:08.136764424  [2024-12-02 14:22:08] frigate.app                    INFO    : Recording process started: 276
2024-12-02 19:22:08.136767884  [2024-12-02 14:22:08] frigate.app                    INFO    : go2rtc process pid: 105
2024-12-02 19:22:08.171309440  [2024-12-02 14:22:08] detector.ov                    INFO    : Starting detection process: 303
2024-12-02 19:22:08.171312718  [2024-12-02 14:22:08] frigate.app                    INFO    : Output process started: 305
2024-12-02 19:22:08.209861680  Abort was called at 349 line in file:
2024-12-02 19:22:08.209865962  ./shared/source/os_interface/linux/drm_neo.cpp
2024-12-02 19:22:08.216327358  Fatal Python error: Aborted
2024-12-02 19:22:08.216330535  
2024-12-02 19:22:08.216486566  Thread 0x00007f6cb4ff96c0 (most recent call first):
2024-12-02 19:22:08.216814911    File "/usr/lib/python3.9/threading.py", line 312 in wait
2024-12-02 19:22:08.221081982    File "/usr/lib/python3.9/multiprocessing/queues.py", line 233 in _feed
2024-12-02 19:22:08.221715278    File "/usr/lib/python3.9/threading.py", line 892 in run
2024-12-02 19:22:08.224536547    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-12-02 19:22:08.225204774    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-12-02 19:22:08.225408962  
2024-12-02 19:22:08.225515629  Current thread 0x00007f6cdddbf740 (most recent call first):
2024-12-02 19:22:08.228180782    File "/usr/local/lib/python3.9/dist-packages/openvino/runtime/ie_api.py", line 521 in compile_model
2024-12-02 19:22:08.230262693    File "/opt/frigate/frigate/detectors/plugins/openvino.py", line 43 in __init__
2024-12-02 19:22:08.230266351    File "/opt/frigate/frigate/detectors/__init__.py", line 18 in create_detector
2024-12-02 19:22:08.230267430    File "/opt/frigate/frigate/object_detection.py", line 53 in __init__
2024-12-02 19:22:08.230271436    File "/opt/frigate/frigate/object_detection.py", line 102 in run_detector
2024-12-02 19:22:08.230292175    File "/usr/lib/python3.9/multiprocessing/process.py", line 108 in run
2024-12-02 19:22:08.233533164    File "/usr/lib/python3.9/multiprocessing/process.py", line 315 in _bootstrap
2024-12-02 19:22:08.233536441    File "/usr/lib/python3.9/multiprocessing/popen_fork.py", line 71 in _launch
2024-12-02 19:22:08.233537606    File "/usr/lib/python3.9/multiprocessing/popen_fork.py", line 19 in __init__
2024-12-02 19:22:08.233538631    File "/usr/lib/python3.9/multiprocessing/context.py", line 277 in _Popen
2024-12-02 19:22:08.233539581    File "/usr/lib/python3.9/multiprocessing/context.py", line 224 in _Popen
2024-12-02 19:22:08.233540570    File "/usr/lib/python3.9/multiprocessing/process.py", line 121 in start
2024-12-02 19:22:08.233544381    File "/opt/frigate/frigate/object_detection.py", line 183 in start_or_restart
2024-12-02 19:22:08.233545477    File "/opt/frigate/frigate/object_detection.py", line 151 in __init__
2024-12-02 19:22:08.233546602    File "/opt/frigate/frigate/app.py", line 429 in start_detectors
2024-12-02 19:22:08.233547508    File "/opt/frigate/frigate/app.py", line 690 in start
2024-12-02 19:22:08.233586308    File "/opt/frigate/frigate/__main__.py", line 17 in <module>
2024-12-02 19:22:08.233587961    File "/usr/lib/python3.9/runpy.py", line 87 in _run_code
2024-12-02 19:22:08.233600915    File "/usr/lib/python3.9/runpy.py", line 197 in _run_module_as_main
2024-12-02 19:22:08.249774115  [2024-12-02 14:22:08] frigate.app                    INFO    : Camera processor started for livingroom: 325
2024-12-02 19:22:08.249778541  [2024-12-02 14:22:08] frigate.app                    INFO    : Capture process started for livingroom: 330
2024-12-02 19:22:09.839823602  [2024-12-02 14:22:09] frigate.video                  ERROR   : livingroom: Unable to read frames from ffmpeg process.
2024-12-02 19:22:09.840755781  [2024-12-02 14:22:09] frigate.video                  ERROR   : livingroom: ffmpeg process is not running. exiting capture thread...
2024-12-02 19:22:15.868226409  [INFO] Starting go2rtc healthcheck service...
2024-12-02 19:22:28.287754453  [2024-12-02 14:22:28] watchdog.livingroom            ERROR   : Ffmpeg process crashed unexpectedly for livingroom.
2024-12-02 19:22:28.287758309  [2024-12-02 14:22:28] watchdog.livingroom            ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-12-02 19:22:28.287759748  [2024-12-02 14:22:28] ffmpeg.livingroom.detect       ERROR   : [h264 @ 0x55dad8ad5c40] No support for codec h264 profile 100.
2024-12-02 19:22:28.287763354  [2024-12-02 14:22:28] ffmpeg.livingroom.detect       ERROR   : [h264 @ 0x55dad8ad5c40] Failed setup for format vaapi: hwaccel initialisation returned error.
2024-12-02 19:22:28.287764670  [2024-12-02 14:22:28] ffmpeg.livingroom.detect       ERROR   : Impossible to convert between the formats supported by the filter 'Parsed_fps_0' and the filter 'auto_scale_0'
2024-12-02 19:22:28.287765669  [2024-12-02 14:22:28] ffmpeg.livingroom.detect       ERROR   : Error reinitializing filters!
2024-12-02 19:22:28.287766756  [2024-12-02 14:22:28] ffmpeg.livingroom.detect       ERROR   : Failed to inject frame into filter network: Function not implemented
2024-12-02 19:22:28.287767797  [2024-12-02 14:22:28] ffmpeg.livingroom.detect       ERROR   : Error while processing the decoded data for stream #0:0
2024-12-02 19:22:28.349984325  [2024-12-02 14:22:28] frigate.watchdog               INFO    : Detection appears to have stopped. Exiting Frigate...

Relevant go2rtc log output

none

FFprobe output from your camera

cannot keep the container alive long enough

Install method

HassOS Addon

Object Detector

OpenVino

Network connection

Wired

Camera make and model

eufy, amcreast, reolink, wyze

Screenshots of the Frigate UI's System metrics pages

none

Any other information that may be helpful

seems to be related to issue #6008

The VM is getting access to the GPU, because my plex instance from inside home assistant can do hardware decoding.
I have a pcie Coral that i can pass through to the VM and it will detect the TPU, but the ffmpeg still crashes.

[NickM-27]

Though Proxmox is not an officially supported installation method, many Proxmox users have had better luck installing Frigate as an LXC using the tteck script.

Using the VM makes it difficult because you have to virtualize the hardware for the VM and then again from the OS into docker (addon)

[artinbastani]

I set that up and it does work properly. (RIP tteck)

But, in the past, my issue with that setup is that when I'm tweaking frigate configurations and frigate doesn't load, its much easier to see the logs in home assistant and change the settings in the file editor interface than sshing into my frigate lxc and using nano. Especially when Im not at home.