RTSP dropouts and RPC disconnect errors (Dahua NVR + IP cams)

[wajonespress]

I'm trying to stream four Dahua IP cameras via a Dahua NVR over RTSP, but after 60-90mins I am consistently getting simultaneous stream dropouts on all four cameras. I am then unable to stream any camera, either inside Scrypted or through external clients like HomeKit, until I manually reload the RTSP Camera plugin. HomeKit recordings and OpenCV motion detection also fail until restart.

RTSP streams remain online and stable in VLC.

These dropouts always coincide with an undefined RPC error:rpc.RPCResultError: (None, 'peer was killed')

OS: macOS 14.6 (M2 Mac mini)
Installation Method: Terminal (via Homebrew)
Device: Dahua NVR + Dahua IP cameras
Client: HomeKit
I've been problem solving this for over a week now to no avail. And every time the cameras cutout my insurance is voided.

I can't find anything on the internet about people getting this undefined RPC error inside Scrypted, and I can't see anything in my setup that looks out of the ordinary. Please help.

RPC disconnect error in the Scrypted Core log:

########################
9/25/2024, 5:32:03 PM
########################
RPCResultError: connection closed.
@scrypted/core:127.0.0.1:49285
    at RpcPeer.kill (/Users/warwickjones/.scrypted/node_modules/@scrypted/server/src/rpc.ts:439:23)
    at Socket.onDisconnected (/Users/warwickjones/.scrypted/node_modules/@scrypted/server/src/rpc-serializer.ts:35:17)
    at Socket.emit (node:events:531:35)
    at Socket.emit (node:domain:488:12)
    at TCP.<anonymous> (node:net:339:12) {
  cause: undefined
}

...And then again after restarting RTSP plugin.

########################
9/25/2024, 9:24:30 PM
########################
RPCResultError: connection closed.
@scrypted/core:127.0.0.1:50210
    at RpcPeer.kill (/Users/warwickjones/.scrypted/node_modules/@scrypted/server/src/rpc.ts:439:23)
    at Socket.onDisconnected (/Users/warwickjones/.scrypted/node_modules/@scrypted/server/src/rpc-serializer.ts:35:17)
    at Socket.emit (node:events:531:35)
    at Socket.emit (node:domain:488:12)
    at TCP.<anonymous> (node:net:339:12) {
  cause: undefined
}

All subsequent attempts by all plugins to access any RTSP streams fail, citing the RCP result error.

########################
9/26/2024, 9:48:19 AM
########################
[Video Analysis Plugin]: Video Analysis motion detection session f73a4d22 started.
[Video Analysis Plugin]: Gstreamer + OpenCV Motion Detection
[Rebroadcast Plugin]: Stream 2 active rebroadcast clients: 1
[Rebroadcast Plugin]: Stream 2 active rebroadcast clients: 0
[Video Analysis Plugin]: Video Analysis ended with error [Traceback (most recent call last):
[Video Analysis Plugin]:   File "/Users/warwickjones/.scrypted/node_modules/@scrypted/server/python/rpc.py", line 448, in handleMessage
[Video Analysis Plugin]:     value = await maybe_await(invoke(*args))
[Video Analysis Plugin]:   File "/Users/warwickjones/.scrypted/node_modules/@scrypted/server/python/rpc.py", line 20, in maybe_await
[Video Analysis Plugin]:     return await value
[Video Analysis Plugin]:   File "/Users/warwickjones/.scrypted/volume/plugins/@scrypted/opencv/zip/unzipped/detect/__init__.py", line 57, in generateObjectDetections
[Video Analysis Plugin]:     async for videoFrame in videoFrames:
[Video Analysis Plugin]:   File "/Users/warwickjones/.scrypted/node_modules/@scrypted/server/python/rpc.py", line 77, in __anext__
[Video Analysis Plugin]:     return await RpcProxyMethod(self, self.__dict__[RpcPeer.PROPERTY_PROXY_PROPERTIES]['Symbol(Symbol.asyncIterator)']['next'])()
[Video Analysis Plugin]:   File "/Users/warwickjones/.scrypted/node_modules/@scrypted/server/python/rpc.py", line 505, in createPendingResult
[Video Analysis Plugin]:     return await future
[Video Analysis Plugin]: rpc.RPCResultError: (None, 'peer was killed')
[Video Analysis Plugin]: 
[Video Analysis Plugin]: 127.0.0.1:49201:@scrypted/objectdetector] {
[Video Analysis Plugin]:   cause: undefined
[Video Analysis Plugin]: }
[Video Analysis Plugin]: Video Analysis motion detection session f73a4d22 ended.

[gewaechshaus]

Hey @wajonespress,

I got the same issues using a Eufy S3pro Cam. It's just because the stream will stop on request, cause of energy saving - it's a battery based device in my case. I think my homebase initiates that stop rtsp stream action. I am running into the same error, also with motion detection - my pi5 simply isn't fast enough to process rebroadcast and video analysis within the time the homebase keeps streaming. Damn it :)

Cheers
Jan