Rtmp to HLS with *.copy don't start

[cdgraff]

Describe the bug
When try to input from RTMP to HLS, using audio.copy and video.copy process is stuck without write any data.

% docker run -p 1935:1935 -v .:/Users/aferrari/Documents/GitHub/mi-stream-relay -v .:/tempstorage -e STATION_SLUG=tn-video savonet/liquidsoap-ci-build:rolling-release-v2.2.x_alpine_arm64 /Users/aferrari/Documents/GitHub/mi-stream-relay/video-minimal.liq
INFO: Loading Sdl_image, Target = linux
INFO: Loading Sdl_ttf, Target = linux
At /Users/aferrari/Documents/GitHub/mi-stream-relay/video-minimal.liq, line 20 char 0 - line 23 char 3:
def segment_name(~position,~extname,stream_name) =
    timestamp = int_of_float(time())
    time.string("%Y/%m/%d/%Hh/#{timestamp}.#{extname}")
end

Warning 4: Unused variable position
At /Users/aferrari/Documents/GitHub/mi-stream-relay/video-minimal.liq, line 20 char 0 - line 23 char 3:
def segment_name(~position,~extname,stream_name) =
    timestamp = int_of_float(time())
    time.string("%Y/%m/%d/%Hh/#{timestamp}.#{extname}")
end

Warning 4: Unused variable stream_name
2023/11/12 14:23:17 >>> LOG START
2023/11/12 14:23:14 [ffmpeg.filter.bitstream:3] No valid mode found for filter pgs_frame_merge!
2023/11/12 14:23:14 [main:3] Liquidsoap 2.2.2+git@3dc336b64
es=3.1.0 yaml.c=3.1.0 yaml.ffi=3.1.0 yaml.types=3.1.0 zarith=1.12
....
2023/11/12 14:23:14 [main:3] We hope you enjoy this snapshot build of Liquidsoap!
2023/11/12 14:23:14 [main:3] 
2023/11/12 14:23:14 [clock:3] Using native (high-precision) implementation for latency control
2023/11/12 14:23:17 [main:3] Standard library loaded in 2.80 seconds.
2023/11/12 14:23:17 [frame:4] frame.audio.samplerate set to: 44100
2023/11/12 14:23:17 [frame:4] frame.video.framerate set to: 25
2023/11/12 14:23:17 [frame:3] Using 44100Hz audio, 25Hz video, 44100Hz main.
2023/11/12 14:23:17 [frame:3] Video frame size set to: 1280x720
2023/11/12 14:23:17 [frame:3] Frame size must be a multiple of 1764 ticks = 1764 audio samples = 1 video samples.
2023/11/12 14:23:17 [frame:3] Targeting 'frame.duration': 0.04s = 1764 audio samples = 1764 ticks.
2023/11/12 14:23:17 [frame:3] Frames last 0.04s = 1764 audio samples = 1 video samples = 1764 ticks.
2023/11/12 14:23:17 [lifecycle:5] At stage: "Liquidsoap script parse"
2023/11/12 14:23:17 [lifecycle:5] Executing action strip types and cleanup memory (stage: after Liquidsoap script parse)
2023/11/12 14:23:17 [clock:4] Currently 2 clock(s) allocated.
2023/11/12 14:23:17 [lifecycle:5] Executing action frame settings eval (stage: after Liquidsoap script parse)
2023/11/12 14:23:17 [frame:4] frame.audio.channels set to: 2
2023/11/12 14:23:17 [frame:4] frame.video.default set to: false
2023/11/12 14:23:17 [frame:4] frame.midi.channels set to: 0
2023/11/12 14:23:17 [frame:4] frame.video.width set to: 1280
2023/11/12 14:23:17 [frame:4] frame.video.height set to: 720
2023/11/12 14:23:17 [frame:4] frame.audio.samplerate set to: 44100
2023/11/12 14:23:17 [lifecycle:5] Executing action start (stage: after Liquidsoap script parse)
2023/11/12 14:23:17 [lifecycle:5] Executing action main application before start (stage: before Liquidsoap application start)
2023/11/12 14:23:17 [lifecycle:5] Executing action sandbox start (stage: before Liquidsoap application start)
2023/11/12 14:23:17 [sandbox:3] Could not find binary bwrap, disabling sandboxing.
2023/11/12 14:23:17 [lifecycle:5] Executing action core startup (stage: before Liquidsoap application start)
2023/11/12 14:23:17 [startup:3] DSSI plugins registration: 0.00s
2023/11/12 14:23:17 [startup:3] FFmpeg filters registration: 0.01s
2023/11/12 14:23:17 [startup:3] FFmpeg bitstream filters registration: 0.00s
2023/11/12 14:23:17 [startup:3] Lilv plugins registration: 0.00s
2023/11/12 14:23:17 [startup:3] Frei0r plugin registration: 0.00s
2023/11/12 14:23:17 [startup:3] LADSPA plugins registration: 0.00s
2023/11/12 14:23:17 [startup:3] Typechecking: 2.61s
2023/11/12 14:23:17 [startup:3] Evaluation: 0.01s
2023/11/12 14:23:17 [startup:3] Typechecking: 0.02s
2023/11/12 14:23:17 [startup:3] Evaluation: 0.00s
2023/11/12 14:23:17 [startup:3] Typechecking: 0.20s
2023/11/12 14:23:17 [startup:3] Evaluation: 0.00s
2023/11/12 14:23:17 [startup:3] Loaded /Users/aferrari/Documents/GitHub/mi-stream-relay/video-minimal.liq: 0.21s
2023/11/12 14:23:17 [lifecycle:5] Executing action land_encoder initialization (stage: before Liquidsoap application start)
2023/11/12 14:23:17 [lifecycle:5] At stage: "before Liquidsoap application start"
2023/11/12 14:23:17 [lifecycle:5] Executing action main application start (stage: Liquidsoap application start)
2023/11/12 14:23:17 [clock:4] Currently 3 clock(s) allocated.
2023/11/12 14:23:17 [clock.h264_mp4toannexb.producer.child:4] Starting source(s): input.ffmpeg, h264_mp4toannexb.consumer
2023/11/12 14:23:17 [input.ffmpeg:5] Assigning source content type for frame type: {audio : ffmpeg.copy, video : ffmpeg.copy}
2023/11/12 14:23:17 [input.ffmpeg:5] Content type: {audio=ffmpeg.copy,video=ffmpeg.copy}
2023/11/12 14:23:17 [source:4] Source input.ffmpeg gets up with content type: {audio=ffmpeg.copy,video=ffmpeg.copy}.
2023/11/12 14:23:17 [input.ffmpeg:5] Activations changed: static=[input.ffmpeg], dynamic=[].
2023/11/12 14:23:17 [input.ffmpeg:5] Enabling caching mode: active source.
2023/11/12 14:23:17 [h264_mp4toannexb.consumer:5] Assigning source content type for frame type: {audio : ffmpeg.copy, video : ffmpeg.copy}
2023/11/12 14:23:17 [h264_mp4toannexb.consumer:5] Content type: {audio=ffmpeg.copy,video=ffmpeg.copy}
2023/11/12 14:23:17 [source:4] Source h264_mp4toannexb.consumer gets up with content type: {audio=ffmpeg.copy,video=ffmpeg.copy}.
2023/11/12 14:23:17 [h264_mp4toannexb.consumer:5] Clock is h264_mp4toannexb.producer.child[].
2023/11/12 14:23:17 [h264_mp4toannexb.consumer:3] Content type is {audio=ffmpeg.copy,video=ffmpeg.copy}.
2023/11/12 14:23:17 [input.ffmpeg:5] Activations changed: static=[h264_mp4toannexb.consumer:h264_mp4toannexb.consumer, input.ffmpeg], dynamic=[].
2023/11/12 14:23:17 [h264_mp4toannexb.consumer:5] Activations changed: static=[h264_mp4toannexb.consumer], dynamic=[].
2023/11/12 14:23:17 [h264_mp4toannexb.consumer:5] Enabling caching mode: active source.
2023/11/12 14:23:17 [clock.main:4] Starting source(s): buffer.consumer
2023/11/12 14:23:17 [buffer.consumer:5] Assigning source content type for frame type: {audio : ffmpeg.copy, video : ffmpeg.copy}
2023/11/12 14:23:17 [buffer.consumer:5] Content type: {audio=ffmpeg.copy,video=ffmpeg.copy}
2023/11/12 14:23:17 [source:4] Source buffer.consumer gets up with content type: {audio=ffmpeg.copy,video=ffmpeg.copy}.
2023/11/12 14:23:17 [buffer.consumer:5] Clock is main[h264_mp4toannexb.producer.child[]].
2023/11/12 14:23:17 [buffer.consumer:3] Content type is {audio=ffmpeg.copy,video=ffmpeg.copy}.
2023/11/12 14:23:17 [h264_mp4toannexb.producer:5] Assigning source content type for frame type: {audio : ffmpeg.copy, video : ffmpeg.copy}
2023/11/12 14:23:17 [h264_mp4toannexb.producer:5] Content type: {audio=ffmpeg.copy,video=ffmpeg.copy}
2023/11/12 14:23:17 [source:4] Source h264_mp4toannexb.producer gets up with content type: {audio=ffmpeg.copy,video=ffmpeg.copy}.
2023/11/12 14:23:17 [h264_mp4toannexb.producer:5] Clock is main[h264_mp4toannexb.producer.child[]].
2023/11/12 14:23:17 [h264_mp4toannexb.producer:3] Content type is {audio=ffmpeg.copy,video=ffmpeg.copy}.
2023/11/12 14:23:17 [h264_mp4toannexb.consumer:5] Activations changed: static=[h264_mp4toannexb.producer, h264_mp4toannexb.consumer], dynamic=[].
2023/11/12 14:23:17 [h264_mp4toannexb.producer:5] Activations changed: static=[buffer.consumer:buffer.consumer], dynamic=[].
2023/11/12 14:23:17 [buffer.consumer:5] Activations changed: static=[buffer.consumer], dynamic=[].
2023/11/12 14:23:17 [buffer.consumer:5] Enabling caching mode: active source.
2023/11/12 14:23:17 [threads:4] Created thread "clock_main" (1 total).
2023/11/12 14:23:17 [clock.tn-video:4] Starting source(s): tn-video
2023/11/12 14:23:17 [tn-video:5] Assigning source content type for frame type: {audio : ffmpeg.copy, video : ffmpeg.copy}
2023/11/12 14:23:17 [tn-video:5] Content type: {audio=ffmpeg.copy,video=ffmpeg.copy}
2023/11/12 14:23:17 [source:4] Source tn-video gets up with content type: {audio=ffmpeg.copy,video=ffmpeg.copy}.
2023/11/12 14:23:17 [tn-video:5] Clock is tn-video[].
2023/11/12 14:23:17 [tn-video:3] Content type is {audio=ffmpeg.copy,video=ffmpeg.copy}.
2023/11/12 14:23:17 [buffer.producer:5] Assigning source content type for frame type: {audio : ffmpeg.copy, video : ffmpeg.copy}
2023/11/12 14:23:17 [buffer.producer:5] Content type: {audio=ffmpeg.copy,video=ffmpeg.copy}
2023/11/12 14:23:17 [source:4] Source buffer.producer gets up with content type: {audio=ffmpeg.copy,video=ffmpeg.copy}.
2023/11/12 14:23:17 [buffer.producer:5] Clock is tn-video[].
2023/11/12 14:23:17 [buffer.producer:3] Content type is {audio=ffmpeg.copy,video=ffmpeg.copy}.
2023/11/12 14:23:17 [buffer.producer:5] Activations changed: static=[tn-video:tn-video], dynamic=[].
2023/11/12 14:23:17 [tn-video:5] Activations changed: static=[tn-video], dynamic=[].
2023/11/12 14:23:17 [tn-video:5] Enabling caching mode: active source.
2023/11/12 14:23:17 [threads:4] Created thread "clock_tn-video" (2 total).
2023/11/12 14:23:17 [clock:4] Main phase starts.
2023/11/12 14:23:17 [threads:4] Created thread "generic queue #1" (1 total).
2023/11/12 14:23:17 [threads:4] Created thread "generic queue #2" (2 total).
2023/11/12 14:23:17 [threads:4] Created thread "non-blocking queue #1" (3 total).
2023/11/12 14:23:17 [threads:4] Created thread "non-blocking queue #2" (4 total).
2023/11/12 14:23:17 [lifecycle:5] Executing action playlist parsers registration (stage: Liquidsoap application start)
2023/11/12 14:23:17 [lifecycle:5] Executing action srt initialization (stage: Liquidsoap application start)
2023/11/12 14:23:17 [clock.main:3] Streaming loop starts in auto-sync mode
2023/11/12 14:23:17 [clock.main:3] Delegating synchronization to CPU clock
2023/11/12 14:23:17 [clock.tn-video:3] Streaming loop starts in auto-sync mode
2023/11/12 14:23:17 [clock.tn-video:3] Delegating synchronization to CPU clock
2023/11/12 14:23:17 [lifecycle:5] Executing action SDL initialization (stage: Liquidsoap application start)
2023/11/12 14:23:17 [lifecycle:5] Executing action prometheus initialization (stage: Liquidsoap application start)
2023/11/12 14:23:17 [lifecycle:5] Executing action osc initialization (stage: Liquidsoap application start)
2023/11/12 14:23:17 [lifecycle:5] Executing action opus decoder initialization (stage: Liquidsoap application start)
2023/11/12 14:23:17 [lifecycle:5] Executing action lo initialization (stage: Liquidsoap application start)
2023/11/12 14:23:17 [lifecycle:5] Executing action ffmpeg utils initialization (stage: Liquidsoap application start)
2023/11/12 14:23:17 [lifecycle:5] Executing action video converter initialization (stage: Liquidsoap application start)
2023/11/12 14:23:17 [video.converter:3] Using preferred video converter: ffmpeg.
2023/11/12 14:23:17 [lifecycle:5] Executing action audio samplerate converter initialization (stage: Liquidsoap application start)
2023/11/12 14:23:17 [audio.converter:3] Using samplerate converter: libsamplerate.
2023/11/12 14:23:17 [lifecycle:5] At stage: "Liquidsoap application start"
2023/11/12 14:23:17 [lifecycle:5] Executing action thread start (stage: after Liquidsoap application start)
2023/11/12 14:23:17 [lifecycle:5] Executing action main loop (stage: after Liquidsoap application start)
2023/11/12 14:23:17 [lifecycle:5] At stage: "before Liquidsoap main loop"
2023/11/12 14:23:17 [lifecycle:5] Executing action main application main loop (stage: Liquidsoap main loop)
2023/11/12 14:23:17 [video.text:3] Using sdl implementation
2023/11/12 14:23:21 [decoder.ffmpeg:3] Requested content-type for format: "live_flv", uri: "rtmp://server.com/app/stream": {audio=ffmpeg.copy,video=ffmpeg.copy}
2023/11/12 14:23:21 [decoder.ffmpeg:3] FFmpeg recognizes "rtmp://server.com/app/stream" as audio: {codec: aac, 44100Hz, 2 channel(s)}, video: {codec: h264, 1280x720, yuv420p}
2023/11/12 14:23:21 [decoder.ffmpeg:3] Decoded content-type for "rtmp://server.com/app/stream": {audio=ffmpeg.copy(codec="aac",channel_layout="stereo",sample_format=fltp,sample_rate=44100),video=ffmpeg.copy(codec="h264",width=1280,height=720,aspect_ratio=1/1,pixel_format=yuv420p)}
2023/11/12 14:23:21 [input.ffmpeg:5] Got metadata at position 0: calling handlers...

Nothing more after that line of code...

To Reproduce

log.level.set(5)

storage_dir         = environment.get(default="/tmp", "STORAGE_DIR")
station_slug        = environment.get(default="stream", "STATION_SLUG")

relay = input.rtmp("rtmp://server.com/app/stream", listen=false)
relay = ffmpeg.filter.bitstream.h264_mp4toannexb(relay)

mpegts = %ffmpeg(
    format="mpegts",
    fflags="-autobsf",
    %audio.copy(wait_for_keyframe), 
    %video.copy(wait_for_keyframe)
    )

streams = [
  ("#{station_slug}",mpegts),
]

def segment_name(~position,~extname,stream_name) =
    timestamp = int_of_float(time())
    time.string("%Y/%m/%d/%Hh/#{timestamp}.#{extname}")
end

def on_file_change(~state,fname) =
    if state == "created" and file.extension(fname) != '.m3u8' then
      log.important(label="#{station_slug}", "Segment #{fname} created")
    end
end
  
  # HLS source, with its own clock:
  hls_source = buffer(relay)
  clock.assign_new(id="#{station_slug}", [hls_source])

  output.file.hls(id="#{station_slug}",
                  playlist="main.m3u8",
                  temp_dir="#{storage_dir}",
                  fallible=true,
                  segment_duration=29.0,
                  segments=5,
                  segments_overhead=100,
                  segment_name=segment_name,
                  on_file_change=on_file_change,
                  persist_at="#{storage_dir}/#{station_slug}/state.config",
                  "#{storage_dir}/#{station_slug}",
                  streams,
                  hls_source)

Expected behavior
Changing:

relay = ffmpeg.filter.bitstream.h264_mp4toannexb(relay)

mpegts = %ffmpeg(
    format="mpegts",
    fflags="-autobsf",
    %audio.copy(wait_for_keyframe), 
    %video.copy(wait_for_keyframe)
    )

To:

mpegts = %ffmpeg(
    format="mpegts",
    fflags="-autobsf",
    %audio(codec="aac",b="64k"),
    %video(codec="libx264",b="1500k",width=1280,height=720,"x264-params"="scenecut=0:open_gop=0:min-keyint=25:keyint=25",preset="ultrafast")
    )

Version details
Docker container rolling release

[toots]

Hi @cdgraff ! Are you able to share the RTMP url privately so I can try & test it locally?

[cdgraff]

Hi @toots yes is the same I shared before in discord DM I'm Alex

[toots]

When in doubt, always leave the default options! Based on my local tests, this should work:

log.level.set(5)

storage_dir         = environment.get(default="/tmp", "STORAGE_DIR")
station_slug        = environment.get(default="stream", "STATION_SLUG")

relay = input.rtmp("rtmp://server.com/app/stream", listen=false)

mpegts = %ffmpeg(
    format="mpegts",
    %audio.copy, 
    %video.copy
    )

streams = [
  ("#{station_slug}",mpegts),
]

def segment_name(~position,~extname,stream_name) =
    timestamp = int_of_float(time())
    time.string("%Y/%m/%d/%Hh/#{timestamp}.#{extname}")
end

def on_file_change(~state,fname) =
    if state == "created" and file.extension(fname) != '.m3u8' then
      log.important(label="#{station_slug}", "Segment #{fname} created")
    end
end
  
  # HLS source, with its own clock:
  hls_source = buffer(relay)
  clock.assign_new(id="#{station_slug}", [hls_source])

  output.file.hls(id="#{station_slug}",
                  playlist="main.m3u8",
                  temp_dir="#{storage_dir}",
                  fallible=true,
                  segment_duration=29.0,
                  segments=5,
                  segments_overhead=100,
                  segment_name=segment_name,
                  on_file_change=on_file_change,
                  persist_at="#{storage_dir}/#{station_slug}/state.config",
                  "#{storage_dir}/#{station_slug}",
                  streams,
                  hls_source)

[cdgraff]

OK thanks!

That setting I get from here:
https://www.liquidsoap.info/doc-dev/ffmpeg_cookbook.html

Reading I understand that is for specific use case, but is that documentation updated? and still recommended?