Lua Multimedia Scripting

Overview

• Project: Media Pipeline Research
• Status: Active — evaluating Lua as multimedia glue language
• Core Concept: Lua handles logic/timing/orchestration while C/C++ handles heavy compute

Architecture: “The Glue Language”

• C/C++ layer: Heavy math, hardware interaction (fast but complex)
• Lua layer: Logic, timing, orchestration (slower but easy to modify)

Frameworks and Libraries

LOVE 2D (Game Framework)

Most popular “Lua + SDL2” integration. Abstracts complex audio/video calls into simple functions:

function love.load()
    music = love.audio.newSource("theme.mp3", "stream")
    music:play()
end

LuaAV

Integrated environment extending Lua for real-time audiovisual composition and processing.

VLC Media Player

Lua extensions for playlist parsing, subtitle downloading, and media automation without recompiling the core application.

Ardour (DAW)

Lua macros for batch audio processing — export 50 tracks with specific naming and normalization via script loops.

Key Technical Advantages

Feature	Benefit
LuaJIT	JIT compilation fast enough for real-time audio DSP
Hot Reloading	Change code while program runs — vital for creative coding
FFI / C-Bindings	Direct access to C libraries without wrapper overhead

Comparison of Approaches

Approach	Best For	Complexity
Game Engines (LOVE, Defold)	Interactive art, physics sims	Low
Embedded/Scripting (VLC, Ardour)	Automation, batch processing	Medium
FFI / C-Bindings (LuaJIT, MoonLibs)	Custom engines, high-performance	High

Related

• remotion — Code-driven video production
• kdenlive-workflows — NLE editing workflows