Studio Overview

Introduction to the MP4E Studio video editor interface.

Introduction

MP4E Studio is a web-based video editor for creating interactive videos. It provides tools for:

  • AI-powered object detection - Automatically detect and track objects
  • Manual object editing - Refine polygons, merge objects, create groups
  • Overlay creation - Add interactive elements at specific positions
  • Plugin configuration - Build custom plugins with HTML/CSS/JS
  • Rule-based interactivity - Define triggers, conditions, and actions
  • Variable management - Create and manage dynamic state
  • Export & embed - Generate embeddable videos with metadata

Interface Overview

The Studio interface is divided into four main areas:

Interface layout
┌────────────────────────────────────────────────────────────────────────┐
│  Header: Project name, View Mode, Preview toggle, Save, Export         │
├──────────────┬───────────────────────────────────┬─────────────────────┤
│              │                                   │                     │
│   Library    │                                   │    Inspector /      │
│   Panel      │         Video Preview             │    Player Panel     │
│              │                                   │                     │
│  [Tabs:]     │      (Interactive preview         │    Inspector:       │
│  - Projects  │       with overlays)              │    - Object props   │
│  - Overlays  │                                   │    - Data fields    │
│  - Plugins   │                                   │    - Group settings │
│              │                                   │    - Actions        │
│  [Entities:] │                                   │                     │
│  - Objects   │                                   │    Player:          │
│  - Scenes    │                                   │    - Controls skin  │
│  - Groups    │                                   │    - Markers        │
│  - AI Scan   │                                   │    - Thumbnails     │
│              │                                   │                     │
├──────────────┴───────────────────────────────────┴─────────────────────┤
│                          Timeline                                       │
│  ├────────────────────────────────────────────────────────────────────┤│
│  │ Frame: 125/3000  │  00:05.00 / 02:00.00  │  ▶ ◀◀ ▶▶  │  🔊  │     ││
│  ├────────────────────────────────────────────────────────────────────┤│
│  │████████░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░││
│  │  Object tracks: ═══════════     ════════════════     ═══          ││
│  └────────────────────────────────────────────────────────────────────┘│
└────────────────────────────────────────────────────────────────────────┘

Library Panel (Left)

Browse project content: Projects (settings, events, variables), Overlays, and Plugins. The Entities section contains Objects, Scenes, Groups, and AI Scan.

Video Preview (Center)

Interactive preview showing the video with overlays, object tracking, and interactions rendered in real-time.

Right Panel (Context)

Switches between Inspector (object/overlay properties) and Player Panel (controls, markers, thumbnails).

Timeline (Bottom)

Navigate through frames, view object presence, and control playback. Scrub to see objects at different times.

Typical Workflow

  1. Upload & Process Video

    Upload your video and run AI processing to detect objects automatically.

  2. Review & Refine Objects

    Review detected objects, merge duplicates, refine polygon boundaries, and add custom labels.

  3. Create Object Groups

    Group related objects (e.g., all products, all people) for easier management.

  4. Add Overlays & Plugins

    Create interactive overlays attached to objects or at fixed positions.

  5. Configure Interactivity

    Set up variables, define rules, and create interactive experiences.

  6. Preview & Test

    Test interactions in the preview panel. Iterate on the design.

  7. Export & Deploy

    Export the video with embedded metadata. Get the embed code.

Panel Reference

Library Panel Tabs

TabDescription
ProjectsProject settings, global events/actions, and variable definitions
OverlaysCreate and manage overlays organized by layer
PluginsCustom plugins library - create, edit, import from marketplace

Entities Section (within Library)

TabDescription
ObjectsList of tracked objects with labels, frame ranges, and visibility
ScenesScene groups and individual scenes for navigation and chapters
GroupsObject groups with shared display settings and data schemas
AI ScanInteractive object detection using SAM (Segment Anything Model)

Inspector Panel (Right)

When SelectedShows
ObjectLabel, group assignment, custom data fields, frame range
OverlayPosition, size, layer, visibility, plugin config, event actions
GroupDisplay settings (hover/click behavior), data schema definition

Player Panel (Right)

SectionDescription
PlaybackAutoplay, loop settings
ControlsEnable/disable controls, select controls skin plugin
InteractionsClick and double-click behavior on video
Menu ConfigSettings menu items, visibility, and position
Chapter MarkersEnable markers from scene groups, choose progress bar style
ThumbnailsGenerate and configure thumbnail preview sprites

Keyboard Shortcuts

ShortcutAction
SpacePlay/Pause
/ Previous/Next frame
Shift + / Jump 10 frames
Home / EndGo to start/end
Cmd/Ctrl + SSave project
Cmd/Ctrl + ZUndo
Cmd/Ctrl + EExport video
DeleteDelete selected
GGroup selected objects
OCreate overlay
PToggle polygon editor

Getting Started

Ready to create your first interactive video? Follow these guides: