plugin-freedom-system
π‘ Summary
An AI-assisted system for creating VST3 and AU audio plugins through conversational design.
π― Target Audience
π€ AI Roast: βPowerful, but the setup might scare off the impatient.β
Risk: Medium. Review: shell/CLI command execution; outbound network access (SSRF, data egress); API keys/tokens handling and storage. Run with least privilege and audit before enabling in production.
Plugin Freedom System
An AI-assisted JUCE plugin development system that enables conversational creation of professional VST3 and AU audio plugins for macOS. Design and build custom audio processors through natural dialogue with Claude Codeβno programming experience required.
Created by TΓCHES
Why This Exists
Traditional plugin development demands deep expertise in C++, DSP algorithms, and the JUCE framework. This barrier keeps plugin creation restricted to experienced programmers, leaving musicians, producers, and sound designers dependent on commercial tools.
The Plugin Freedom System removes that barrier entirely.
By enabling conversational plugin development, this system:
- Democratizes creation: Anyone with an idea can build it, regardless of technical background
- Prioritizes creativity: Focus on sonic goals and UX, not implementation details
- Accelerates iteration: Ideas become working plugins in hours, not weeks
- Removes gatekeeping: Opens audio software development to the people who actually use these tools
What You Can Build
- Effects: Reverbs, delays, distortion, modulation, filters, dynamics processors
- Synthesizers: Subtractive, FM, wavetable, granular, additive
- Utilities: Analyzers, meters, routing tools, MIDI processors
- Experimental: Custom DSP algorithms, hybrid processors, generative tools
All plugins compile to native VST3/AU formats compatible with any DAW (Ableton, Logic, Reaper, etc.).
How It Works
1. Dream (/dream)
Brainstorm your plugin concept through conversation:
- Creative brief - Vision, sonic goals, UX principles
- Parameter specification - All controls, ranges, and mappings
- UI mockups - Visual design and layout
2. Plan (/plan)
Research and design the technical architecture:
- DSP architecture - Signal flow and processing strategy
- Implementation plan - Technical approach and complexity analysis
3. Implement (/implement)
Transform your specifications into a fully functional plugin through an automated workflow:
- Build System Ready (Stage 1): Project structure, CMake configuration, and all parameters implemented - validated automatically
- Audio Engine Working (Stage 2): DSP algorithms and audio processing complete - validated automatically
- UI Integrated (Stage 3): WebView interface connected to audio engine (or skip for headless plugins) - validated automatically with runtime tests
- After Stage 3 validation passes: Plugin complete, ready to install
4. Deploy & Iterate
/install-plugin- Install to system folders for DAW use/test- Run automated validation suite/improve- Add features or fix bugs (with regression testing)/reconcile- Reconcile state between planning and implementation
Modern Interface Design
Plugins use web-based interfaces (HTML/CSS/JS) rendered via JUCE's WebView instead of traditional GUI frameworks. This enables:
- Rapid prototyping: See design changes instantly without rebuilding
- Modern aesthetics: Leverage contemporary web design patterns and animations
- Interactive mockups: Test and refine interfaces before implementation
- Familiar tools: Use web technologies many creators already understand
- Responsive layouts: Easily adapt UIs to different sizes and contexts
GUI-Optional Workflow
Plugins can skip custom UI and ship as "headless" plugins using DAW-provided controls:
- Faster iteration: Test DSP immediately without waiting for UI implementation
- Progressive enhancement: Add custom UI later via
/improve - Flexibility: Decide when/if to build visual interface
- Zero overhead: Smaller binary, faster compile, all parameters exposed to DAW
Key Features
Automated Build Pipeline
7-phase build system (scripts/build-and-install.sh) handles validation, compilation, installation, and verification. No manual CMake commands or Xcode configuration required.
Quality Assurance
- Automatic validation after each stage (compile-time + runtime tests)
- validation-agent runs pluginval automatically (VST3/AU validation)
- Validation is blocking - errors must be fixed before progressing
- Regression testing on modifications
- Backup verification before destructive operations
- Build failure detection and troubleshooting
Knowledge Base
Dual-indexed troubleshooting database (troubleshooting/) captures solutions to build failures, runtime issues, GUI problems, and API misuse. The system learns from every problem encountered.
Required Reading (juce8-critical-patterns.md) automatically prevents repeat mistakes by injecting proven patterns into all subagent contexts.
Graduated Research Protocol
3-level investigation system (/research) for complex problems:
- Quick: Single-agent targeted investigation (1-2 min)
- Moderate: Multi-agent parallel search (3-5 min)
- Deep: Comprehensive multi-level analysis (5-10 min)
Version Management
- Semantic versioning on improvements
- Git-based state tracking
- Safe rollback capabilities
- Backup verification before destructive operations
Workflow Modes
- Manual mode (default): Present decision menus at each checkpoint for full control
- Express mode: Auto-progress through implementation stages without intermediate menus
- Configurable: Set preferences in
.claude/preferences.jsonor use--express/--manualflags - Safe: Express mode drops to manual on any error, ensuring oversight when needed
Lifecycle Management
/install-plugin- Deploy to system folders/uninstall- Remove binaries (keep source)/reset-to-ideation- Roll back to concept stage/destroy- Complete removal with verified backup/clean- Interactive cleanup menu
System Architecture
Contracts (Single Source of Truth)
Every plugin has immutable contracts in plugins/[Name]/.ideas/:
creative-brief.md- Vision, sonic goals, UX principlesparameter-spec.md- Complete parameter definitionsarchitecture.md- DSP design and signal flowplan.md- Implementation strategyui-mockups/- Visual design references
Zero drift: All stages reference the same specs. No "telephone game" across workflows.
Dispatcher Pattern
Each implementation stage runs in a fresh subagent context:
foundation-shell-agent(Stage 1) - Project structure and parameter managementdsp-agent(Stage 2) - Audio processinggui-agent(Stage 3) - WebView UIvalidation-agent(after each stage) - Automatic validation with runtime tests
No context accumulation: Clean separation prevents cross-contamination and keeps token usage minimal.
Discovery Through Play
All features discoverable via:
- Slash command autocomplete (type
/in Claude Code) - Numbered decision menus at checkpoints
- Interactive skill prompts
No manual required: Learn by exploring, not reading docs.
Checkpoint Protocol
At every completion point:
- Auto-commit changes
- Update state files (
.continue-here.md,PLUGINS.md) - Present numbered decision menu
- Wait for user response
- Execute chosen action
Never auto-proceeds: You stay in control.
Quick Start
Prerequisites
- macOS (Sonoma or later recommended)
- Claude Code CLI
All other dependencies (Xcode Command Line Tools, JUCE, CMake, Python, pluginval) can be validated and installed via /setup.
First-Time Setup
# Validate and configure your system dependencies /setup # The setup wizard will: # - Detect your platform and installed tools # - Offer to install missing dependencies automatically or guide manual installation # - Save configuration for build scripts # - Generate a system report
Create Your First Plugin
# 1. Dream the concept /dream # Brainstorm your plugin idea through conversation # Creates: creative brief, parameter spec, UI mockups # 2. Plan the architecture /plan # Research and design the technical implementation # Creates: DSP architecture, implementation plan # 3. Build it /implement # Automated workflow builds the plugin # 4. Install and test /install-plugin YourPluginName # Plugin now available in your DAW
Improve an Existing Plugin
# Fix bugs or add features /improve MyPlugin # Describe the change # System handles versioning, testing, and rollback safety
Resume Interrupted Work
# Pick up where you left off /continue MyPlugin # System loads checkpoint and presents next steps
Complete Command Reference
Setup
/setup- Validate and configure system dependencies (first-time setup)- Detects platform, checks for required tools
- Offers automated installation or guided manual setup
- Saves configuration to
.claude/system-config.json
Development Workflow
/dream- Brainstorm concept, create creative brief, parameter spec, and UI mockups/plan- Research and design DSP architecture and implementation strategy/implement [Name]- Build plugin through automated 3-stage workflow with continuous validation/continue [Name]- Resume paused workflow/improve [Name]- Modify completed plugin (with regression testing)
Quality Assurance
/test [Name]- Run automated validation suite/research [topic]- Deep investigation (3-level protocol)/doc-fix- Document solved problems for knowledge base/add-critical-pattern- Add current problem to Required Reading
Deployment
/install-plugin [Name]- Install to system folders/uninstall [Name]- Remove binaries (keep source)/show-standalone [Name]- Preview UI in standalone mode
Lifecycle
/clean- Interactive cleanup menu (uninstall/reset/destroy)/reconcile [Name]- Reconcile state between
Pros
- Democratizes plugin creation for non-programmers
- Accelerates development with automated workflows
- Supports modern web technologies for UI design
- Comprehensive validation and testing processes
Cons
- Requires macOS, limiting accessibility
- Steep learning curve for complete beginners
- Dependency on Claude Code CLI might deter some users
- Potential complexity in managing plugin versions
Related Skills
pytorch
SβIt's the Swiss Army knife of deep learning, but good luck figuring out which of the 47 installation methods is the one that won't break your system.β
agno
SβIt promises to be the Kubernetes for agents, but let's see if developers have the patience to learn yet another orchestration layer.β
nuxt-skills
SβIt's essentially a well-organized cheat sheet that turns your AI assistant into a Nuxt framework parrot.β
Disclaimer: This content is sourced from GitHub open source projects for display and rating purposes only.
Copyright belongs to the original author glittercowboy.
