Skip to main content

VibesFlow Overview

VibesFlow is the first application that enables users to create and monetize DJ sets in real-time through motion-based input. The platform continuously adapts music generation to user movement, creating unique vibestreams that respond to physical gestures and body motion.

Core Functionality

Real-Time Music Generation

VibesFlow transforms device sensor data (accelerometer and gyroscope) into musical parameters through AI interpretation:

Motion-to-Music Pipeline

Platform Architecture

Multi-Network Support

VibesFlow operates across two blockchain networks with distinct roles:

Decentralized Storage

All vibestreams are permanently stored on Filecoin through the Synapse SDK:

User Experience Flow

Key Features

Creator Mode

  • Real-time music generation from motion input
  • Automatic audio chunking and storage
  • NFT minting for vibestream ownership
  • Revenue generation through PPM (Pay-Per-Minute)

Participant Mode

  • Join existing vibestreams
  • Real-time audio streaming via SRS
  • Automated payment processing
  • Geographic proximity constraints (for group modes)

Market Integration

  • Browse all stored vibestreams
  • Preview and playback functionality
  • Subscription-based access (Metis users)
  • FilCDN-powered content delivery

Technical Stack

Frontend Technologies

  • React Native: Cross-platform mobile and web support
  • Expo: Development and deployment framework
  • TypeScript: Type-safe development

Blockchain Integration

  • NEAR SDK: RTA NFT management
  • Ethers.js: Metis Hyperion contract interaction
  • Multi-wallet support: NEAR Wallet, MetaMask

AI and Audio Processing

  • Google Lyria: Real-time music generation
  • Alith Framework: Intelligent sensor interpretation
  • Web Audio API: Client-side audio processing

Storage and CDN

  • Synapse SDK: Filecoin storage integration
  • FilCDN: Decentralized content delivery
  • Pinata: IPFS fallback storage

Development Environment

The platform supports both development and production environments with proper configuration management:

Next Steps

RTA Protocol

Understand Real-Time Assets mechanics

Vibestreams

Learn about vibestream creation and modes