VibesFlow Overview
VibesFlow is the first application that enables users to create and monetize DJ sets in real-time through motion-based input. The platform continuously adapts music generation to user movement, creating unique vibestreams that respond to physical gestures and body motion.Core Functionality
Real-Time Music Generation
VibesFlow transforms device sensor data (accelerometer and gyroscope) into musical parameters through AI interpretation:Motion-to-Music Pipeline
Platform Architecture
Multi-Network Support
VibesFlow operates across two blockchain networks with distinct roles:| Network | Purpose | Contracts |
|---|---|---|
| NEAR | RTA NFT creation | rtav2 contract |
| Metis Hyperion | Monetization & PPM | VibeFactory, PPM, Subscriptions |
Decentralized Storage
All vibestreams are permanently stored on Filecoin through the Synapse SDK:User Experience Flow
Key Features
Creator Mode
- Real-time music generation from motion input
- Automatic audio chunking and storage
- NFT minting for vibestream ownership
- Revenue generation through PPM (Pay-Per-Minute)
Participant Mode
- Join existing vibestreams
- Real-time audio streaming via SRS
- Automated payment processing
- Geographic proximity constraints (for group modes)
Market Integration
- Browse all stored vibestreams
- Preview and playback functionality
- Subscription-based access (Metis users)
- FilCDN-powered content delivery
Technical Stack
Frontend Technologies
- React Native: Cross-platform mobile and web support
- Expo: Development and deployment framework
- TypeScript: Type-safe development
Blockchain Integration
- NEAR SDK: RTA NFT management
- Ethers.js: Metis Hyperion contract interaction
- Multi-wallet support: NEAR Wallet, MetaMask
AI and Audio Processing
- Google Lyria: Real-time music generation
- Alith Framework: Intelligent sensor interpretation
- Web Audio API: Client-side audio processing
Storage and CDN
- Synapse SDK: Filecoin storage integration
- FilCDN: Decentralized content delivery
- Pinata: IPFS fallback storage