Fun Moves
Augmented Reality APP, 2021
​
​
Individual Project
​
Category: APP Development, Motion Capture, Rigging
Coding Language: Swift
Creative Tools: ARkit, RealityKit, Blender, After Effects
​
Fun moves is a fun AR APP that allows the player to puppeteer a virtual character, accompanied by fun visual effects, animations, and sounds as the person goes harder on his/her movements. ​
APP Mechanism
Body Detection
Once ARkit detects player's body, the virtual character is added to the scene, meanwhile reading player's full body joints data
Joint Data Analysis & Puppeteer
Send player's joints data to virtual character for real-time puppeteering, while analyze distance between different body parts, etc the head, the hands and the feets
Visual & Sound Effects Triggering
Three levels of thresholds are set based on how actively the player is moving, each level contains different assets of sound and visual effects, triggered when the player reaches the threshold
Design Process
-
Create Assets
character rigging
character texturing
visual effects animation
2. Code Architecture
CI filter integration
3. Interaction Design
choose virtual character from asset
record screen video & audio
reset target player
character display
User Flow
open the APP
point to a friend
choose virtual character
have fun!