Download source Description
Reality Ocean is a mixed reality piece for Apple Vision Pro, a gift for people who long for the ocean but cannot reach the coast for now. Your real room stays visible as 25 small fish, a sea turtle and jellyfish move into your everyday space, so without leaving home you can share a brief connection with a group of small lives, using your own hands.
Turn on feeding, then pinch and release to drop a single small pellet. It sinks slowly, and nearby fish gather to feed. Your hand movements also sway the fish around you, turning watching into a responsive encounter. The turtle follows a continuous swimming path while the jellyfish drift, and live fill-light controls for brightness and direction let you fine-tune how the ocean looks in your own room.
It is a native visionOS app written in Swift, with Apple RealityKit as its 3D engine, SwiftUI for the interface and ARKit for spatial and hand tracking; the schooling, hand response and feeding logic were vibe-coded with GPT 6 Astra. It is currently an interactive prototype installed and running on Vision Pro. To keep motion smooth, real-room mesh collision and occlusion are turned off in this version.
It is provided as an Xcode project in source form and needs to be signed and built yourself for a Vision Pro running visionOS 2.0 or later.
How Tripo was used
Tripo is a key source of new species for the school of fish.
- New species: the models and textures of the yellowtail damselfish and the copperband butterflyfish were generated with Tripo.
- Into Vision Pro: the assets were checked in Blender, rigged and given looping swim animations, then converted to USDZ with their UVs and PBR materials intact and brought into Apple RealityKit.
- Time saved: Tripo shortened modeling and texturing for each new species, so the author could spend more time on natural swimming, interaction feedback and on-device performance tuning.
