Skip to content
JT5D edited this page Nov 11, 2023 · 12 revisions

AR VR XR AI code, learning & research

VisionOS, iOS, ARfoundation, Oculus, ChatGPT, OpenCV, ML

#Our interest lies at the intersection of virtual & real, mind & matter, imagination & manifestation and the New possibilities for collaborative creativity, education & problem solving Radical new forms of storytelling & data visualization Magic & play made possible by AR, VR, XR & AI a438ce65-b962-4ac6-aaf7-2d66373e2039-1

THIS REPO IS STILL UNDER CONSTRUCTION

Spatial computing is THE next major paradigm shift

Moving from tiny screens to VR to AR to R(eality) Broadening horizons & augmenting life and Transforming us & the universe forever. 282232367-6ec3583f-4422-40a3-b105-a16013c8b985

Apple Vision Pro Headset

Apple Vision Pro is a groundbreaking AR headset.
Watch Overview Video

Pricing and Availability: Starting at $3,499, available early next year in the U.S.
More details

Get Started

Apply for Apple Vision Pro developer kit

https://developer.apple.com/visionos/developer-kit/Apple Vision Pro developer kit Have an innovative idea for an app or game for visionOS that requires building and testing on Apple Vision Pro? Apply for an Apple Vision Pro developer kit. This kit will help you deliver amazing spatial experiences by letting you quickly build, iterate, and test on Vision Pro.

Apply for Unity Polyspatial Beta

https://create.unity.com/spatial UNITY’S BETA PROGRAM FOR CREATING SPATIAL EXPERIENCES Get started with spatial creation Be the first to create for Apple’s visionOS platform Unity is excited to collaborate with Apple to bring familiar and powerful authoring tools for creating immersive games and apps for this new spatial computing platform, Apple Vision Pro. Your apps will get access to benefits such as pass-through and Dynamic Foveated Rendering, in addition to popular Unity features like AR Foundation and XR Interaction Toolkit.

VisionOS

VisionOS Interface
The operating system for Apple Vision Pro. Use visionOS with familiar tools to build immersive apps and games.

Features

  • Windows: Create with SwiftUI, add 3D content.
  • Volumes: Use RealityKit or Unity for 3D experiences.
  • Spaces: Shared Space for side-by-side apps, Full Space for immersive experiences.

Developing for visionOS: Requires a Mac with Apple silicon.
Get started with visionOS

Overview Developing for visionOS requires a Mac with Apple silicon. Create new apps using SwiftUI to take full advantage of the spectrum of immersion available in visionOS. If you have an existing iPad or iPhone app, add the visionOS destination to your app’s target to gain access to the standard system appearance, and add platform-specific features to create a compelling experience. To provide continuous access to your content in the meantime, deliver a compatible version of your app that runs in visionOS.

Expand your app into immersive spaces Start with a familiar window-based experience to introduce people to your content. From there, add SwiftUI scene types specific to visionOS, such as volumes and spaces. These scene types let you incorporate depth, 3D objects, and immersive experiences.

Build your app’s 3D content with RealityKit and Reality Composer Pro, and display it with a RealityView. In an immersive experience, use ARKit to integrate your content with the person’s surroundings.

People can select an element by looking at it and tapping their fingers together. They can also pinch, drag, zoom, and rotate objects using specific hand gestures. SwiftUI provides built-in support for these standard gestures, so rely on them for most of your app’s input. When you want to go beyond the standard gestures, use ARKit to create custom gestures. Screenshot 2023-11-11 at 4 52 07 AM

##Dive into Apple's code examples These run XCode & Simulator with no need for a device yet. Dive into featured sample apps Explore the core concepts for all visionOS apps with Hello World. Understand how to detect custom gestures using ARKit with Happy Beam. Discover streaming 2D and stereoscopic media with Destination Video. And learn how to build 3D scenes with RealityKit and Reality Composer Pro with Diorama and Swift Splash.

Hello World Use windows, volumes, and immersive spaces to teach people about the Earth. Hello-World-intro@2x

Destination Video Leverage 3D video and Spatial Audio to deliver an immersive experience. Destination-Video-intro@2x

Happy Beam Leverage a Full Space to create a fun game using ARKit. Happy-Beam-intro@2x

Diorama Design scenes for your visionOS app using Reality Composer Pro. Diorama-intro@2x

Swift Splash Use RealityKit to create an interactive ride in visionOS. Swift-Splash-intro@2x

##Create immersive Unity apps Explore how you can use Unity to create engaging and immersive experiences for visionOS. We'll share how Unity integrates seamlessly with Apple frameworks, take you through the tools you can use to build natively for the platform, and show you how volume cameras can bring your existing scenes into visionOS windows, volumes, and spaces. Discover how to incorporate visionOS features like passthrough and scene understanding, customize your visuals with Shader Graph, and adapt your interactions to work with spatial input. https://developer.apple.com/videos/play/wwdc2023/10088

Principles of spatial design

Discover the fundamentals of spatial design. Learn how to design with depth, scale, windows, and immersion, and apply best practices for creating comfortable, human-centered experiences that transform reality. Find out how you can use these spatial design principles to extend your existing app or bring a new idea to life.

skinned-mesh-sampling-example banner001

Demo 68747470733a2f2f692e696d6775722e636f6d2f546b31496c4f622e676966

1_wv65L5KTi2kKjItLat-JvA

https://github.com/imclab/Vision-PRO-AR-VR-XR-AI/assets/391299/cd42ae1d-d4c4-432f-ab17-a6405a279280 shared-spaces~dark@2x

ntugrid_neg

1_EFbxxoPRymjGCYUshrrvcQ 1_iiLBjfJiyR2pTv8AWCUx9A

overview@2x

Left-aligned Right-aligned
toppng com-instagram-logo-icon-social-media-icon-png-and-vector-make-money-on-instagram-quick-start-guide-small
Untitled

https://discord.gg/6QkcjWkT3P

images

### Video Tutorials

Left-aligned Right-aligned
git status git status
git diff git diff
hqdefault(38) hqdefault(38)
hqdefault(38) hqdefault(37)
hqdefault(36) hqdefault(35)
hqdefault(33) hqdefault(32)
hqdefault(31) hqdefault(30)
hqdefault(29) hqdefault(28)
hqdefault(27) hqdefault(26)
hqdefault(25) hqdefault(24)
hqdefault(23)
hqdefault(22)
hqdefault(21)
hqdefault(20)
hqdefault(19)
hqdefault(18)
hqdefault(17)
hqdefault(16)
hqdefault(15)
hqdefault(14)
Clone this wiki locally