Stack Overflow
Stack Overflow

Questions tagged [realitykit]

Apple RealityKit is a high-level framework that helps a developer to load and render AR/VR models with PBR shaders, animations and physics simulations for iOS, visionOS and macOS apps.

RealityKit is an Apple framework for building, animating and rendering 3D scenes. It was introduced at WWDC 2019 for iOS and macOS, and at WWDC 2023 for visionOS. RealityKit allows us implement a high-performance life-like 3D simulation, or fulfil a physically based rendering for its companion – and frameworks – to seamlessly integrate virtual objects into the real world.

RealityKit was built from the ground up for Augmented Reality apps, and it shines with and . Using this framework you can asynchronously load assets in .usdz and .reality formats, or in .rcproject format that stores compositions of app. Starting from Xcode 15, there will be the Reality Composer Pro app.

References

795 questions
11
votes
2 answers

Scanning Real-World Object and generating 3D Mesh from it

ARKit app allows us to create an ARReferenceObject, and using it, we can reliably recognize the position and orientation of the real-world objects. But also we can save the finished .arobject file. However, ARReferenceObject contains only the…
Andy Jazz
  • 49,178
  • 17
  • 136
  • 220
10
votes
1 answer

ARKit – Tap node with raycastQuery instead of hitTest, which is deprecated

In iOS 14, hitTest(_:types:) was deprecated. It seems that you are supposed to use raycastQuery(from:allowing:alignment:) now. From the documentation: Raycasting is the preferred method for finding positions on surfaces in the real-world…
aheze
  • 24,434
  • 8
  • 68
  • 125
10
votes
2 answers

Add UIImage as texture to a Plane in RealityKit

I was trying out the new RealityKit framework in swift and I want to place a 2D image in on an ARAnchor. I managed to create a mesh plane and I tried to add the image as a texture to this plane. I found out that I can give a local image to a…
batabek
  • 103
  • 3
  • 7
10
votes
1 answer

ARKit – Replicating robot character in Motion Capture RealityKit

I'm trying to make a 3d model like robot provided by Apple in Motion Capture example (shown at WWDC 2019) which can mimic me in motion capture ARKit 3.0 by replacing robot character given by Apple. Desired Solution: Is there any special software…
Ameer Hamza
  • 103
  • 7
10
votes
4 answers

3D model formats in ARKit / ARCore development

I am a beginner at AR game development for both iOS and Android. I have the following questions: What kinds of 3D model formats are supported by ARKit for iOS and ARCore for Android respectively? (I tried .dae and .obj are supported by ARkit, not…
Funny LI
  • 333
  • 1
  • 3
  • 8
9
votes
1 answer

ARKit and RealityKit - ARSessionDelegate is retaining 14 ARFrames

I am classifying images per frame from ARSession delegate by Vision framework and CoreML in an Augmented Reality app, with ARKit and RealityKit. While processing a frame.capturedImage I am not requesting another frame.capturedImage for…
Tanvirgeek
  • 540
  • 1
  • 9
  • 17
9
votes
2 answers

How do I rotate an object around only one axis in RealityKit?

I'm trying to rotate a cube around its z-axis but I can't find how. Is there a way in RealityKit to do this?
Robbe Verhoest
  • 401
  • 4
  • 9
9
votes
1 answer

How to improve People Occlusion in ARKit 3.0

We are working on a demo app using people's occlusion in ARKit. Because we want to add videos in the final scene, we use SCNPlanes to render the video using a SCNBillboardConstraint to ensure they are facing the right way. These videos are also…
vrwim
  • 13,020
  • 13
  • 63
  • 118
8
votes
1 answer

Why does RealityKit memory does not clear after deinit called?

I cannot manage to release my RealityKit ARView() from memory. I am aware that there were similar issues with ARKit + SceneKit with workarounds which doesn't solve my problem, unfortunately. The solutions above kind of work by removing everything…
Chirag Shah
  • 3,034
  • 1
  • 30
  • 61
8
votes
2 answers

Realitykit - Custom Material

Using Realitykit, trying to change the material of moon Entity to a custom .jpg and then tapping the screen to spawn that object based off hitTest. Nothing shows up when I tap and getting the following error in debug: [Collision] Bad paramater…
Lawlitrix
  • 81
  • 3
8
votes
4 answers

RealityKit - Animate opacity of a ModelEntity?

By setting the color of a material on the model property of a ModelEntity, I can alter the opacity/alpha of an object. But how do you animate this? My goal is to animate objects with full opacity, then have them fade to a set opacity, such as…
ColdLogic
  • 7,206
  • 1
  • 28
  • 46
8
votes
5 answers

Is there any way to load FBX file using ARKit?

In my project I'm positioning 3d files using ARKit. I'm able to load .dae and .obj format models. Is there any way I could load .fbx files?
vineeth s thayyil
  • 436
  • 4
  • 16
7
votes
1 answer

3D artwork that is exported as USDZ has different colors

I want to start by saying that I am new to SceneKit and playing with AR environments on iOS. I have a 3D model object, a van, as part of a Blender file(.blend) --> it can be found here. I am exporting it as a .glb file from Blender --> it can be…
Laur Stefan
  • 1,519
  • 5
  • 23
  • 50
7
votes
2 answers

Why so many debug error using ARKit and RealityKit?

On my project I simply wrapped a ARView, setup a configuration and run it on my real device, when I start the app Xcode print out the following error debug message. 2021-10-08 17:59:06.476537+0800 RealityKit_Shell[8247:2500396] Metal GPU Frame…
Damiano Miazzi
  • 1,514
  • 1
  • 16
  • 38
7
votes
1 answer

Is there any way to export Point Cloud data from LiDAR iOS14?

I am new for Metal and ARkit. I started learning about Lidar and scene’s depth data to visualize the shape. Below is the link for the point cloud sample code provided by Apple…
AnilG
  • 101
  • 1
  • 3
1
2
3
…
52 53