Stack Overflow
Stack Overflow

Questions tagged [realitykit]

Apple RealityKit is a high-level framework that helps a developer to load and render AR/VR models with PBR shaders, animations and physics simulations for iOS, visionOS and macOS apps.

RealityKit is an Apple framework for building, animating and rendering 3D scenes. It was introduced at WWDC 2019 for iOS and macOS, and at WWDC 2023 for visionOS. RealityKit allows us implement a high-performance life-like 3D simulation, or fulfil a physically based rendering for its companion – and frameworks – to seamlessly integrate virtual objects into the real world.

RealityKit was built from the ground up for Augmented Reality apps, and it shines with and . Using this framework you can asynchronously load assets in .usdz and .reality formats, or in .rcproject format that stores compositions of app. Starting from Xcode 15, there will be the Reality Composer Pro app.

References

795 questions
7
votes
1 answer

How to hide ModelEntity in RealityKit?

There are hide model in Reality Composer but can't find any docs about hide entity or ModelEntity in RealityKit. Something like this : SCNNode ---- hidden A Boolean value that determines the visibility of the node’s contents. Animatable.
zhou junhua
  • 462
  • 1
  • 4
  • 12
7
votes
1 answer

Is it possible to have ARView and ARSCNView coexist?

I tried creating the two views in a view controller, and running them at the same time, but that doesn't work, the ARView overtakes ARSCNView, even if it's not hooked up to an outlet. I then tried adding one view to the other, and that doesn't work…
Joe
  • 355
  • 1
  • 10
7
votes
2 answers

How to animate a model's rotation in RealityKit?

In my previous question I already found how to put a rotation transform over only one axis on an object, now I want this to be animated. Is there a way to do this in RealityKit?
Robbe Verhoest
  • 401
  • 4
  • 9
7
votes
1 answer

How to set entity in front of screen with Reality kit?

The new reality kit camera transform appears to be misleading. When I set an entity’s transform to the camera’s, it is not following the front of the screen, instead, it is always near the world origin. There used to be pointOfView in scnview. What…
Illuminator
  • 153
  • 1
  • 6
7
votes
2 answers

Retrieving bone rotations from 3D Skeleton in ARKit 3

I'm trying to get the bone rotations related to their parents, but I end up getting pretty weird angles. I've tried everything, matrix multiplications, offsets, axis swapping, and no luck. guard let bodyAnchor = anchor as? ARBodyAnchor else {…
c4b4d4
  • 964
  • 12
  • 32
7
votes
2 answers

ARKit – What do the different columns in Transform Matrix represent?

An ARAnchor's 4x4 matrix has 4 columns. The fourth column of the matrix contains 3 translate values for x, y, and z coordinates. I was wondering what the other 3 columns represent?
Ashutosh Pandey
  • 127
  • 1
  • 4
6
votes
1 answer

ARKit app cannot replay a recorded ARSession from Reality Composer

I followed the instructions here to record an ARKit mov session using the Reality Composer app, but when I load in Xcode and run with an ARKit app, the app shows a black screen and shows errors: The app runs fine without the .mov file 2021-07-17…
jiawen
  • 1,198
  • 2
  • 17
  • 29
6
votes
1 answer

What is the real Focal Length of the camera used in RealityKit?

I am doing this Augmented Reality project starting from Xcode's default AR project. I need to know the focal length of the camera used by ARKit. This page defines Focal Length well: Focal length, usually represented in millimeters (mm), is the…
Duck
  • 34,902
  • 47
  • 248
  • 470
6
votes
1 answer

How to prevent Entities from overlapping?

I'm trying to create an AR experience with RealityKit but I'm finding that by default, entities will move into each other and overlap when they are moved by user interaction. I want to prevent the objects from overlapping and entering each other, so…
Julian Schiavo
  • 111
  • 1
  • 8
6
votes
1 answer

RealityKit – Plane Detection

In RealityKit, similiar to ARKit, objects won't show until the camera has detected some sort of flat surface. Once the camera has detected that surface, the objects will show and pin to it. How do I know (by code) if the camera has detected a flat…
Daniel Aragon
  • 89
  • 2
  • 5
6
votes
1 answer

How to place a RealityKit entity that will always look at the camera?

For SCNNodes we have SCNBillboardConstraint, so is there any way how to apply this constraint to an entity (when working with RealityKit instead of SceneKit) in order the entity always to face the camera as the device is moving?
izzym
  • 89
  • 3
6
votes
2 answers

How can I solve USDZConvert Pxr Import Error?

I'm running into this issue after installing USDZ tools from Apple's website. I'm a bit rusty at Python and tried installing all the underlying packages. I set my PYTHONPATH already using export…
aspdev91
  • 137
  • 2
  • 9
6
votes
1 answer

How to deallocate RealityKit ARView()?

I cannot manage to release my RealityKit ARView() from memory. I am aware that there are (were?) similar issues with ARKit + SceneKit – with workarounds like this one: https://stackoverflow.com/a/53919730/7826293 which doesen´t solve my problem…
HelloTimo
  • 558
  • 1
  • 5
  • 18
6
votes
1 answer

How can you edit a USDZ mesh that has been included in AR project?

How can you edit a usdz file and maintain the rigs that have been set inside of it? For example, I am trying to edit the robot.usdz mesh included in this example project -…
soCohesive
  • 593
  • 5
  • 10
6
votes
2 answers

RealityKit – How to set a ModelEntity's transparency?

In SceneKit, there are lots of options such as Use alpha channel of UIColor via SCNMaterial.(diffuse|emission|ambient|...).contents Use SCNMaterial.transparency (a CGFloat from 0.0 to 1.0) Use SCNMaterial.transparent (another…
Jian Jin
  • 111
  • 1
  • 5
1 2
3
…
52 53