ARKit: Placing a 3D-object on top of image

Question

I'm trying to add a 3D-object properly on a reference image. To add the 3D-object on the image in real world I'm using the imageAnchor.transform property as seen below.

    func renderer(_ renderer: SCNSceneRenderer, didAdd node: SCNNode, for anchor: ARAnchor) {

    guard let imageAnchor = anchor as? ARImageAnchor else { return }

    let referenceImage = imageAnchor.referenceImage

    updateQueue.async {  
        // Add a virtual cup at the position of the found image
        self.virtualObject.addVirtualObjectWith(sceneName: "cup.dae",
                                                childNodeName: nil,
                                                position: SCNVector3(x: imageAnchor.transform.columns.3.x,
                                                                     y: imageAnchor.transform.columns.3.y,
                                                                     z: imageAnchor.transform.columns.3.z),
                                                recursively: true,
                                                imageAnchor: imageAnchor)

    }

}

The problem is when I move the device orientation the cup won't stay nicely in the middle on the image. I would also like to have the cup on the same spot even when I remove the image. I don't get the problem because when you add an object using plane detection and hit testing there is also a ARAnchor used for the plane.

Update 05/14/2018

 func addVirtualObjectWith(sceneName: String, childNodeName: String, objectName: String, position: SCNVector3, recursively: Bool, node: SCNNode?){
    print("VirtualObject: Added virtual object with scene name: \(sceneName)")

    let scene = SCNScene(named: "art.scnassets/\(sceneName)")!
    var sceneNode = scene.rootNode.childNode(withName: childNodeName, recursively: recursively)!
    sceneNode.name = objectName
    sceneNode.position = position

    add(object: sceneNode, toNode: node)

}

func add(object: SCNNode, toNode: SCNNode?){
    if toNode != nil {
        toNode?.addChildNode(object)
    }
    else {
        sceneView.scene.rootNode.addChildNode(object)
    }
}

Any possibility of seeing the virtualObject.addVirtualObjectWith code for reference purposes? — jarora, May 11 '18 at 15:10

KNV · Accepted Answer · 2018-05-24T15:07:00.337

6

I finally found the solution, turns out that the size of the AR Reference Image was not set correctly in the attributes inspector. When the size is not correct, the anchor of the image will be shaky.

edited May 24 '18 at 15:07

answered Mar 26 '18 at 13:26

KNV

631
4
19

3

Yep, size matters a lot for reference images. Also, [it can help](https://stackoverflow.com/a/45182794/957768) to add a regular `ARAnchor` at the detected image's location, and use `ARSCNViewDelegate` to place your SceneKit content relative to that anchor, because ARKit optimizes world tracking results in the vicinity of a developer-placed anchor. – rickster May 24 '18 at 17:44
@rickster, Thanks for your comment, because of the regular ARAnchor the tracking is now much more accurate! – KNV May 25 '18 at 08:55

ARKit: Placing a 3D-object on top of image

1 Answers1