Version First Edition - Early Access 3
Platform iOS 14
Language Swift 5.1
Editor Xcode 12

Learn Augmented Reality for the Apple Platform!

This book is the easiest and fastest way to get hands-on experience using Apple frameworks and technologies like Reality Composer, RealityKit, and ARKit — all the available rendering technologies Apple has to offer, as well as a collection of fun projects for creating various real-world AR experiences.

After reading this book, you’ll have a deep understanding of the technologies and frameworks used to create powerful, immersive AR experiences for the Apple platform.

Take a deep dive into:

  • AR Quick Look: Discover how to integrate AR Quick Look into your apps to give them some cool AR superpowers.
  • Reality Composer & Reality Files: Find out how to leverage the power of Reality Composer to create interactive AR-based experiences.
  • Reality Converter & PBR Materials: Discover how PBR materials can add a level of realism to your AR objects, and how you can use Reality Converter to convert, view and customize USDZ content.
  • RealityKit: Find out how to set up and use RealityKit to build a face-based augmented reality app.
  • Facial Blend Shapes: Build a fully interactive augmented reality face mask that reacts to your facial expressions using blend shapes.
  • ARKit: Get a complete introduction to ARKit, Apple’s framework for creating fully interactive augmented reality, and learn about the different types of rendering options available with ARKit.
  • Raycasting & Physics: Learn about raycasting, 2D hit-testing and the SpriteKit physics engine as you add more features and functionality to your game.
  • ECS & Collaborative Experiences: Build a collaborative AR experience and learn how to create and manage a multipeer connection.

Note: This book is in Early Access. You’ll get advance access to the book while it’s in development, and you’ll get a free update to the complete digital edition of the book when it’s complete!

Estimated final release date: Fall 2020

Before You Begin

This section tells you a few things you need to know before you get started, such as what you’ll need for hardware and software, where to find the project files for this book, and more.

i

iv

Section I: Reality Composer

Welcome to the first section of the book. In this section, you’ll dip your toes into the shallow end of augmented reality as you learn about AR Quick Look, Reality Composer, Reality and USDZ Files. You’ll create an interactive virtual drum kit that you’ll be able to share with your friends on iMessage.

Get up to speed quickly with your first project in AR.

1

Discover how to integrate AR Quick Look into your apps to give them some cool AR superpowers.

2

Find out how to leverage the power of Reality Composer to create interactive AR-based experiences.

3

Learn about USD and the USDZ file format, and find out how to convert your virtual content into this universal format using Python-based command-line tools.

4

Discover how PBR materials can add a level of realism to your AR objects, and how you can use Reality Converter to convert, view and customize USDZ content.

5

Section II: Reality Composer & Image Tracking

In this section, you’ll dive a little deeper into augmented reality and learn about image anchors and tracking. You’ll also create an interactive AR Business Card that you can show off to your friends, making them green with envy.

Learn how to use image anchors to scale and place virtual objects within the real world.

6

Spice up your reality apps with animations and sound effects using behaviors, triggers and actions.

7

Section III: Reality Composer & Object Tracking

In this section, you’ll add another dimension with Object tracking. Using object anchors, you’ll augment a physical toy truck with interactive buttons that will reveal some fun facts about its real-world counterpart.

Learn how to use object anchors to anchor AR content to physical objects within the real world, and take a tour of ARKit Scanner — an iOS app that lets you scan physical objects.

8

Section IV: RealityKit & Face Tracking

In this section, you’ll learn about RealityKit and face tracking. You’ll create a SnapChat-like face filter app with SwiftUI that lets you mockup your face with funny props. You’ll also create an animated mask that you can control with your eyes, brows and mouth.

Find out how to set up and use RealityKit to build a face-based augmented reality app.

9

Discover how you can use face anchors and face occlusion to track a user’s face and apply a virtual mask.

10

Build a fully interactive augmented reality face mask that reacts to your facial expressions using blend shapes.

11

Section V: ARKit & SpriteKit

In this section, you’ll get a full introduction to ARKit and find out what makes it so powerful. In doing so, you’ll create a fun 2D SpriteKit game where you get to save tiny Emoji’s before they fall to their death.

Get a complete introduction to ARKit, Apple's framework for creating fully interactive augmented reality, and learn about the different types of rendering options available with ARKit.

12

Discover how to combine ARKit and SpriteKit to create exciting augmented reality 2D games.

13

Learn about raycasting, 2D hit-testing and the SpriteKit physics engine as you add more features and functionality to your game.

14

Section VI: ARKit & SceneKit

In this section, you’ll continue learning about ARKit. You’ll also learn about SceneKit, Apple’s framework for creating 3D content, as you build a miniature interactive virtual airport that allows customers to access basic departure and arrivals information.

Find out how to use the power of SceneKit and ARKit together to create powerful 3D augmented reality scenes.

15

Discover how to detect, manage and use plane anchors and focus nodes. Learn how to enable environmental mapping and add lights and shadows.

16

Section VII: ECS & Collaborative Experiences (Bonus Section)

In this section, you’ll create a multiplayer AR shared experience using RealityKit. In this experience, two players can play a basic Knots & Crosses game on separate devices.

Build a collaborative AR experience and learn how to create and manage a multi-peer connection.

17

Meet the team

Contributors

Who is this book for

This book is for beginner to intermediate iOS developers who already know the basics of Swift development and are looking to build immersive AR experiences for the Apple platform.

Concepts covered in this book

  • Reality Composer & Reality Files
  • Reality Converter & PBR Materials
  • RealityKit
  • Facial Blend Shapes
  • ARKit
  • Raycasting & Physics
  • ECS & Collaborative Experiences

Version history

First Edition - Early Access 3 · iOS 14, Swift 5.1, Xcode 12

v1.0.ea3 · Sep 10 2020 · Chris Language
Pro

Apple Augmented Reality by Tutorials

By Chris Language

The best book to learn how to build realistic and immersive AR experiences for the Apple platform. Note: This book is in Early Access. You’ll get advance access to the book while it’s in development, and you’ll get a free update to the complete digital edition of the book when it’s complete! Estimated final release date: Fall 2020

Read for Free with an Ultimate Pro Subscription* * Includes this and all other books in our online library See all benefits
Buy Individually $59.99* *Includes access to all of our online reading features.
See buying options
Hide buying options

All videos. All books.
One low price.

A raywenderlich.com subscription is the best way to learn and master mobile development — plans start at just $19.99/month!

Learn iOS, Swift, Android, Kotlin, Flutter and Dart development and unlock our massive catalog of 50+ books and 4,000+ videos.