Module 1 of 3 in Building Intelligent Apps with Apple AI Models

Vision Framework

Sep 18 2024, Swift 5.10, 6.0, iOS 17.5, 18b4, Xcode 15.4, 16b6
Leave a rating/review

The Vision Framework is a powerful API for various computer vision tasks on Apple devices. Explore functionalities like object detection, face recognition and more. This module provides an overview of the Vision Framework as well as covers the new features released with iOS 18 and Apple Intelligence. By Walter Tyree.

Start learning for free
 
EXPERIENCE
Intermediate level
EST TIME TO COMPLETE
1 hr, 39 mins
CONTENT
4 lessons
Share
Save for later

Module outcomes

  • Gain a comprehensive understanding of the Vision Framework
  • Construct basic Vision requests
  • Explore new features introduced in iOS 18

Covered concepts

  • Vision Framework
  • Machine Learning
  • iOS 18

Module content

1
Diving into the Vision Framework Lesson (21 mins)

Learn about capabilities of the Vision Framework as well as the general architecture. You’ll also learn why Apple pushes the on-device model for machine learning and vision and how to make sure your app is configured correctly.

 Start
Introduction • Start Reading · 1 min
Instruction 01 Reading · 5 mins
Instruction 02 Reading · 5 mins
Demo Video · 8 mins
Conclusion Reading · 1 min
Quiz: Understanding the Vision Framework 4 questions
2
Building Basic Vision Requests Lesson (38 mins)

Learn the basic request and response workflow that your app can use, regardless of the type of image detection or manipulation it needs.

 Start
Introduction • Start Reading · 1 min
Instruction 01 Reading · 14 mins
Demo 01 Video · 8 mins
Instruction 02 Reading · 11 mins
Demo 02 Video · 4 mins
Conclusion Reading · 1 min
Quiz: Making Vision Requests 4 questions
3
Exploring Text Detection & Recognition Lesson (22 mins)

Explore the special cases of text detection and recognition. You’ll also learn some tips and tricks for working with accuracy and confidence scores.

 Start
Introduction • Start Reading · 1 min
Instruction 01 Reading · 6 mins
Instruction 02 Reading · 7 mins
Demo Video · 7 mins
Conclusion Reading · 1 min
Quiz: Text Detection & Recognition 4 questions
4
Unveiling New Vision Framework Features in iOS 18 Lesson (18 mins)

Get an overview of some of the new features and ideas in the Vision Framework released in iOS 18.

 Start
Introduction • Start Reading · 1 min
Instruction 01 Reading · 6 mins
Instruction 02 Reading · 7 mins
Demo Video · 4 mins
Conclusion Reading · 1 min
Quiz: iOS 18 Vision Framework Updates 4 questions