Making Things See summary

Understanding the Basics of Kinect

In Making Things See by Greg Borenstein, we embark on a journey to understand the Kinect sensor, a device that revolutionized the way computers perceive and interact with the physical world. The book begins with an exploration of the Kinect sensor’s hardware and software, delving into its capabilities, limitations, and the underlying principles that enable it to capture three-dimensional scenes and human motion.

As we progress, Borenstein introduces us to the concept of depth sensing, explaining how the Kinect sensor uses infrared light to measure the distance between objects and the camera. We learn about the sensor’s ability to create a point cloud, a collection of points in three-dimensional space that represent the surfaces of objects, and how this data can be used to understand the environment and track human movement.

Building Simple Kinect Applications

With a solid understanding of the Kinect sensor in place, Borenstein guides us through the process of building simple applications that utilize its capabilities. We learn how to access the sensor’s data stream and use it to create basic programs that can track and respond to human gestures. This includes understanding the skeletal tracking feature, which enables the sensor to identify and track the movements of individual body parts.

Borenstein also introduces us to the Processing programming environment, providing us with the necessary tools to develop interactive visual applications that leverage the Kinect’s motion tracking abilities. He demonstrates how to create projects that respond to hand gestures, track the user’s body, and even generate 3D models of the environment.

Advanced Kinect Applications

Having mastered the basics, we move on to more advanced applications of the Kinect sensor. Borenstein explores how the depth data captured by the sensor can be used to create 3D reconstructions of the environment, allowing us to explore the realms of 3D scanning and augmented reality. He also introduces us to machine learning techniques that enable the sensor to recognize and classify objects based on their shapes and movements.

Furthermore, the book delves into the world of robotics, showcasing how the Kinect sensor can be used to create interactive robotic systems that respond to human gestures and movements. We learn about the concept of telepresence, where the sensor enables a robot to mimic the movements of a remote user, blurring the boundaries between the physical and digital worlds.

Exploring Artistic and Creative Applications

As we near the end of our journey, Borenstein takes us into the realm of artistic and creative applications of the Kinect sensor. We explore how artists and designers have used the sensor to create immersive installations, interactive artworks, and innovative user interfaces. From dance performances driven by motion tracking to interactive sculptures that respond to the viewer’s presence, we witness the diverse ways in which the Kinect has been harnessed as a tool for artistic expression.

In conclusion, Making Things See offers a comprehensive exploration of the Kinect sensor and its potential applications. Through a combination of theoretical discussions, practical examples, and inspiring case studies, Greg Borenstein provides us with the knowledge and inspiration to embark on our own creative journeys with this groundbreaking technology.