Perform Scanning Activity on an Emerging Technology for Your Organization

36

TECHNOLOGYREVIEW.COM MIT TECHNOLOGY REVIEW VOL. 120 | NO. 2 BREAKTHROUGH TECHNOLOGIES

P R

O D

U C

T P

H O

T O

S B

Y L

E O

N A

R D

G R

E C

O

MA17_10_360cameras.indd 36 2/8/17 12:39 PM

T h

e 3

6 0

-D eg

ree Se

lfie

TECHNOLOGYREVIEW.COM MIT TECHNOLOGY REVIEW

VOL. 120 | NO. 2 BREAKTHROUGH TECHNOLOGIES

By Elizabeth Woyke

Inexpensive cameras that make spherical images are opening a new era in photography and changing the way people share stories.

Breakthrough Consumer cameras that produce 360° images, providing a realistic sense of events or places.

Why It Matters Photos and videos with this perspective could become the new standard for everything from news coverage to vacation shots.

Key Players - Ricoh - Samsung - 360fly - JK Imaging (maker of

Kodak Pixpro digital cameras)

- IC Real Tech (maker of the ALLie camera)

- Humaneyes Technologies

Availability Now

MA17_10_360cameras.indd 37 2/8/17 12:39 PM

38

TECHNOLOGYREVIEW.COM MIT TECHNOLOGY REVIEW VOL. 120 | NO. 2 BREAKTHROUGH TECHNOLOGIES

Seasonal changes to vegetation fas- cinate Koen Hufkens. So last fall Hufkens, an ecological researcher at Harvard, devised a system to continuously broadcast images

from a Massachusetts forest to a website called VirtualForest.io. And because he used a camera that creates 360° pictures, visitors can do more than just watch the feed; they can use their mouse cursor (on a computer) or finger (on a smartphone or tablet) to pan around the image in a circle or scroll up to view the forest can- opy and down to see the ground. If they

look at the image through a virtual-reality headset they can rotate the photo by mov- ing their head, intensifying the illusion that they are in the woods.

Hufkens says the project will allow him to document how climate change is affecting leaf development in New Eng- land. The total cost? About $550, includ- ing $350 for the Ricoh Theta S camera that takes the photos.

We experience the world in 360 degrees, surrounded by sights and sounds. Until recently, there were two main options for shooting photos and video that

captured that context: use a rig to posi- tion multiple cameras at different angles with overlapping fields of view or pay at least $10,000 for a special camera. The production process was just as cumber- some and generally took multiple days to complete. Once you shot your footage, you had to transfer the images to a computer; wrestle with complex, pricey software to fuse them into a seamless picture; and then convert the file into a format that other people could view easily.

Today, anyone can buy a decent 360° camera for less than $500, record a video

C O

U R

T E

S Y

O F

A L

L IE

C A

M E

R A

MA17_10_360cameras.indd 38 2/8/17 12:39 PM

39

TECHNOLOGYREVIEW.COM MIT TECHNOLOGY REVIEW

VOL. 120 | NO. 2 BREAKTHROUGH TECHNOLOGIES

Chicago’s Millennium Park captured by the ALLie camera.

ALLie Camera It uses technology originally developed for the surveillance industry and can capture images in low light.

MA17_10_360cameras.indd 39 2/8/17 12:39 PM

40

TECHNOLOGYREVIEW.COM MIT TECHNOLOGY REVIEW VOL. 120 | NO. 2 BREAKTHROUGH TECHNOLOGIES

within minutes, and upload it to Facebook or YouTube. Much of this amateur 360° content is blurry; some of it captures 360 degrees horizontally but not vertically; and most of it is mundane. (Watching footage of a stranger’s vacation is almost as boring in spherical view as it is in reg- ular mode.) But the best user-generated 360° photos and videos—such as the Vir- tual Forest—deepen the viewer’s apprecia- tion of a place or an event.

Journalists from the New York Times and Reuters are using $350 Samsung Gear 360 cameras to produce spherical photos and videos that document any- thing from hurricane damage in Haiti to a refugee camp in Gaza. One New York Times video that depicts people in Niger

fleeing the militant group Boko Haram puts you in the center of a crowd receiv- ing food from aid groups. You start by watching a man heaving sacks off a pickup truck and hearing them thud onto the ground. When you turn your head, you see the throngs that have gathered to claim the food and the makeshift carts they will use to transport it. The 360° for- mat is so compelling that it could become a new standard for raw footage of news events—something that Twitter is trying to encourage by enabling live spherical videos in its Periscope app.

Or consider the spherical videos of medical procedures that the Los Angeles startup Giblib makes to teach students about surgery. The company films the

Ballet dancers captured by the Samsung Gear 360.

C O

U R

T E

S Y

O F

S A

M S

U N

G

The 360° format is so compelling that it could become a new standard f

o r

r a

w f

o o

t a

g e

o

f n

e w

s e

v e

n t

s .

MA17_10_360cameras.indd 40 2/8/17 12:39 PM

41

TECHNOLOGYREVIEW.COM MIT TECHNOLOGY REVIEW

VOL. 120 | NO. 2 BREAKTHROUGH TECHNOLOGIES

samsung gear 360 Samsung has given these cameras to New York Times and Reuters journalists who are producing 360° news coverage.

MA17_10_360cameras.indd 41 2/8/17 12:39 PM

42

TECHNOLOGYREVIEW.COM MIT TECHNOLOGY REVIEW VOL. 120 | NO. 2 BREAKTHROUGH TECHNOLOGIES

Utah’s Sidestep Canyon captured by the Ricoh Theta S.

Ricoh Theta S Ricoh put the image sensors on the camera’s sides instead of behind its lenses, making its thin shape possible.

J O

H N

F O

W L

E R

/F L

IC K

R

MA17_10_360cameras.indd 42 2/8/17 12:39 PM

43

TECHNOLOGYREVIEW.COM MIT TECHNOLOGY REVIEW

VOL. 120 | NO. 2 BREAKTHROUGH TECHNOLOGIES

operations by attaching a $500 360fly 4K camera, which is the size of a baseball, to surgical lights above the patient. The 360° view enables students to see not just the surgeon and surgical site, but also the way the operating room is organized and how the operating room staff interacts.

Meanwhile, inexpensive 360° cameras such as Kodak’s $450 Pixpro SP360 4K are popping up on basketball backboards, football fields, and hockey nets during practice for professional and collegiate teams. Coaches say the resulting videos help players visualize the action and pre-

pare for games in ways that conventional sideline and end-zone videos can’t.

Component innovations These applications are feasible because of the smartphone boom and innova- tions in several technologies that combine images from multiple lenses and sensors. For instance, 360° cameras require more horsepower than regular cameras and generate more heat, but that is handled by the energy-efficient chips that power smartphones. Both the 360fly and the $499 ALLie camera use Qualcomm Snap-

dragon processors similar to those that run Samsung’s high-end handsets.

Camera companies also benefited in recent years from smartphone vendors’ continuous quest to integrate higher- quality imaging into their gadgets. The competition forced component makers like Sony to shrink image sensors and ensure that they offered both high reso- lution and good performance in low light. As the huge smartphone market helped bring down component prices, 360°-cam- era makers found it possible to price their devices accessibly, often at less than

MA17_10_360cameras.indd 43 2/8/17 12:39 PM

44

TECHNOLOGYREVIEW.COM MIT TECHNOLOGY REVIEW VOL. 120 | NO. 2 BREAKTHROUGH TECHNOLOGIES 360Fly 4K Dustproof and water-resistant, it’s often used to record extreme sports.

MA17_10_360cameras.indd 44 2/8/17 12:39 PM

45

TECHNOLOGYREVIEW.COM MIT TECHNOLOGY REVIEW

VOL. 120 | NO. 2 BREAKTHROUGH TECHNOLOGIES

$500. “There are sensors that now cost $1 instead of $1,000 because they’re used in smartphones, which have incredible economies of scale,” says Jeffrey Martin, the CEO of a 360°-camera startup called Sphericam. Advances in optics played a part as well. Unlike traditional cameras, which have fairly narrow fields of view, 360° cameras sport exaggerated fish-eye lenses that require special optics to align and focus images across multiple points.

Most 360° cameras lack displays and viewfinders. To compensate, cam- era makers developed apps that you can download to your phone to compose shots and review the resulting images.

The cameras connect to the apps wire- lessly, and many of them allow you to upload photos and video directly from your phone to Facebook and YouTube. In turn, those sites have made it possible over the past year for people not just to post recorded 360° content but to live- stream 360° videos as well.

Because creating 360° content requires stitching together multiple images, doing it on the fly for live stream- ing represents an impressive technical achievement. Computer-vision algorithms have simplified the process so that it can be done on the camera itself, which in turn allows people to live-stream video

Bicyclists in Taiwan captured by the 360fly 4K.

These applications are possible because of the smartphone boom and innovations in computer vision t

e c

h n

o l

o g

ie s

.

K IN

M U

N L

E E

/F L

IC K

R

MA17_10_360cameras.indd 45 2/8/17 12:39 PM

46

TECHNOLOGYREVIEW.COM MIT TECHNOLOGY REVIEW VOL. 120 | NO. 2 BREAKTHROUGH TECHNOLOGIES

with minimal delays. (It helps that most consumer-grade cameras have only two lenses and thus one stitch line. Profes- sional versions can have six to 24 lenses.) The ALLie camera supports fast stitching and live-streaming, as do Ricoh’s upcom- ing Ricoh R development kit camera and Kodak’s Orbit360 4K, which will be avail- able later this year for $500.

Spherical cameras represented 1 per- cent of worldwide consumer camera shipments in 2016 and are set to reach 4 percent in 2017, according to the research fi rm Futuresource Consulting. The pop-

ularity of these devices will benefit the virtual-reality industry as well as cam- era makers. You don’t need special VR gear to view spherical videos, but YouTube says many people look at them on smart- phones slipped into VR headsets, such as Google’s Cardboard and Daydream devices. And more people experimenting with 360° cameras means more content for other people to watch in VR.

In fact, John Carmack, the chief tech- nology offi cer of Facebook’s Oculus VR subsidiary, has predicted that people will spend less than 50 percent of their VR

time playing games. Instead, they may don VR headsets to do things like virtu- ally attend a wedding.

Once people discover spherical videos, research suggests, they shift their viewing behavior quickly. The company Human- eyes, which is developing an $800 camera that can produce 3-D spherical images, says people need to watch only about 10 hours of 360° content before they instinc- tively start trying to interact with all vid- eos. When you see 360° imagery that truly transports you somewhere else, you want it more and more.

T O

M P

O O

L E

/F L

IC K

R

MA17_10_360cameras.indd 46 2/8/17 12:39 PM

47

TECHNOLOGYREVIEW.COM MIT TECHNOLOGY REVIEW

VOL. 120 | NO. 2 BREAKTHROUGH TECHNOLOGIES

An urban scene captured by the Kodak Pixpro SP360 4K.

Kodak pixpro sp360 4k It can be mounted on a drone to produce aerial 360° videos.

MA17_10_360cameras.indd 47 2/8/17 12:39 PM

Copyright of MIT Technology Review is the property of MIT Technology Review and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use.