Ninety percent of the worlds data was created in the last two years. What we do with it will change the future.
We’re living in the age of Big Data.
From smartphones to social media sites, online shopping to electronic medical records, modern technology is creating mountains of valuable information. When filtered through powerful computer algorithms, these digital bits shape our world.
Thanks to Big Data, online dating sites can better match prospective mates. Companies can understand their customers wants and needs as never before. Government agencies can more easily catch tax cheats.
We are on the cusp of an amazing wave of innovation, productivity and growth … all driven by Big Data, a 2011 McKinsey & Company study concludes. USC computer scientists, electrical engineers and other researchers are at the vanguard of this technological revolution. Read on to learn about four ways that USC researchers are harnessing Big Data to change the future.
What makes basketball teams like the Oklahoma City Thunder so successful? Take great players like Kevin Durant and Russell Westbrook, smart coaching and passionate fansand add a dash of computer science.
Yes, computer science.
Moneyballthe use of statistics to guide decisions in sportshas its believers in todays NBA. Researchers call it quantitative analytics, and its increasingly influencing decisions in the front office and on the court. Two USC Viterbi School of Engineering computer scientists are major players in the movement.
Rajiv Maheswaran and Yu-Han Chang have spent the past two years analyzing data captured by video cameras mounted high in the rafters of several NBA arenas to unlock the mysteries of what constitutes good offense and defense. Their aptitude at making sense of the rivers of data generated by SportVU, an optical tracking technology originally created for incoming missiles, earned them the top research award at the 2012 MIT Sloan Sports Analytics Conferencea sort of Super Bowl for the sports-data obsessed.
Currently, 15 NBA teams in search of a competitive advantage use the SportVU data-gathering system. Among them is one of the teams that made the 2013 NBA Finals: the San Antonio Spurs.
Maheswaran and Chang can do a lot with the data. Both big sports fans, they looked at more than 70,000 shots, including the position of the shooters and defenders before, during and after field goal attempts.
Among their findings: A typical three-point shot is nearly as good as a close-range two-pointer. Thats because a typical three-pointer is less contested and worth more. Look at it this way: Data show that a three-point shooter facing a defender 5 feet away hits his shot 54 percent of the time. Thats about the same percentage for a player shooting a two-point shot only 3 feet from the basket.
Maheswaran and Chang also create individual player profiles that show offensive and defensive tendencies, rebounding stats, and shooting analytics such as shot selection on the court and accuracy under increased pressure. Thats invaluable information for an NBA team.
What they can do with the data is far beyond what we or any NBA team can do with the data, says Brian Kopp, vice president of strategy and development of Chicago-based STATS, which owns the SportVU technology.
The computer scientists just launched a new company to create tools to help NBA teams understand and use optical tracking data.
We can also do this for soccer, football, hockey, Maheswaran says, basically any sport that has movement.
Taming of the News
What do Lady Gaga, President Barack Obama and Justin Bieber have in common? They not only make news, but they shape it as never before.
Amid an explosion in social media, journalists at some of the nations most prestigious publications are increasingly turning to influential Twitter accounts for story leads. A prominent actresss tweeted naked pictures of herself to a married co-star can easily become tomorrows front-page entertainment news.
As Twitter grows in popularity, The New York Times, Wall Street Journal and Los Angeles Timeshave taken notice. The service, which now has about 200 million monthly visitors, has also attracted the attention of Big Data scholars, including USC Viterbi computer scientist Yan Liu.
By using statistical modeling and algorithms, Liu and her USC research team are studying social medias growing impact on traditional news coverage. Simply put, some of societys most prominent public figures can now take their unfiltered messages directly to the people through Twitter, leaving the mainstream media to play catch-up.
More athletes, movie stars and other high-profile people are using Twitter, and the numbers will continue to grow, Liu says.
While Twitter democratizes news by enabling people to report their own news on equal footingin 140 characters or fewersome celebrity newsmakers-turned-reporters are more equal than others.
Over 10 weeks in early 2012, Liu and her team reviewed more than 87,000 tweets from the 2,000 most influential Twitter accounts. The researchers combed through Google News and other aggregators that house millions of articles to track down which tweets later appeared in mainstream media.
Of the tweets picked up, Liu said, 50 percent came from the entertainment world, 30 percent from sports, 10 percent from politics and 10 percent from other sources. Lady Gaga and Justin Bieber, as measured by the number of followers and media hits, were the most influential tweeters.
Liu hopes to extend her Twitter research to model buzz trends to make predictions about future hot news topics. She sees a bright future for Big Data in making sense of it all.
Big Data is whats happening this century, says Liu, whose research also includes studying climate change and gene regulatory networks. From business to health care to energy, Big Data is going to have a huge impact.
Help for Traffic-Haters
Cyrus Shahabi knew there had to be a better way.
Day after day, the director of USCs Integrated Media Systems Center (IMSC) and professor of computer science and electrical engineering braved bumper-to-bumper traffic from his Irvine, Calif., home to USCs University Park Campus and back again. Online traffic alert services, which often use delayed data, werent much help. Tired of wasting hours a week breathing car fumes and fighting freeway fatigue, Shahabi decided to do something about it.
And so he has.
Shahabi and IMSC associate director Ugur Demiryurek created a new smartphone app that they say offers Los Angeles commuters the fastest possible routes to their destinations. Known as ClearPath, the application uses sophisticated algorithms to crunch massive amounts of data, including historical traffic patterns and real-time traffic information generated from nearly 10,000 sensors installed throughout Los Angeles County.
The time is right for ClearPath. Traffic data provider INRIX last year named Los Angeles as the nations second-worst city for gridlock, with drivers wasting about 56 hours per year in traffic. Nationally, traffic represents an annual $121 billion drain on the American economy, according to the Texas Transportation Institutes 2011 annual Urban Mobility Report.
ClearPath is so smart it can tune its traffic reports according to time, date and weather conditions. It could potentially help drivers make split-second decisions that would cut their drives home or shorten their long-haul freight times. To the average driver, this could mean fewer headaches and less road rage. On a national level, shorter commute times might increase productivity and conserve valuable energy resources.
Eager to test the system, Demiryurek and other ClearPath team members drive routes suggested by their app and compare them to those recommended by services such as Google Maps. They find the app beats the competition even though it often suggests surface streets to avoid gridlock. Competitors typically try to push drivers onto freeways, even when the freeways are jammed.
The ClearPath team is trying to raise money from investors to develop apps for such high-traffic cities as San Francisco, New York and Chicago. Seed money came from the USC Stevens Institute for Innovation.
Shahabi is using ClearPath himself, and hes seen his commute time drop precipitously. Much to Shahabis surprise, ClearPath often suggests he take the 5 Freeway north at about 9:30 a.m. and come home on the 5 Freeway south between 7:10 p.m. and 7:30 p.m., depending on the day. Shahabi had previously avoided that freeway at all costs.
Im saving 10 minutes each way, 20 minutes a day, he says. Thats huge, and its thanks to ClearPath.
Parkinsons disease often starts gently, its tremors and stiff muscles the only sign of illness. This incurable movement disorder worsens over time, though, and can rob the physical independence of those living with it.
In the future, technology from video games could keep an eye on people with Parkinsons in their own homes, noticing important physical changes and alerting caregivers about them. That could protect patients healthand self-sufficiency.
The new system, under development by USC computer scientists, neurologists, kinesiologists and public health experts, is called iHealth mobility monitoring.
Heres how it works. Video game consoles with 3-D sensors, such as Microsoft Kinect, would track a patients movements around the house. Smartphone apps and body sensors could capture additional information.
Algorithms developed by the iHealth team would analyze the massive amounts of data to uncover significant changes in movement as they happen.
Our system will allow patients and their caregivers to monitor disease progression and the effectiveness of treatments in real time, says Cesar Blanco, project leader and head of research and development for the Alfred E. Mann Institute for Biomedical Engineering.
If a patient just loses a little flexibility or range in movement, iHealth might simply alert the patient and his or her caregivers about exercises that could better manage symptoms. With major mobility changes, the system would immediately contact physicians, who could change drug dosages, prescribe new medications or take other action. Currently, doctors have no way to effectively monitor patients between office visits other than asking them to check in if symptoms worsen.
The system might help prevent accidents, as well. Parkinsons patients are at greater risk for hip fractures because of the diseases impact on balance, and iHealths increased surveillance could decrease the number of such injuries. In the process, it could reduce pain, suffering and medical costs among the up to 1 million Americans with Parkinsonswhich is more than the combined number of people diagnosed with muscular dystrophy, Lou Gehrigs disease and multiple sclerosis, according to the Parkinsons Disease Foundation.
Possible applications extend beyond Parkinsons to encompass strokes and other mobility disorders. iHealth could even monitor the posture of weight lifters and factory workers to prevent repetitive motion injuries, including carpal tunnel syndrome.
These mobility monitoring technologies could be used by the general public to minimize the potential for physical injuries from various activities of daily life, including walking, lifting objects and carrying groceries, Blanco says. Our goal is to develop monitoring technologies that empower people.