Facebook has announced a research project in which collected 2,200 hours of footage in first person from around the world to train the next generation of artificial intelligence models.
The project is called Ego4D and could prove to be crucial for the company’s Reality Labs division, which is working on several projects that could benefit from AI models trained using video footage captured from a human perspective.
This includes smart glasses, such as Facebook’s Ray-Ban stories published last month and virtual reality, in which the company has invested heavily since acquiring the $ 2 billion Oculus in 2014.
Snapshots can teach artificial intelligence to understand or identify something in the real world or virtual world that you might see in first person through smart glasses or Oculus goggles.
The company said it will make the set of Ego4D data. “This version, which represents a set of open data and a research challenge, catalyzes progress for us both internally and across the academic community. It also allows other researchers to consider solutions to these new problems. And do it in a more meaningful way and a broader way. “
The set of data can be distributed in artificial intelligence models used to train technologies such as robots to understand the world faster. A robot traditionally learns by doing things in the world. And there are opportunities for them to learn from the video from our experience.
Facebook and a consortium of 13 partner universities relied on over 700 participants in nine countries to capture shots in first person. Use of devices standard like GoPro cameras and Vuzix smart glasses.
Facebook’s university partners include Carnegie Mellon University in the US, University of Bristol in the UK, National University of Singapore, the University of Tokyo in Japan and the International Institute for Information Technology in India.
Facebook wants systems that see, hear and remember everything you do
The footage was shot in the US, UK, in Italy, India, Japan, Singapore and Saudi Arabia. The company said it hopes to expand the project in multiple countries, including Colombia and Rwanda.
The company is constantly stepping up its hardware efforts. Last month it released its $ 299 Ray-Ban Stories, its first smart glasses.
In July, the company announced the formation of a team of product to work on Metaverse. It is a concept that involves the creation of digital worlds that can be experienced by multiple people at the same time.
But for the past month, Facebook has been bombarded with news. The stories come from a collection of internal company research leaked by Frances Huggin, former product manager of the company.
Among the research released, there were slides showing that Instagram is bad for the mental health of teenagers.
For privacy reasons, the company said attendees were instructed to avoid acquiring personally identifiable characteristics when collecting footage. in closed environments.
This includes people’s faces, conversations, tattoos and jewelry. Facebook said it removed personally identifiable information from the videos, obscuring the faces of pedestrians and vehicle license plates. Audio was also removed from many of the videos.
Read More About: Technology News