Technology
Facebook’s Rosetta AI can read all the memes
There are so many memes on Facebook and Instagram that the company has enlisted its artificial intelligence to help understand them.
In a blog post, Facebook developers say they have created a dedicated AI tool, called Rosetta, to read the text that appears in memes (and other images and video frames) that are shared to Facebook and Instagram.
At face value, understanding memes might not seem like the most important problem for AI to solve. But Facebook’s researchers point out that the technology, which is designed to recognize depicted text in a wide variety of languages, has many practical uses.
For example, Rosetta can read photographed text in menus and street signs, as well as words appearing on clothing and product labels. So while Rosetta isn’t dedicated to memes, their prevalence on Facebook and Instagram will undoubtedly make them a major use case, especially in Facebook’s detection of offensive material.
“Understanding the text that appears on images is important for improving experiences, such as a more relevant photo search or the incorporation of text into screen readers that make Facebook more accessible for the visually impaired,” Facebook explains, adding that reading text in images is important in identifying “inappropriate or harmful content and keep our community safe.”
According to Facebook, the system is able to process more than a billion images a day.
The process essentially boils down to two steps: Rosetta scans images for text, and then uses text recognition to identify what the text actually says. Once the text has been transcribed, the system interprets what the text could mean.
Through Rosetta, Facebook is able to improve its image search as well as the systems that determine the types of images that may appear in your News Feed. It also helps the company automatically detect and remove hate speech that it may not have been able to identify previously.
In the future, Facebook says it could apply the same technology toward understanding text that appears in video as well, though that requires a more complex system.
!function(f,b,e,v,n,t,s){if(f.fbq)return;n=f.fbq=function(){n.callMethod?
n.callMethod.apply(n,arguments):n.queue.push(arguments)};if(!f._fbq)f._fbq=n;
n.push=n;n.loaded=!0;n.version=’2.0′;n.queue=[];t=b.createElement(e);t.async=!0;
t.src=v;s=b.getElementsByTagName(e)[0];s.parentNode.insertBefore(t,s)}(window,
document,’script’,’https://connect.facebook.net/en_US/fbevents.js’);
fbq(‘init’, ‘1453039084979896’);
if (window.mashKit) {
mashKit.gdpr.trackerFactory(function() {
fbq(‘track’, “PageView”);
}).render();
}
-
Business7 days ago
DOJ’s Apple antitrust case neatly aligns with EU on one key point: NFC and mobile payments
-
Business6 days ago
Lordstown Motors’ ousted CEO settles with SEC for misleading investors
-
Business5 days ago
Apple sued, Microsoft’s AI ambitions and Nvidia’s surprises
-
Business4 days ago
TechCrunch Mobility: The wheels are starting to come off the Fisker EV bus
-
Entertainment3 days ago
Amazon Big Spring Sale 2024: Shop 350+ deals on Apple, robot vacuums, security cameras, more
-
Business3 days ago
Maju Kuruvilla is out as CEO of one-click checkout company Bolt
-
Entertainment5 days ago
Amazon’s Big Spring Sale 2024: Shop 340+ deals on Apple, robot vacuums, security cameras, more
-
Entertainment3 days ago
Asus ROG Zephyrus G14 (2024): The MacBook Pro of gaming laptops