Connect with us

Technology

Meta makes its MobileLLM open for researchers

Published

on

Meta makes its MobileLLM open for researchers

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More


Meta AI has announced the open-source release of MobileLLM, a set of language models optimized for mobile devices, with model checkpoints and code now accessible on Hugging Face. However, it is presently only available under a Creative Commons 4.0 non-commercial license, meaning enterprises can’t use it on commercial products.

Originally described in a research paper published in July 2024 and covered by VentureBeat, MobileLLM is now fully available with open weights, marking a significant milestone for efficient, on-device AI.

The release of these open weights makes MobileLLM a more direct, if roundabout, competitor to Apple Intelligence, Apple’s on-device/private cloud hybrid AI solution made up of multiple models, shipping out to users of its iOS 18 operating system in the U.S. and outside the EU this week. However, being restricted to research use and requiring downloading and installation from Hugging Face, it’s likely to remain limited to a computer science and academic audience for now.

Advertisement

More efficiency for mobile devices

MobileLLM aims to tackle the challenges of deploying AI models on smartphones and other resource-constrained devices.

With parameter counts ranging from 125 million to 1 billion, these models are designed to operate within the limited memory and energy capacities typical of mobile hardware.

By emphasizing architecture over sheer size, Meta’s research suggests that well-designed compact models can deliver robust AI performance directly on devices.

Resolving scaling issues

The design philosophy behind MobileLLM deviates from traditional AI scaling laws that emphasize width and large parameter counts.

Advertisement

Meta AI’s research instead focuses on deep, thin architectures to maximize performance, improving how abstract concepts are captured by the model.

Yann LeCun, Meta’s Chief AI Scientist, highlighted the importance of these depth-focused strategies in enabling advanced AI on everyday hardware.

MobileLLM incorporates several innovations aimed at making smaller models more effective:

Depth Over Width: The models employ deep architectures, shown to outperform wider but shallower ones in small-scale scenarios.

Advertisement

Embedding Sharing Techniques: These maximize weight efficiency, crucial for maintaining compact model architecture.

Grouped Query Attention: Inspired by work from Ainslie et al. (2023), this method optimizes attention mechanisms.

Immediate Block-wise Weight Sharing: A novel strategy to reduce latency by minimizing memory movement, helping keep execution efficient on mobile devices.

Performance Metrics and Comparisons

Advertisement

Despite their compact size, MobileLLM models excel on benchmark tasks. The 125 million and 350 million parameter versions show 2.7% and 4.3% accuracy improvements over previous state-of-the-art (SOTA) models in zero-shot tasks.

Remarkably, the 350M version even matches the API calling performance of the much larger Meta Llama-2 7B model.

These gains demonstrate that well-architected smaller models can handle complex tasks effectively.

Designed for smartphones and the edge

MobileLLM’s release aligns with Meta AI’s broader efforts to democratize access to advanced AI technology.

Advertisement

With the increasing demand for on-device AI due to cloud costs and privacy concerns, models like MobileLLM are set to play a pivotal role.

The models are optimized for devices with memory constraints of 6-12 GB, making them practical for integration into popular smartphones like the iPhone and Google Pixel.

Open but non-commercial

Meta AI’s decision to open-source MobileLLM reflects the company’s stated commitment to collaboration and transparency. Unfortunately, the licensing terms prohibit commercial usage for now, so only researchers can benefit.

By sharing both the model weights and pre-training code, they invite the research community to build on and refine their work.

Advertisement

This could accelerate innovation in the field of small language models (SLMs), making high-quality AI accessible without reliance on extensive cloud infrastructure.

Developers and researchers interested in testing MobileLLM can now access the models on Hugging Face, fully integrated with the Transformers library. As these compact models evolve, they promise to redefine how advanced AI operates on everyday devices.


Source link
Continue Reading
Advertisement
Click to comment

You must be logged in to post a comment Login

Leave a Reply

Technology

ChromeOS gets a big update with Quick Insert, Focus mode, and new AI features

Published

on

ChromeOS gets a big update with Quick Insert, Focus mode, and new AI features

Starting today, Google’s ChromeOS 130 update with Quick Insert, Focus Mode, Welcome Recap, and other features is rolling out. Chromebook Plus models with NPU also get exclusive special features in 130, such as the new recorder app with AI, enhanced mic, camera effects, and Gemini AI tools like “help me read” summaries.

There’s a long list of changes in 130, but here are some highlights. Quick Insert is a way to add emoji, GIFs, or links to recently visited sites and access AI features from a menu. On most devices, that means using the launcher or Google button plus f on your keyboard. The Samsung Galaxy Chromebook Plus is the first Chromebook to replace the launcher key with a new button that activates Quick Insert with a single press, but more devices launching next year will have it, too.

Focus Mode lets you activate do not disturb and schedule time to reduce distractions while you work, while Welcome Recap is an opt-in feature that summarizes whatever you were doing last so you can reopen apps and tabs to get back to work quickly.

Welcome Recap.
Image: Google

Advertisement

Source link

Continue Reading

Technology

NYT Strands today — hints, answers and spangram for Friday, November 1 (game #243)

Published

on

NYT Strands homescreen on a mobile phone screen, on a light blue background

Strands is the NYT’s latest word game after the likes of Wordle, Spelling Bee and Connections – and it’s great fun. It can be difficult, though, so read on for my Strands hints.

Want more word-based fun? Then check out my Wordle today, NYT Connections today and Quordle today pages for hints and answers for those games.

Source link

Continue Reading

Technology

Snapchat most-used app for online grooming, says NSPCC

Published

on

Snapchat most-used app for online grooming, says NSPCC
Getty Images Thumbs above a lit up phone screenGetty Images

The messaging app Snapchat is the most widely-used platform for online grooming, according to police figures supplied to the children’s charity the NSPCC.

More than 7,000 Sexual Communication with a Child offences were recorded across the UK in the year to March 2024 – the highest number since the offence was created.

Snapchat made up nearly half of the cases where the platform used for the grooming was recorded by the police.

The NSPCC said it showed society was “still waiting for tech companies to make their platforms safe for children.”

Snapchat told the BBC it had “zero tolerance” of the sexual exploitation of young people, and had extra safety measures in place for teens and their parents.

Advertisement

Becky Riggs, the National Police Chief’s Council lead for child protection, described the data as “shocking.”

“It is imperative that the responsibility of safeguarding children online is placed with the companies who create spaces for them, and the regulator strengthens rules that social media platforms must follow,” she added.

Groomed at the age of 8

The gender of the victims of grooming offences was not always recorded by police, but of the cases where it was known, four in five victims were girls.

Advertisement

Nicki – whose real name the BBC is not using – was eight when she was messaged on a gaming app by a groomer who encouraged her to go on to Snapchat for a conversation.

“I don’t need to explain details, but anything that you can imagine happening happened in those conversation – videos, pictures. Requests of certain material from Nicki, etcetera,” her mother, who the BBC is calling Sarah, explained.

She then created a fake Snapchat profile pretending to be her daughter and the man messaged – at which point she contacted the police.

She now checks her daughter’s devices and messages on a weekly basis, despite her daughter objecting.

Advertisement

“It’s my responsibility as mum to ensure she is safe,” she told the BBC.

She said parents “cannot rely” on apps and games to do that job for them.

‘Problems with the design of Snapchat’

Snapchat is one of the smaller social media platforms in the UK – but is very popular with children and teenagers.

Advertisement

That is “something that adults are likely to exploit when they’re looking to groom children,” says Rani Govender, child safety online policy manager at the NSPCC.

But Ms Govender says there are also “problems with the design of Snapchat which are also putting children at risk.”

Messages and images on Snapchat disappear after 24 hours – making incriminating behaviour harder to track – and senders also know if the recipient has screengrabbed a message.

Ms Govender says the NSPCC hears directly from children who single out Snapchat as a concern.

Advertisement

“When they make a report [on Snapchat], this isn’t listened to, and that they’re able to see extreme and violent content on the app as well,” she told the BBC.

A Snapchat spokesperson told the BBC the sexual exploitation of young people was “horrific.”

“If we identify such activity, or it is reported to us, we remove the content, disable the account, take steps to prevent the offender from creating additional accounts, and report them to the authorities,” they added.

Record offending

Advertisement

The instances of recording grooming has been increasing since the offence of Sexual Communication with a Child came into force in 2017, reaching a new record high of 7,062 this year.

Of the 1,824 cases where the platform was known last year, 48% were recorded on Snapchat.

The number of grooming offences recorded on Snapchat has risen each year since 2018/19.

Reported grooming offences on WhatsApp also rose slightly in the past year. On Instagram and Facebook, known cases have fallen over recent years, according to the figures. All three platforms are owned by Meta.

Advertisement

WhatsApp told the BBC it has “robust safety measures” in place to protect people on its app.

Jess Phillips, minister for safeguarding and violence against women and girls, said social media companies “have a responsibility to stop this vile abuse from happening on their platforms”.

In a statement, she added: “Under the Online Safety Act they will have to stop this kind of illegal content being shared on their sites, including on private and encrypted messaging services or face significant fines.”

The Online Safety Act includes a legal requirement for tech platforms to keep children safe.

Advertisement

From December, big tech firms will have to publish their risk assessments on illegal harms on their platforms.

Media regulator Ofcom, which will enforce those rules, said: “Our draft codes of practice include robust measures that will help prevent grooming by making it harder for perpetrators to contact children.

“We’re prepared to use the full extent of our enforcement powers against any companies that come up short when the time comes.”

Source link

Advertisement

Continue Reading

Technology

NASA Mars video shows ‘giant eyeball’ during solar eclipse

Published

on

NASA Mars video shows 'giant eyeball' during solar eclipse

As it continues its painstaking search for microbial life on Mars, NASA’s Perseverance rover has also been reporting other other-worldly happenings occurring during its adventures.

Just recently, for example, one of its many onboard cameras captured some remarkable footage of a solar eclipse as Phobos — one of Mars’ two moons — passed between the red planet and the sun.

“Ever feel like someone’s watching you?” Perseverance said in a post on social media that included the video of Phobos. “That’s how I felt when I observed this transit of the martian moon Phobos! The pupil in this ‘googly eye’ is the potato-shaped moon, and the iris is our sun.”

Ever feel like someone's watching you?

That's how I felt when I observed this transit of the Martian moon Phobos! The pupil in this "googly eye" is the potato-shaped moon, and the iris is our Sun. Learn more: https://t.co/jUYoXY1jpK pic.twitter.com/7izVWOHEPH

— NASA's Perseverance Mars Rover (@NASAPersevere) October 30, 2024

Advertisement

“Captured by the rover’s Mastcam-Z on September 30, the 1,285th martian day of Perseverance’s mission, the event took place when the potato-shaped moon passed directly between the sun and a point on the surface of Mars, obscuring a large part of the Sun’s disc,” NASA’s JET Propulsion Laboratory, which is overseeing the rover mission, said in a post on its website. “At the same time that Phobos appeared as a large black disc rapidly moving across the face of the sun, its shadow, or antumbra, moved across the planet’s surface.”

Named after the god of fear and panic in Greek mythology by astronomer Asaph Hall in 1877, Phobos is about 157 times smaller in diameter than Earth’s moon, and is only about 17 miles (27 kilometers) at its widest point, compared to the 2,159.2 miles (3,475 kilometers) of Earth’s moon.

NASA’s Mars rovers have been capturing footage of Phobos since 2004, providing scientists with plenty of data to learn more about it. For example, it’s been found that Phobos’ orbit is almost perfectly in line with Mars’ equator and relatively close to the planet’s surface, causing a fast orbit in which it loops around Mars in a mere 7.6 hours. Phobos is moving closer to Mars by about six feet every 100 years, a descent that suggests it will collide with the planet — or break up due to gravitational stresses — in about 50 million years’ time.






Source link

Advertisement

Continue Reading

Technology

Mozilla’s Thunderbird email app for Android is finally available

Published

on

Mozilla’s Thunderbird email app for Android is finally available

There are a variety of email apps for Android on the Play Store. Several developers of the major desktop email clients have developed versions for mobile devices. However, there is one in particular from Mozilla that, after more than two decades, was still lost from the ecosystem. That just changed with the release of an official Thunderbird app for Android.

After a long wait, Thunderbird receives an official app for Android

The name Mozilla probably sounds familiar to you, as it is the developer of the popular Firefox web browser. The nonprofit foundation is also responsible for other useful open-source tools. In addition to Firefox, Mozilla offers Thunderbird as a fairly popular email client. The primary focus of the app was desktop computers and laptops. Now, Mozilla is changing its strategy by releasing an official version of its email client for Android.

Interestingly, Firefox has had a mobile app for years, so it’s intriguing that it took so long for Thunderbird to have one. Anyway, the wait is finally over. Mozilla had already released a beta version of the official Thunderbird app for Android in early October. It seems that everything went well during the beta, as it didn’t take Mozilla long to roll out a stable version for everyone.

Thunderbird App Android Official featured

App developed on the K-9 email client code

It’s noteworthy that Thunderbird isn’t exactly a development from scratch. Its developers built it on the open-source code of K-9, a veteran email app that Mozilla acquired. Mozilla has been working on the Thunderbird app for Android since 2022 with direct collaboration from the original K-9 team. So, if you were a K-9 user back in the day, you might see some similar features. However, everything looks much more modern, and the new client includes a plethora of new options inherited from the desktop client.

Advertisement

If you want to give Thunderbird a try, you can download it from the Play Store right now.

Source link

Continue Reading

Technology

Hyundai reveals its newest hydrogen-powered vehicle, the Initium

Published

on

Hyundai reveals its newest hydrogen-powered vehicle, the Initium

Hydrogen-powered vehicles haven’t really caught on as an alternative means of eco-friendly transportation. Hyundai, however, hopes to fix that with a bigger investment in the technology and its newest hydrogen-powered concept SUV called the .

Hyundai announced it plans to start production on the hydrogen SUV in the first half of next year. The Initium can run approximately 404 miles on a single refueling and can also run on electric power as a backup that can be recharged from a household electricity supply. The vehicle will also make its public debut at the LA Auto Show and Auto Guangzhou in China next month. It’s not yet confirmed where the cars will be available when they go on sale so a US launch isn’t guaranteed.

The Initium may just be a concept car for now but Hyundai seems committed to bringing its newest hydrogen car to drivers quickly, even if the fuel source hasn’t made nearly as many strides towards widespread acceptance as electric options. The South Korean carmaker is planning on investing $4 billion to develop its hydrogen vehicle technology and infrastructure to meet its complete carbon neutrality goal by 2045 with cars like the Initium and unveiled last year.

Hydrogen may be an efficient alternative to gasoline but it still has a ways to go to be competitive with electric vehicles (and that’s without acknowledging the continued prevalence of gasoline-powered cars). There are only 59 hydrogen charging stations in the US with most of them in California, according to the . There are only a handful of carmakers who still offer a hydrogen powered option including Hyundai () and Toyota (). Honda used to offer a hydrogen car with The Clarity but it ended production in 2021, according to .

Advertisement

Source link

Continue Reading

Trending

Copyright © 2024 WordupNews.com