Connect with us

Technology

Nvidia advances robot learning and humanoid development with AI and simulation tools

Published

on

Nvidia advances robot learning and humanoid development with AI and simulation tools

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More


Nvidia revealed new AI and simulation tools that will advance robot learning and humanoid development.

The world’s biggest tech company by valuation (worth $3.432 trillion) said that the tools will enable robotics developers to greatly accelerate their work on AI-enabled robots, with tools revealed this week at the Conference for Robot Learning (CoRL) in Munich, Germany.

The lineup includes the general availability of the Nvidia Isaac Lab robot learning framework; six new humanoid robot learning workflows for Project GR00T, an initiative to accelerate humanoid robot development; and new world-model development tools for video data curation and processing, including the Nvidia Cosmos tokenizer and Nvidia NeMo Curator for video processing.

Advertisement

The open-source Cosmos tokenizer provides robotics developers superior visual tokenization by breaking down images and videos into high-quality tokens with exceptionally high compression rates. It runs up to 12 times faster than current tokenizers, while NeMo Curator provides video processing curation up to seven times faster than unoptimized pipelines.

Also timed with CoRL, Nvidia released 23 papers and presented nine workshops related to robot learning, and also released training and workflow guides for developers. Further, Hugging Face and Nvidia announced they’re collaborating to accelerate open-source robotics research with LeRobot, Nvidia Isaac Lab and Nvidia Jetson for the developer community.

Accelerating robot development with Isaac Lab

Nvidia Isaac Lab Project GR00T Models

Nvidia Isaac Lab is an open-source, robot learning framework built on Nvidia Omniverse, a platform for developing OpenUSD applications for industrial digitalization and physical AI simulation.

Developers can use Isaac Lab to train robot policies at scale. This open-source unified robot learning framework applies to any embodiment — from humanoids to quadrupeds and collaborative robots — to handle increasingly complex movements and interactions.

Leading commercial robot makers, robotics application developers, and robotics research entities around the world are adopting Isaac Lab, including 1X, Agility Robotics, The AI Institute, Berkeley Humanoid, Boston Dynamics, Field AI, Fourier, Galbot, Mentee Robotics, Skild AI, Swiss-Mile, Unitree Robotics, and Xpeng Robotics.

Advertisement

Project GR00T: Foundations for general-purpose humanoid robots

The humanoids are coming. Building advanced humanoids is extremely difficult, demanding multilayer
technological and interdisciplinary approaches to make the robots perceive, move and learn skills effectively for human-robot and robot-environment interactions.

Project GR00T is an initiative to develop accelerated libraries, foundation models and data pipelines to accelerate the global humanoid robot developer ecosystem.

Six new Project GR00T workflows provide humanoid developers with blueprints to realize the most challenging humanoid robot capabilities. They include things such as GR00T-Gen for building generative AI-powered, OpenUSD-based 3D environments and more.

“Humanoid robots are the next wave of embodied AI,” said Jim Fan, senior research manager of embodied AI at Nvidia, in a statement. “Nvidia research and engineering teams are collaborating across the company and our developer ecosystem to build Project GR00T to help advance the progress and development of global humanoid robot developers.”

Advertisement

Today, robot developers are building world models — AI representations of the world that can predict how objects and environments respond to a robot’s actions. Building these world models is incredibly compute- and data-intensive with models requiring thousands of hours of real-world, curated image or video data.

Nvidia Cosmos tokenizers provide efficient, high-quality encoding and decoding to simplify the development of these world models. They set a new standard of minimal distortion and temporal instability, enabling high-quality video and image reconstructions.

Providing high-quality compression and up to 12 times faster visual reconstruction, the Cosmos tokenizer paves the path for scalable, robust and efficient development of generative applications across a broad spectrum of visual domains.

1X, a humanoid robot company, has updated the 1X World Model Challenge dataset to use the Cosmos tokenizer.

Advertisement

“Nvidia Cosmos tokenizer achieves really high temporal and spatial compression of our data while still retaining visual fidelity,” said Eric Jang, vice president of AI at 1X Technologies, in a statement. “This allows us to train world models with long horizon video generation in an even more compute-efficient manner.”

Other humanoid and general purpose robot developers including Xpeng Robotics and Hillbot are developing with the Nvidia Cosmos tokenizer to manage high-resolution images and videos.

NeMo Curator

NeMo Curator now includes a video processing pipeline. This enables robot developers to improve their world-model accuracy processing large-scale text, image and video data.

Curating video data poses challenges due to its massive size, requiring scalable pipelines and efficient orchestration for load balancing across GPUs. Additionally, models for filtering, captioning and embedding need optimization to maximize throughput.

Advertisement

NeMo Curator overcomes these challenges by streamlining data curation with automatic pipeline orchestration, reducing processing time significantly. It supports linear scaling across multi-node multi-GPU systems, efficiently handling over 100 petabytes of data. This simplifies AI development, reduces costs and accelerates time to market.

Availability

Nvidia Isaac Lab 1.2 is available now and is open source on GitHub. Nvidia Cosmos tokenizer is available now on GitHub and Hugging Face. NeMo Curator for video processing will be available at the end of the month.

The new Nvidia Project GR00T workflows are coming soon to help robot companies build humanoid robot capabilities with greater ease.

For researchers and developers learning to use Isaac Lab, new getting started developer guides and tutorials are now available, including an Isaac Gym to Isaac Lab migration guide.

Advertisement

Source link
Advertisement
Continue Reading
Advertisement
Click to comment

You must be logged in to post a comment Login

Leave a Reply

Technology

The FTC comes after neobank Dave for misleading marketing, hidden fees

Published

on

Image of a robot hand holding a fistful of cash to represent funding for robotics startups.

The Federal Trade Commission (FTC) announced on Tuesday that it will be taking action against the online cash app and neobank Dave, which it says used “misleading marketing to deceive consumers.” At issue is how Dave marketed $500 cash advances to consumers that it rarely offered, and the “Express Fee” it charged if customers wanted their money immediately.

The FTC claimed the service was misleading because Dave’s marketing implied that its cash advances would be “instant,” using terminology like “on the spot” to describe them, without disclosing the fees involved until after the consumer completed the sign-up process and gave Dave access to their bank account.

The fees ranged anywhere from $3 to $25, the complaint stated. If the user chose not to pay the fee, they’d have to wait two to three business days for the standard transfer to go through, the complaint says. What’s more, the FTC says, Dave would also sometimes charge a surprise fee, which it described as a “tip.” The user interface was designed to make this difficult for users to detect or avoid the fee, leading to consumers feeling scammed, according to the FTC.

This latter issue is another example of the “dark patterns” — or manipulative design practices — companies use to guide users to take actions benefiting their own goals, not the consumers. Examples of the type of behavior the FTC now wants to penalize are things like automatically checking boxes when users sign up, or showing larger buttons for the actions the company wants users to take.

Advertisement

According to a recent study by the agency, a majority of subscription apps and websites use dark patterns to trick consumers.

In Dave’s case, consumers were shown images of a cartoon child surrounded by food and messaging like “10 Healthy Meals,” “15 Healthy Meals,” or “20 Healthy Meals,” implying that the tip would go to providing meals for people in need. However, the FTC says that only 10 cents of each “tip” is donated and the company keeps the remaining amount. In other words, the tip doesn’t actually provide a full meal, much less 10 to 20 meals. Also, when consumers tried to lower their tip, they would see an image of the food being taken away from the child until they were left with an empty plate, the complaint says.

According to SEC filings, Dave received more than $149 million in revenue from tips from 2022 through the first six months of 2024, the FTC said.

Another issue was that Dave charges a $1 monthly membership fee debited directly from customers’ bank accounts. But when users discovered the fee, they were not able to easily cancel it, according to the complaint. Some even tried to delete their account to escape the fee and were still charged, the FTC says.

Advertisement

The full complaint includes several screenshots of Dave’s tricky techniques, which the FTC says are in violation of Section 5(a) of the FTC Act and the Restore Online Shoppers’ Confidence Act (ROSCA). The agency is seeking an injunction to stop Dave from continuing its behavior and may also seek a monetary award or other relief as deemed by the court.

In response to the complaint, Dave said that it’s “disappointed” the FTC has chosen to file suit.

“The FTC asserts many incorrect claims regarding Dave’s disclosures and how the Company acquires consent for the fees associated with our products,” a company statement reads. “For the avoidance of doubt, Dave’s ability to charge subscription fees and optional tips and express fees is not in question. We believe this case is another example of regulatory overreach by the FTC, and we intend to vigorously defend ourselves. We take compliance and customer transparency very seriously and believe that we have always acted within the law. We remain focused on serving our members who love and rely on our products,” it said.

Source link

Advertisement

Continue Reading

Science & Environment

Knots made in a weird quantum fluid can last forever

Published

on

Knots made in a weird quantum fluid can last forever


Certain knots, like this trefoil, can be formed from vortices in a quantum fluid

Login/Shutterstock

By manipulating a quantum fluid, researchers could form liquid knots that never unravel. These could help us shed light on odd quantum objects from the dawn of the universe.

When tiny whirlpools called vortices form in a fluid, they can make loops that can then be knotted like a loop of string. But while a string can form knots that won’t unravel without the help of scissors, knotted vortices in a fluid break free more easily. They can explode into a diffuse swarm of…

Advertisement



Source link

Continue Reading

Technology

Did OpenAI just spend more than $10 million on a URL?

Published

on

Did OpenAI just spend more than $10 million on a URL?

On Wednesday, OpenAI CEO Sam Altman posted a simple URL on X: chat.com. It automatically routes to OpenAI’s popular chatbot, ChatGPT.

Prior to this, the domain was owned by Dharmesh Shah, the founder and CTO of HubSpot. In early 2023, Shah purchased the chat.com domain for $10 million. However, just a few months later, he announced that he had sold the domain, though he wouldn’t disclose the details of the sale or the buyer. Notably, he did confirm that he sold the domain for more than he had originally paid for it.

“The reason I bought chat.com is simple: I think Chat-based UX (#ChatUX) is the next big thing in software. Communicating with computers/software through a natural language interface is much more intuitive. This is made possible by Generative A.I,” Shah wrote in a LinkedIn post announcing the purchase — which chat.com briefly redirected to before he resold it. After the sale, Domain Name Wire noted that Shah had mentioned another buyer had been interested in the purchase and speculated he’d flipped it to them.

While the domain’s full ownership history remains unclear, domain sales database NameBio reports that chat.com sold for $15.5 million on March 28, 2023. This timing aligns with Shah’s LinkedIn post from May 25, 2023, announcing his sale after two months of ownership. OpenAI declined The Verge’s request for comment; Shah didn’t reply to a request for comment in time for publication. TechCrunch reported that OpenAI confirmed it acquired the domain.

Advertisement

The drop of “GPT” from the chat.com domain aligns with OpenAI’s recent rebranding efforts. In September, the company announced a new series of reasoning models starting with “o1.” At the time, former chief research officer Bob McGrew told The Verge he hoped that the o1 series would mark “the first step of newer, more sane names” to better communicate the company’s work. Still, as TechCrunch reported, the company isn’t hosting ChatGPT on chat.com, so this likely doesn’t represent an official name change.

People hoarding “vanity domains” is a tale as old as the Internet itself. Just a few months ago, AI startup Friend spent $1.8 million on the domain friend.com after raising $2.5 million in funding. For OpenAI, more than $10 million is a drop in the bucket — the startup just raised $6.6 billion.

Source link

Continue Reading

Technology

Dangerous Android banking malware looks to trick victims with fake money transfers

Published

on

An Android phone being held in the hand


  • ToxicPanda can initiate money transfers and even grab MFA codes
  • The banking trojan is targeting consumers in Europe and Latin America
  • More than 1,500 devices already compromised

A Chinese hacker is targeting Android devices in Europe and Latin America with a banking trojan able to steal money from victim’s accounts.

A new report from cybersecurity researchers Cleafy says the trojan, ToxicPanda, is quite similar to a piece of older, known malware called TgToxic, which was first spotted in 2023. The two have some similarities, although ToxicPanda can be described as a “lite” version, since many features seem to be stripped down, and some were left as simple placeholders.

Source link

Advertisement

Continue Reading

Technology

Sennheiser Momentum 4 headphones drop to $249.95

Published

on

Sennheiser Momentum 4 headphones drop to $249.95

Finding a great pair of wireless headphones isn’t terribly hard but there are so many options it can feel overwhelming, luckily you have a deal like this one on the Sennheiser Momentum 4 that you can look forward to. At their full retail price, these would normally cost you $379.95.

However, right now Amazon has them on sale for $249.95, so you save $130. That’s a pretty good deal that amounts to a 34% discount. Now this isn’t the lowest price we’ve seen them and based on price tracking from Camel Camel Camel, the all-time low was $219.95 back in October. Today’s price is somewhat close to this discount though and $130 off is nothing to scoff at.

Sennheiser Momentum 4 Price History

Now one thing worth noting is that this deal is for the White color of these headphones. All the other colors are $290 or higher, so technically this deal is the lowest price if you factor in those other color options. The Sennheiser Momentum 4 is a premium pair of wireless headphones with several noteworthy features that make it a desirable pair of headphones for music. For one, they have a battery life of up to 60 hours. That’s an astounding amount of listening time on a single charge.

They also have adaptive noise cancellation so you can block out the world when listening to all of your audio. They’re also built with premium materials and are super comfortable to wear for long periods of time. These come with some nice extras as well, including an airplane adapter and a 3.5mm AUX cable if you want to use these as a wired pair to conserve battery life. Additionally, they support voice assistants and easy-to-use touch controls for various functions.

Advertisement

Buy at Amazon

Source link

Continue Reading

Technology

Early Black Friday deal takes $1,300 off the LG C4 OLED

Published

on

Early Black Friday deal takes $1,300 off the LG C4 OLED

Amazon has a deal on one of LG’s premium OLED TVs ahead of Black Friday. The 65-inch LG OLED evo C4, which only arrived earlier this year, typically costs $2,700. Today, you can get it for an all-time low of $1,394. That’s even lower than its October Prime Day sale price.

Although the C4 skips out on some bells and whistles of the ultra-premium LG G4 flagship TV, that model starts at $2,600 and goes all the way up to $25,000. (Cue spit take.)

LG

The LG C4 includes AI features, thanks to its Alpha 9 Gen 7 chip. That enables AI Super Upscaling, which enhances your picture quality on the fly. Meanwhile, Multi View lets you split your screen into two, letting you plop your favorite content on each side.

Even if AI features aren’t high on your priority list, the TV has plenty of presentational perks. The 65-inch display has over eight million self-lit pixels and all the quality improvements you’d expect from OLED, like deeper blacks and richer colors. The TV has 100 percent color volume (meaning it can display the full range of colors at any brightness level) and 100 percent color fidelity (content-accurate colors). It boasts a 0.1ms response time and up to a 144Hz refresh rate for high gaming frame rates.

Advertisement

The TV gets brighter than its predecessor, reaching nearly nearly 1,000 nits. Its brightness booster feature magnifies individual pixels. If you have an LG soundbar, you can transmit wireless, lossless Dolby Atmos audio from the TV to it. As Engadget’s Steve Dent summarized at launch, that feature can give you high-quality surround sound with less hassle.

The TV supports Alexa out of the box if your smart home is plugged into Amazon’s ecosystem. Its array of ports includes USB, Ethernet and four HDMI inputs.

Check out all of the latest Black Friday and Cyber Monday deals here.

Source link

Advertisement

Continue Reading

Trending

Copyright © 2024 WordupNews.com