Connect with us

Technology

Inflection helps fix RLHF uninformity with unique models for enterprise, agentic AI

Published

on

Inflection helps fix RLHF uninformity with unique models for enterprise, agentic AI

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More


A recent exchange on X (formerly Twitter) between Wharton professor Ethan Mollick and Andrej Karpathy, the former Director of AI at Tesla and co-founder of OpenAI, touches on something both fascinating and foundational: many of today’s top generative AI models — including those from OpenAI, Anthropic, and Google— exhibit a striking similarity in tone, prompting the question: why are large language models (LLMs) converging not just in technical proficiency but also in personality?

The follow-up commentary pointed out a common feature that could be driving the trend of output convergence: Reinforcement Learning with Human Feedback (RLHF), a technique in which AI models are fine-tuned based on evaluations provided by human trainers. 

Building on this discussion of RLHF’s role in output similarity, Inflection AI’s recent announcements of Inflection 3.0 and a commercial API may provide a promising direction to address these challenges. It has introduced a novel approach to RLHF, aimed at making generative models not only consistent but also distinctively empathetic. 

Advertisement

With an entry into the enterprise space, the creators of the Pi collection of models leverage RLHF in a more nuanced way, from deliberate efforts to improve the fine-tuning models to a proprietary platform that incorporates employee feedback to tailor gen AI outputs to organizational culture. The strategy aims to make Inflection AI’s models true cultural allies rather than just generic chatbots, providing enterprises with a more human and aligned AI system that stands out from the crowd.

Inflection AI wants your work chatbots to care

Against this backdrop of convergence, Inflection AI, the creators of the Pi model, are carving out a different path. With the recent launch of Inflection for Enterprise, Inflection AI aims to make emotional intelligence — dubbed  “EQ” — a core feature for its enterprise customers. 

The company says its unique approach to RLHF sets it apart. Instead of relying on anonymous data-labeling, the company sought feedback from 26,000 school teachers and university professors to aid in the fine-tuning process through a proprietary feedback platform. Furthermore, the platform enables enterprise customers to run reinforcement learning with employee feedback. This enables subsequent tuning of the model to the unique voice and style of the customer’s company.

Inflection AI’s approach promises that companies will “own” their intelligence, meaning an on-premise model fine-tuned with proprietary data that is securely managed on their own systems. This is a notable move away from the cloud-centric AI models many enterprises are familiar with — a setup Inflection believes will enhance security and foster greater alignment between AI outputs and the ways people use it at work.

Advertisement

What RLHF is and isn’t

RLHF has become the centerpiece of gen AI development, largely because it allows companies to shape responses to be more helpful, coherent, and less prone to dangerous errors. OpenAI’s use of RLHF was foundational to making tools like ChatGPT engaging and generally trustworthy for users. RLHF helps align model behavior with human expectations, making it more engaging and reducing undesirable outputs.

However, RLHF is not without its drawbacks. RLHF was quickly offered as a contributing reason to a convergence of model outputs, potentially leading to a loss of unique characteristics and making models increasingly similar. Seemingly, alignment offers consistency, but it also creates a challenge for differentiation.

Previously, Karpathy himself pointed out some of the limitations inherent in RLHF. He likened it to a game of vibe checks, and stressed that it does not provide an “actual reward” akin to competitive games like AlphaGo. Instead, RLHF optimizes for an emotional resonance that’s ultimately subjective and may miss the mark for practical or complex tasks. 

From EQ to AQ

To mitigate some of these RLHF limitations, Inflection AI has embarked on a more nuanced training strategy. Not only implementing improved RLHF, but it has also taken steps towards agentic AI capabilities, which it has abbreviated as AQ (Action Quotient). As White described in a recent interview, Inflection AI’s enterprise aims involve enabling models to not only understand and empathize but also to take meaningful actions on behalf of users — ranging from sending follow-up emails to assisting in real-time problem-solving.

Advertisement

While Inflection AI’s approach is certainly innovative, there are potential short falls to consider. Its 8K token context window used for inference is smaller than what many high-end models employ, and the performance of their newest models has not been benchmarked. Despite ambitious plans, Inflection AI’s models may not achieve the desired level of performance in real-world applications. 

Nonetheless, the shift from EQ to AQ could mark a critical evolution in gen AI development, especially for enterprise clients looking to leverage automation for both cognitive and operational tasks. It’s not just about talking empathetically with customers or employees; Inflection AI hopes that Inflection 3.0 will also execute tasks that translate empathy into action. Inflection’s partnership with automation platforms like UiPath to provide this “agentic AI” further bolsters their strategy to stand out in an increasingly crowded market.

Navigating a post-Suleyman world

Inflection AI has undergone significant internal changes over the past year. The departure of CEO Mustafa Suleyman in Microsoft’s “acqui-hire,” along with a sizable portion of the team, cast doubt on the company’s trajectory. However, the appointment of White as CEO and a refreshed management team has set a new course for the organization. 

This “re-founding” centered around the enterprise use of emotional AI, aiming to provide personalized and deeply embedded AI experiences rather than generic chatbot solutions.

Advertisement

Inflection AI’s unique approach with Pi is gaining traction beyond the enterprise space, particularly among users on platforms like Reddit. The Pi community has been vocal about their experiences, sharing positive anecdotes and discussions regarding Pi’s thoughtful and empathetic responses. 

This grassroots popularity demonstrates that Inflection AI might be on to something significant. By leaning into emotional intelligence and empathy, Inflection is not only creating AI that assists but also AI that resonates with people, whether in enterprise settings or as personal assistants. This level of user engagement suggests that their focus on EQ could be the key to distinguishing themselves in a landscape where other LLMs risk blending into one another.

What’s next for Inflection AI

Moving forward, Inflection AI’s focus on post-training features like Retrieval-Augmented Generation (RAG) and agentic workflows aims to keep their technology at the cutting edge of enterprise needs. Inflection AI says the ultimate goal is to usher in a post-GUI era, where AI isn’t just responding to commands but actively assisting with seamless integrations across various business systems.

The jury’s still out on whether Inflection AI’s novel approach will significantly enhance output similarity. However, if White and his team’s innovative ideas bear fruit, EQ could emerge as a pivotal metric for evaluating the effectiveness of your company’s generative technology.

Advertisement

Source link
Advertisement
Continue Reading
Advertisement
Click to comment

You must be logged in to post a comment Login

Leave a Reply

Technology

Monsarrat unveils outdoor RPG demo with AR gameplay

Published

on

Monsarrat unveils outdoor RPG demo with AR gameplay

Johnny Monsarrat helped initiate the era of the massively multiplayer online game with Asheron’s Call in 1999. He hopes to establish a new category of games again with an outdoor role-playing game called Landing Party.

Los Angeles-based Monsarrat, a company named after its founder, launched the game earlier this summer as a mobile game played with augmented reality tech, using a smartphone’s camera and superimposing animated graphics on the real world. It’s been done before, but Monsarrat has filed for patents for features like being able to move the gaming landscape when real world obstructions get in the way.

Monsarrat was previously one of the founders of Turbine, the maker of MMOs including Asheron’s Call, Dungeons & Dragons Online and The Lord of the Rings Online. Warner Bros. bought Boston-based Turbine in 2010 for $160 million.

Now Monsarrat is moving gaming to the outdoors. Such outdoor walking games were defined in 2016 by Niantic’s Pokémon Go, which has earned a staggering $8 billion, including $566 million just in 2023. But Monsarrat said that Pokémon Go gameplay has nothing like the creativity and community of powerhouse MMO games that Monsarrat knows so well.

Advertisement

Join us for GamesBeat Next!

GamesBeat Next is almost here! GB Next is the premier event for product leaders and leadership in the gaming industry. Coming up October 28th and 29th, join fellow leaders and amazing speakers like Matthew Bromberg (CEO Unity), Amy Hennig (Co-President of New Media Skydance Games), Laura Naviaux Sturr (GM Operations Amazon Games), Amir Satvat (Business Development Director Tencent), and so many others. See the full speaker list and register here.


Monsarrat wants to get people playing RPGs outdoors.

And while outdoor games can be challenging, they’re not as physically taxing as sports, which are too athletic for a lot of people, Monsarrat.

“Some people don’t want to get exhausted or sweat, or they just want something more creative,” he said. “I think about roleplaying games like what I used to make on PC. They tend to make more money per player. The KPIs are better for role playing games. People get caught up in the story,” he said. “If you join a team, it has team goals. You’ve got to keep playing the game. That improves player retention. You make some friends. You want to see your friends. You’ve got to keep playing the game.”

He added, “MMOs are more efficient on PC, on console, on mobile. And I mean, this is my hypothesis. I think the MMO or RPG games should be more efficient outdoors. So what I’m saying is I don’t have to be a massive Pokemon Go hit to make serious money because the economics should be more efficient.”

Advertisement

Live demo

Gamers have tried out Monsarrat’s Landing Party demo game.

I played a demo of Monsarrat’s game multiple times during its development. Recently, I played the Landing Party game in a parking lot in my hometown.

During the demo, the game started up and I could see an image on my camera screen. I could help it identify the planet of the ground, and then it was ready to go. It has to know where the ground is so it doesn’t put objects that should be on the ground in the air. It’s easy to move the game map if you encounter an obstacle like a parked car or fence. You simply hold a button down and turn your body, moving the game world as your body moves. Then you reposition it so you can walk in a different direction. That’s one of the patented features.

“It’s like you aree in the park and you have a family playing frisbee. There’s a park bench in your way, and you can move the game around,” Monsarrat said.

With one feature, there is a two-dimensional game zone on the map. You walk through it like the Holodeck in Star Trek. You have to shoot a gun at some big monsters and navigate through rocky or jungle-like areas. It’s meant to be immersive.

If there is a character in the game and you walk right into the character, the whole character and the world gets pushed backward. So you can’t walk through virtual walls. Some monsters appear and you shoot them with the gun and escort a couple of characters to a landing ship so they can escape.

Advertisement

In another quest, you have a Geiger counter and you’re searching for a source of radiation. The sound of the counter gets louder as you near the radiation, and it grows faint if you move away from it. You can play this game with other players, and you can also play via remote multiplayer as well. Eventually, all of this could be a full MMO.

In Monsarrat’s games, there are no fixed locations. Players can enjoy the game anywhere where there is some room to walk.

“Even a small space, if you can walk around, you can play it. Also, the game is more creative. It’s got real community.”

The Landing Party game has around 12 quests. It can be played in a relatively short time. But Monsarrat believes any game can be divided into a number of small quests. The company is in talks with licensors about securing intellectual property for games.

Advertisement

The success of AR and location-based games

Landing Party game.

Niantic has had some successes like Monster Hunter Now, which has generated $150 million in revenue. But Niantic has struggled to evolve its entry level Pokémon Go, where you collect stuff, into mature products with better performing player retention and monetization.

Monsarrat’s new launch, Landing Party, is backed up by four patents. It’s an outdoor RPG inspired by its founder’s background in MMOs. Instead of placing one creature at a GPS point, Landing Party lays out a fantasy world across an open map space, like a park or a parking lot, where the player walks through to play. The game has no fixed locations, allowing players to set their next game mission in a backyard, a local park, or any other open space, even a small one.

“In the global crisis of loneliness, people are craving a reason to go outdoors,” said Monsarrat. “But some people aren’t drawn to sports. They want an alternative outdoor activity that’s more creative and less athletic. That’s what we’re building, and we see three key market drivers: creativity, community, and convenience.”

Landing Party is so far just a demo game, but it’s free and has 12 missions that could be the future of outdoor video games. It is now available on Apple App Store and Google Play.

Monsarrat is now seeking business partnerships, and funding to build out the future full game. Monsarrat believes that current outdoor games are just focused on collecting and get boring quickly. That’s why he wants to take roleplaying, a strong game type that has proven key performance indicators on PC, console, and mobile — and bring it outdoors.

Advertisement

He noted that Pokémon Go’s technology is a database of fixed map points, which can only support “collecting stuff” gameplay. Its popularity speaks to the power of the intellectual property and the need to get people going outside in the global crisis of loneliness, Monsarrat said. He thinks later Niantic games like Harry Potter, NBA and Marvel failed as fans wanted deep stories and roleplaying adventures which Niantic’s fixed GPS points didn’t support.

Even so, Pokémon Go persists as a top 10 mobile game even though it’s eight years old. That suggests that AR walking games can still be hits. Besides Pokemon Go, other hits include Jurassic World Alive, Monster Hunter Now and Dragon Quest Walk.

As a market, such games are earning nearly $1 billion a year in revenue. Roughly 90% of smartphones now support AR, compared to less than half in 2019. Disney is making a Kingdom Hearts game and Disney Step.

And Mark Zuckerberg, CEO of Meta, recently showed off a new pair of AR glasses, dubbed Orion, as a new product coming soon. Monsarrat believes consumers aren’t waiting for AR headsets, as 30% of Americans already use AR for face filters, shopping, and games. Apple Vision Pro didn’t sell well to consumers, but it also cost $3,500. Apple is still investing for the future products.

Advertisement

Monsarrat believes the power of storytelling and more player interaction can help outdoor gaming. And people are already playing AR games.

Origins

Johnny Monsarrat is making outdoor MMOs.

    Monsarrat was a mentor at a college and met a contestant who had an AR application. Monsarrat saw an opportunity to make tools to make AR games. That summer, Pokemon Go came out and it became possible to raise a small amount of funding.

    “They thought like a mapping company. It turned out their fixed map points were not good for storytelling,” he said. “I’m not trying to copycat Pokemon Go. With my background in gaming, I want to build a different type of game. I think of outdoor gaming as a platform. It’s funny that there’s only one type of outdoor game — collecting games. Well, there’s dozens of different game types. Why shouldn’t there be more game types for this new platform, outdoor gaming? So we’re making the role playing part of it.”

    Monsarrat started the company back in 2016 and rebooted it in 2021. To date, the company has raised $2 million in funding, after securing some key patents. He has added advisers such as Yucheng Chiang, CEO of Top Golf, Jenna Seiden of Skydance Interactive, ex-Blizzard chief Mike Ybarra, former PlayStation head Jack Tretton, Sandy Kleinman of Universal Studios and Brad Bao, head of scooter maker Lime.

    The game has been cooking for a while. He showed the game off at Augmented World Expo and has shown off versions of its at the Game Developers Conference and GamesBeat events.

    Advertisement

    “Now that we have a demo game, I’m starting to ramp up. I’m looking at making a Hollywood deal and we’re looking at going to launch,” he said. “With a full game, we hope to do it within a couple of years.”

    The company has 12 people, with developers based mostly in Poland. Back during the development of Asheron’s Call, the development team took over his mother’s house. During that time, Monsarrat was hit by a car in an accident while he was walking on the sidewalk. He wasn’t seriously hurt, and he took the $30,000 and put it into the company. He changed careers and became a human genome expert and also became a travel writer. But he was drawn back to games and got an MBA.

    “I was drawn back because of Pokemon Go,” he said.

    But the gameplay has advances that make it easier to play outdoor games, where obstacles can get in the way.

    Advertisement

    “The most important features we have are all about ease of use. Most players don’t need to live next to a big park. They can live next to a small park, or they want to play in a very small space, like their indoor living room or their own backyard,” he said. “Making the game practical in small spaces is really what it’s all about. And our four patents, and also two that are coming in the pipeline, all relate to that.”


Source link
Continue Reading

Servers computers

0814 Three datacenter servers with compute blades in a rack side by side ppt Slides

Published

on

0814 Three datacenter servers with compute blades in a rack side by side ppt Slides

source

Continue Reading

Technology

Epic v. Google: everything we’re learning live in Fortnite court

Published

on

Epic v. Google: everything we’re learning live in Fortnite court

Epic: “I agree with Google, we need to look at the real world.”

Epic is getting eight minutes of rebuttal to Google’s closing argument, and lead attorney Gary Bornstein is using part of it to argue this: we should look at the internal documents in this case to see what’s actually going on.

“What did they say in their documents? That tells you what they believed in the real world.”

He begins by showing one of the emails Google showed us about reacting to an Apple change in price — and that Google chose not to follow that price change at the time.

Advertisement

“They chose not to change their price despite believing that Apple was changing theirs,” he says, and “during that time not a single developer pulled out of the Play Store to focus on iOS.”

Source link

Continue Reading

Technology

Hardware startup wants to solve the multi billion dollar problem of bandwidth by using an ancient technique — AI memory compression technique could save Google, Microsoft billions but Nvidia won’t be happy

Published

on

Hardware startup wants to solve the multi billion dollar problem of bandwidth by using an ancient technique — AI memory compression technique could save Google, Microsoft billions but Nvidia won't be happy

Swedish firm ZeroPoint Technologies, a spin-off from Chalmers University of Technology in Gothenburg, was founded by Professor Per Stenström and Dr. Angelos Arelakis with the goal of delivering efficient real-time memory compression across the entire memory system. The company seeks to maximize server efficiency by addressing memory bottlenecks, potentially saving hyperscalers like Microsoft, Meta, and Google, as well as large enterprises, substantial costs.

ZeroPoint claims its technology eliminates up to 70% of unnecessary data in microchip memory through a combination of ultra-fast compression, real-time data compaction, and efficient memory management. This approach maximizes performance per watt and tackles the long-standing challenge of memory bottlenecks that have hindered performance scaling for decades.

Source link

Continue Reading

Servers computers

Dell PowerEdge R840 Rack Server – Overview, Specifications, Benefits & Uses

Published

on

Dell PowerEdge R840 Rack Server - Overview, Specifications, Benefits & Uses



Buy New Dell PowerEdge R840 Rack Server :-https://www.serverbasket.com/shop/dell-emc-poweredge-r840-server/
For Complete Information on Dell PowerEdge R840 Rack Server, Please Contact Us at:
Website: https://www.serverbasket.com
Email: sales@serverbasket.com
Toll-Free No: 1800 123 1346
WhatsApp: +91 7337330401
———————————————————————————————————–
Subscribe To Our Channel @ https://www.youtube.com/channel/UCO8bZFM0NzVsjG7Ss83LvOQ
———————————————————————————————————–

Check out the Powerful Dell PowerEdge R840 Rack Server.

Key Benefits:

– Maximize Application Performance
– Automate Maintenace With OpenManage Enterprise
– Scalable Resources
– Power Your Business- Critical Workloads
– Guard Your Data Center With Built-In Security
– Enterprise Support From Dell
– Instant Delivery
– 24/7 Technical Assistance
– Best Price in Market
– Quick Support

Dell PowerEdge R840 Rack Server Specifications:

CPU Capacity:

– Supports 4 Processors
– Intel® Xeon® Scalable Processors
– Single CPU: 28 Cores Max
– Quad CPU: 112 Cores Max
– Max VCPUs: 224 VCPUs

RAM Capacity:

– Inbuilt 48 DIMM Slots
– 128 GB Max Memory Per DIMM Slot
– 6 TB Maximum Memory Capacity
– Supported Technology: DDR4 Memory

Storage Capacity:

-Up To 8 x 2.5″ SAS SATA (HDDs/SSDs) Max 30TB
-Up To 24 x 2.5″ SAS/SATA(HDDs/SSDs) With
-Up To 12 NVMe PCIe SSDs Max 122 TB
-Up to 24 NVMe PCIe SSDs Max 153 TB

Max potential Storage: 153 TB

Raid Controller :

Internal Controllers: PERC H730P, H740P, H330 Software RAID (SWRAID) S140
Boot Optimized Storage Subsystem: HW RAID 2 x M.2 SSDs 120GB or 240 GB

External PERC (RAID): H840
12Gbps SAS HBAs (non-RAID): External-12Gbps SAS HBA (non-RAID), Internal- HBA330 (non-RAID)

Power Supply:

-Platinum: 750W,1100W, 1600W, 2000W, 2400W
-Titanium: 750W
-DC: 1100W
-Mix Mode/HVDC: 750W, 1100W1
-Hot plug power supplies with full redundancy option
-6 hot plugs fans with N +1 redundancy

Operating System:

-Canonical® Ubuntu® LTS
-Citrix® XenServer®
-Microsoft Windows Server® with Hyper-V
-Red Hat® Enterprise Linux
-SUSE® Linux Enterprise Server
-VMware® ESXi

Optional embedded hypervisors:

-Microsoft Windows Server with Hyper-V®
-Citrix® XenServer®
-VMware vSphere ESXi

Embedded management:

-iDRAC9 with Lifecycle Controller
-iDRAC Direct
-iDRAC RESTful API with Redfish
-Quick Sync 2 BLE/wireless

———————————————————————————————————–
Check out the Powerful Dell PowerEdge R840 Rack Server from Server Basket.
———————————————————————————————————–
#DellPowerEdegeR840Sever #DellR840 #DellR840Sever #ServerBasket .

source

Continue Reading

Technology

What’s Next? review: Bill Gates’s Netflix series offers some dubious ideas about the future

Published

on

Bill Gates in What?s Next: The Future with Bill Gates. Cr. Netflix ? 2024
Bill Gates in What?s Next: The Future with Bill Gates. Cr. Netflix ? 2024

Bill Gates thinks the ultra-rich should give away their wealth, as he does

Rob Liggins/Netflix

What’s Next? The future with Bill Gates
Netflix

When you want to imagine the future, who do you turn to? Friends and family? Science fiction? New Scientist? Now you can check in with Bill Gates, as the Microsoft co-founder and multibillionaire has worked with Netflix on What’s Next? The future with Bill Gates, in which he digs into make-or-break issues: artificial intelligence, misinformation, climate change, income inequality and disease.

Advertisement

The five-part series is uneven, though, and the worst instalment is perhaps the first, “What can…

Source link

Continue Reading

Trending

Copyright © 2024 WordupNews.com