Connect with us

Technology

Together AI promises faster inference and lower costs with enterprise AI platform for private cloud

Published

on

Together AI promises faster inference and lower costs with enterprise AI platform for private cloud

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More


Running AI in the public cloud can presents enterprises with numerous concerns about data privacy and security.

That’s why some enterprises will choose to deploy AI on a private cloud or on-premises environment. Together AI is among the vendors looking to solve the challenges of effectively enabling enterprises to deploy AI in private clouds in a cost effective approach. The company today announced its Together Enterprise Platform, enabling AI deployment in virtual private cloud (VPC) and on-premises environments.

Together AI made its debut in 2023, aiming to simplify enterprise use of open-source LLMs. The company already has a full-stack platform to enable enterprises to easily use open source LLMs on its own cloud service. The new platform extends AI deployment to customer-controlled cloud and on-premises environments. The Together Enterprise Platform aims to address key concerns of businesses adopting AI technologies, including performance, cost-efficiency and data privacy.

Advertisement

“As you’re scaling up AI workloads, efficiency and cost matters to companies, they also really care about data privacy,” Vipul Prakash, CEO of Together AI told VentureBeat. “Inside of enterprises there are also well-established privacy and compliance policies, which are already implemented in their own cloud setups and companies also care about model ownership.”

How to keep private cloud enterprise AI cost down with Together AI

The key promise of the Together Enterprise Platform is that organizations can manage and run AI models in their own private cloud deployment.

This adaptability is crucial for enterprises that have already invested heavily in their IT infrastructure. The platform offers flexibility by working in private clouds and enabling users to scale to Together’s cloud.

A key benefit of the Together Enterprise platform is its ability to dramatically improve the performance of AI inference workloads. 

Advertisement

“We are often able to improve the performance of inference by two to three times and reduce the amount of hardware they’re using to do inference by 50%,” Prakash said. “This creates significant savings and more capacity for enterprises to build more products, build more models, and launch more features.” 

The performance gains are achieved through a combination of optimized software and hardware utilization.

 “There’s a lot of algorithmic craft in how we schedule and organize the computation on GPUs to get the maximum utilization and lowest latency,” Prakash explained. “We do a lot of work on speculative decoding, which uses a small model to predict what the larger model would generate, reducing the workload on the more computationally intensive model.”

Flexible model orchestration and the Mixture of Agents approach

Another key feature of the Together Enterprise platform is its ability to orchestrate the use of multiple AI models within a single application or workflow. 

Advertisement

“What we’re seeing in enterprises is that they’re typically using a combination of different models – open-source models, custom models, and models from different sources,” Prakash said. “The Together platform allows this orchestration of all this work, scaling the models up and down depending on the demand for a particular feature at a particular time.”

There are many different ways that an organization can orchestrate models to work together. Some organizations and vendors will use technologies like LangChain to combine models together. Another approach is to use a model router, like the one built by Martian, to route queries to the best model. SambaNova uses a Composition of Experts model, combining multiple models for optimal outcomes.

Together AI is using a different approach that it calls – Mixture of Agents. Prakash said this approach combines multi-model agentic AI with a trainable system for ongoing improvement. The way it works is by using “weaker” models as “proposers” – they each provide a response to the prompt. Then an “aggregator” model is used to combine these responses in a way that produces a better overall answer.

“We are a computational and inference platform and agentic AI workflows are very interesting to us,” he said. “You’ll be seeing more stuff from Together AI on what we’re doing around it in the months to come.”

Advertisement

Source link
Advertisement
Continue Reading
Advertisement
Click to comment

You must be logged in to post a comment Login

Leave a Reply

Technology

Amazon October Prime Day: how to find the best deals

Published

on

Amazon October Prime Day: how to find the best deals

Amazon Prime Day is one of the biggest shopping events of the year outside of Black Friday and Cyber Monday, with this year’s autumnal incarnation (once again dubbed Prime Big Deal Days) running from October 8th through the 9th. The two-day shopping affair will likely grant Prime members access to some of the best prices of the year on Amazon devices, as well as products from Sony, Sonos, Peloton, Withings, and other well-known brands. This applies to items spanning a range of categories, including gaming peripherals, laptops, 4K TVs, phones, PC accessories, and more.

As always, you can count on us to publish only the best deals during Prime Big Deal Days — as well as any worthwhile ones featured at Walmart, Best Buy, and other competing retailers. That said, if you want to be sure you catch any and all deals that are most important to you — or be among the first to know of certain price drops — we’ve compiled some helpful tools and advice.

Below, we’ve spelled out a few of our biggest deal-hunting tips, from how to use automated price trackers to the different ways you can set up your own personalized deal alerts. All of these methods and tools are free to use, and once you put in just a little bit of work, you can rest easy knowing that you don’t need to take much action until it comes time to make a purchase.

Use a price-tracking tool or deal aggregator

Advertisement

CamelCamelCamel’s extension helps you keep tabs on historical price trends with useful graphs like these.
Screenshot: CamelCamelCamel

CamelCamelCamel tracks the price of every product sold on Amazon and can send you alerts when they reach the price that’s right for you. Once a product reaches the desired price you’ve set or lower, you’ll get an email about it. CamelCamelCamel only works for products on Amazon, however, so you’ll need to use a different one below if you want to track price movement at Walmart, Best Buy, Target, and other retailers.

To track prices and get alerts via email, you’ll need to create a free account. Also, we suggest installing the site’s browser extension, called The Camelizer, which lets you see pricing trends on a product-by-product basis and allows you to set your desired price without navigating away from Amazon. It’s fantastic and easy to use.

As soon as one of the products falls below the amount set on your price alert, you’ll instantly get an email. And if you already have a wishlist saved on Amazon, you can import it into CamelCamelCamel.

Advertisement

Honey’s price-tracking feature can automatically find coupons on your behalf when viewing a product.
Screenshot: Honey

Like CamelCamelCamel, the PayPal Honey browser extension can track the prices of items you’re interested in, and it will alert you via email when it finds a deal. However, unlike the price-tracking site above, Honey will also scour each site you visit for offer codes that can be applied to your checkout total to save you even more money.

Honey works with Amazon and many other retailers, and you can add items to your “Droplist,” which is basically just a wishlist. In most instances, the option to add an item to your list pops up on the right-hand side, and you can select the price watch duration as well as the percentage off you’re looking for. As an added convenience, Honey will also automatically add items you frequently browse to your Droplist thanks to its so-called “Smart Droplist” feature, which can be turned on and off at your discretion.

Slickdeals allows you to set up custom alerts for specific keywords, though finding the right parameters can be a trial and error process.
Screenshot: Slickdeals

Advertisement

Slickdeals aggregates some of the best deals around the internet, as discovered by its team and community of users. It’s a great place to find a curated set of deals on things you might be interested in. The site also allows you to create deal alerts based on keywords, but they work a little differently on Slickdeals than they do on the above sites.

You can type in a product name, like “Sonos Era 100” or a retailer’s name, and once it’s added to your list, you’ll be notified of a deal alert if it meets your criteria. You can set it to alert you to any deal related to your keyword, or you can filter out deals so that you’ll be notified if, for example, the deal is popular enough to make it to Slickdeals’ front page or earned a high rating from the community. Setting these keywords a little too broadly may result in frequent notification pings and emails, though, so you’ll need to use some discretion and find the right balance of how aggressively you want Slickdeals to notify you.

Unlike the Honey extension and The Camelizer, Keepa integrates historical pricing data directly into the Amazon product listing.
Screenshot: Keepa

Keepa is another handy tool you can use to track and compare Amazon prices over time. Like CamelCamelCamel, Keepa provides charts that track pricing trends and will alert you when it finds a deal. You can also import any wishlists you’ve previously saved on Amazon.

Advertisement

Unlike CamelCamelCamel, however, you don’t necessarily need to create an account in order to track prices with Keepa. You just need to install the extension, and Keepa will automatically add a price history graph to supported product listings. The embedded extension features different tabs as well, one of which showcases pricing history and another that allows you to specify various pricing details. Once you’ve set your desired price, you’ll then receive price alerts via email, push notification, Telegram, or RSS.

Set up deal alert notifications through Alexa or the Amazon app

If you’re a Prime member who owns a fourth-gen Echo speaker or a newer model, you can also request that Amazon send you deal notifications up to 24 hours ahead of time on products you’re interested in. Amazon can alert you of price drops on eligible products in your shopping cart or wishlist, as well as anything you’ve marked as “saved for later.” To enable the feature, tap More > Settings > Notifications in the Alexa app, and then tap Amazon Shopping. Then, scroll down to Shopping Recommendations and enable Deal Recommendations. Once done, you’ll receive a notification on both your device and your Echo speaker (the latter in the form of a yellow ring) notifying you of the deal.

Alternatively, you can sign up to receive deal alerts regarding products you’ve recently viewed in the Amazon Shopping app, as well as those related to your recent search history. If you’re a Prime member, you just need to navigate to the Prime Big Deal Days event page in the mobile app between now and October 8th to create the alert. Once done, you’ll receive push notifications for any deal(s) you’ve subscribed to when the event begins on October 8th. You can also just open the Amazon Shopping app and tap Settings > Notifications > Deals and Recommendations before toggling “Savings” and / or “Recommendations.”

Advertisement

Look for deals outside of Amazon

Prime Day and Prime Big Deal Days are events that show off Amazon’s huge retail presence, so, naturally, other retail chains take notice. Because of this, you can sometimes find better deals at retailers like Target, Walmart, and Best Buy. At the very least, they may be able to match Amazon’s pricing if you ask.

If Amazon’s upcoming sale doesn’t have everything you want or if you just want to make sure you’re getting the best deal, shop around a bit. Walmart will be hosting its own sale starting on October 8th, for example, and Target plans to run a “Circle Week” promo for members of its free Target Circle program starting on October 6th. And once again, you’ll be able to find all of our deals coverage in and outside of Amazon here.

Trust the experts

Advertisement

We’re a discerning bunch here at The Verge, so don’t fret if you’re going into this without any prep. We’ll be corralling the best tech deals and keeping our coverage up to date in the run-up to the main event. So mark October 8th and 9th on your calendar, sign up for Amazon Prime and our new and improved Verge Deals newsletter, and maybe start putting aside a little spending cash.

Source link

Continue Reading

Technology

Pretty Little Liars reboot canceled after two seasons on Max and I’m now not sure I can trust the show’s 90% Rotten Tomatoes score

Published

on

Zaria, Chandler Kinney, Bailee Madison, Maia Reficco, and Malia Pyles posing against school lockers.

School’s out for Pretty Little Liars: Summer School as Max has canceled the show after two seasons.

One of the best streaming services has decided not to renew the series three months after it ended on Max. The reboot is a horror twist on the original 2010 hit mystery drama series Pretty Little Liars and was originally called Pretty Little Liars: Original Sin (2022) before being renamed to Pretty Little Liars: Summer School in the second season.

Source link

Continue Reading

Technology

Transformers: Why the T in ChatGPT is AI’s biggest breakthrough – and greatest risk

Published

on

New Scientist. Science news and long reads from expert journalists, covering developments in science, technology, health and the environment on the website and the magazine.
New Scientist. Science news and long reads from expert journalists, covering developments in science, technology, health and the environment on the website and the magazine.

A good neural network architecture is vital when developing artificial intelligence

SHUTTERSTOCK/Qpt

When ChatGPT first took the world by storm in 2022, its capabilities were so impressive that people happily looked past its awkward name. Yet hidden within those initials lies a key breakthrough responsible for sending artificial intelligence rocketing these past few years – and potentially a limitation that could see it crashing back to Earth.

GPT stands for generative pre-trained transformer, and it is the last word that matters most. The term was coined in a 2017 paper by a team at Google, which introduced a concept called…

Advertisement

Source link

Continue Reading

Technology

Stellar Blade now subject of trademark lawsuit

Published

on

Stellar Blade now subject of trademark lawsuit
EVE stares at an enemy in Stellar Blade.
Sony Interactive Entertainment

Stellar Blade has been the subject of some strange controversies since its release in late April, but one of the strangest has to be a recent lawsuit filed against developer Shift Up and Sony that claims its name is guilty of trademark infringement.

IGN reports that the lawsuit was filed in a Louisiana court earlier this month by Griffith Chambers Mehaffey, the owner of film production company called Stellarblade LLC. His lawyers claim that he’s been using stellarblade.com since 2006, and that his company has existed since 2010. However, the game’s release has made it tougher for people to find information about his business.

Mehaffey is seeking damages and for Sony and Shift Up to no longer use the name “Stellar Blade.”

Additionally, the suit claims that the trademarks for his business and Shift Up’s game look “confusingly similar.” Both have blue color schemes and a stylized S, although the two look very different otherwise.

This wasn’t a problem back when the game was announced in 2019 under the name Project EVE, although Sony revealed the Stellar Blade name at its September 2022 State of Play According to U.S. Patent and Trademark Office, the Stellar Blade trademark was initially filed in January 2023, with an “opposition” filed on September 11, 2024. Mehaffey filed his own trademark in June 2023, and then sent a cease and desist letter to Shift Up in July.

Advertisement

Stellar Blade was the PlayStation 5’s first big console exclusive release for 2024. While reviews were mixed (Digital Trends said had great style but was “lacking substance”), Shift Up revealed that the game sold 1 million units over the first couple of months. It dropped out of PlayStation’s top 20 downloads list in June.






Source link

Continue Reading

Technology

Gemini app on Android gets a more simplified homescreen

Published

on

Gemini app on Android gets a more simplified homescreen

Earlier this month, Google redesigned the Gemini homepage on desktop. The redesign removed the “Hello” + greeting and suggestions and now offers a simple “Hello can I help you?” message. The search engine giant has now provided the same on mobile devices. The Gemini app on Android devices has received a new simplified homescreen, which is now more minimalistic than earlier.

Gemini app’s new simplified homescreen replaces the old design with a minimalistic interface

According to a report by 9to5Google, the Gemini app on Android has received a new update, which brings a more simplified homescreen. The new update replaces the old design with a more minimalistic interface. The new UI is designed to prioritize user experience.

Earlier, there was the “Gemini Advanced” logo on top, apart from a handful of suggestions and the “Chats & Gems” list. However, the new homescreen only has the “Hello, [user name]” greeting. It now also includes a new message bubble icon in the top-left corner, which gives you access to the Recent conversations and Gems. Notably, the chat box at the bottom of the screen is unchanged.

As you can see, the new Gemini app interface draws inspiration from the search’s homepage. If you want to access the new Gemini interface, then simply update the app on your Android device. The new design seems to be rolling out gradually, it may not be available in all regions right away.

Advertisement

Google recently also added Gems to Gemini’s mobile app

It’s worth mentioning that Google added Gems to Gemini’s mobile app earlier this month. Gems were originally launched for gemini.google.com at the end of August on the web. However, now they are also available in the Gemini app on Android and iOS devices. Earlier, the “Recent” section was renamed to “Chat & Gems”. However, with the latest homescreen layout update, they are moved to the bubble icon in the top-left corner.

For those unaware, Gems in Gemini allows you to program the AI assistant for a single and repetitive task. Notably, they can “remember a detailed set of instructions to help you save time on tedious, repetitive or difficult tasks”. Google also offers a handful of pre-generated Gems like a learning coach, brainstormer, career guide, and writing editor.

Source link

Continue Reading

Technology

Prime Day deals include three free months of Amazon Music Unlimited for new users

Published

on

Prime Day deals include three free months of Amazon Music Unlimited for new users

Amazon is hoping to get more people hooked on Music Unlimited with a pre-Prime Day offer. Those who haven’t tried the service before can get three months of access for free. The offer is even better for Prime members who haven’t checked out the music-streaming platform. They can use it for four months at no extra cost. Music Unlimited typically costs $11 per month without Prime and $10 per month for Prime members.

The company isn’t leaving existing subscribers entirely out in the cold. Those with an individual Amazon Music Unlimited plan can upgrade to the Family Plan at no extra cost for two months.

Amazon

Amazon Music Unlimited is free for three months to those who haven’t used it before. Prime members who are newcomers to the service get an additional month of access at no extra cost.

$0 at Amazon

Amazon Music Unlimited includes more than 100 million songs, many of which are available in high definition and/or spatial audio. The service also includes ad-free versions of many popular podcasts.

Advertisement

While it may not be the first music streaming service that springs to mind for most folks, Amazon Music Unlimited may be worth checking out. The HD music selection is particularly notable, since Spotify has yet to offer that feature.

Follow @EngadgetDeals on Twitter for the latest tech deals and buying advice in the lead up to October Prime Day 2024.

Source link

Continue Reading

Trending

Copyright © 2017 Zox News Theme. Theme by MVP Themes, powered by WordPress.