Connect with us

Technology

Anthropic challenges OpenAI with affordable batch processing

Published

on

Anthropic challenges OpenAI with affordable batch processing

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More


Anthropic, a leading artificial intelligence company, launched its new Message Batches API on Tuesday, allowing businesses to process large volumes of data at half the cost of standard API calls.

This new offering handles up to 10,000 queries asynchronously within a 24-hour window, marking a significant step towards making advanced AI models more accessible and cost-effective for enterprises dealing with big data.

The AI economy of scale: Batch processing brings down costs

The Batch API offers a 50% discount on both input and output tokens compared to real-time processing, positioning Anthropic to compete more aggressively with other AI providers like OpenAI, which introduced a similar batch processing feature earlier this year.

This move represents a significant shift in the AI industry’s pricing strategy. By offering bulk processing at a discount, Anthropic is effectively creating an economy of scale for AI computations.

This could lead to a surge in AI adoption among mid-sized businesses that were previously priced out of large-scale AI applications.

The implications of this pricing model extend beyond mere cost savings. It could fundamentally alter how businesses approach data analysis, potentially leading to more comprehensive and frequent large-scale analyses that were previously considered too expensive or resource-intensive.

Advertisement
ModelInput Cost (per 1M tokens)Output Cost (per 1M tokens)Context Window
GPT-4o$1.25$5.00128K
Claude 3.5 Sonnet$1.50$7.50200K
Pricing Comparison: GPT-4o vs. Claude’s Premium Models; Costs shown per million tokens (Table Credit: VentureBeat)

From real-time to right-time: Rethinking AI processing needs

Anthropic has made the Batch API available for its Claude 3.5 Sonnet, Claude 3 Opus, and Claude 3 Haiku models through the company’s API. Support for Claude on Google Cloud’s Vertex AI is expected soon, while customers using Claude through Amazon Bedrock can already access batch inference capabilities.

The introduction of batch processing capabilities signals a maturing understanding of enterprise AI needs. While real-time processing has been the focus of much AI development, many business applications don’t require instantaneous results. By offering a slower but more cost-effective option, Anthropic is acknowledging that for many use cases, “right-time” processing is more important than real-time processing.

This shift could lead to a more nuanced approach to AI implementation in businesses. Rather than defaulting to the fastest (and often most expensive) option, companies may start to strategically balance their AI workloads between real-time and batch processing, optimizing for both cost and speed.

The double-edged sword of batch processing

Despite the clear benefits, the move towards batch processing raises important questions about the future direction of AI development. While it makes existing models more accessible, there’s a risk that it could divert resources and attention from advancing real-time AI capabilities.

Advertisement

The trade-off between cost and speed is not new in technology, but in the field of AI, it takes on added significance. As businesses become accustomed to the lower costs of batch processing, there may be less market pressure to improve the efficiency and reduce the cost of real-time AI processing.

Moreover, the asynchronous nature of batch processing could potentially limit innovation in applications that rely on immediate AI responses, such as real-time decision making or interactive AI assistants.

Striking the right balance between advancing both batch and real-time processing capabilities will be crucial for the healthy development of the AI ecosystem.

As the AI industry continues to evolve, Anthropic’s new Batch API represents both an opportunity and a challenge. It opens up new possibilities for businesses to leverage AI at scale, potentially increasing access to advanced AI capabilities.

Advertisement

At the same time, it underscores the need for a thoughtful approach to AI development that considers not just immediate cost savings, but long-term innovation and diverse use cases.

The success of this new offering will likely depend on how well businesses can integrate batch processing into their existing workflows and how effectively they can balance the trade-offs between cost, speed, and computational power in their AI strategies.


Source link
Continue Reading
Advertisement
Click to comment

You must be logged in to post a comment Login

Leave a Reply

Technology

A Google breakup is on the table, say DOJ lawyers

Published

on

A Google breakup is on the table, say DOJ lawyers

Similarly, Plaintiffs are considering behavioral and structural remedies that would prevent Google from using products such as Chrome, Play, and Android to advantage Google search and Google search-related products and features — including emerging search access points and features, such as artificial intelligence — over rivals or new entrants.

Source link

Continue Reading

Servers computers

Tripp Lite SRWO8U22 8U, 12U or 22U Wall Mount Open Frame Cabinet Product Tour

Published

on

Tripp Lite SRWO8U22 8U, 12U or 22U Wall Mount Open Frame Cabinet   Product Tour

source

Continue Reading

Technology

Instacart’s AI-powered shopping cart turns shopping into a side quest

Published

on

Instacart AI

Grocery shopping as a game without checkout lines could make a sometimes tedious errand more bearable thanks to an AI infusion into Instacart’s Caper Carts. Instacart augmented the smart grocery carts with new AI features. They offer a touchscreen that provides navigation guidance to the products you’re looking for, as well as personalized recommendations, discounts, and even a way to make shopping into a kind of treasure-hunting game.

Instacart created the Caper Carts to skip the need for checkout lines. They have cameras, a scale, and other sensors to evaluate items placed within, while the screen lets you know what the cart thinks you just pulled from the shelf using Nvidia’s AI libraries of information about products plus its on-device AI processing platform. You can buy everything before you even get to the front of the store and simply walk out when you’re done. 

The AI in the new Caper Cart offers a lot more than just a faster checkout, though. They come with real-time location tracking to note where you are and lead you to what you want to buy. You can upload your grocery list to the cart with a QR code in the Instacart app, which then displays it on the cart’s screen. It can also do the same for products on sale that pique your interest, offering discounts based on your location.

Instacart AI

(Image credit: Instacart)

Source link

Advertisement

Continue Reading

Technology

NYT Mini Crossword today: puzzle answers for Wednesday, October 9

Published

on

NYT Mini Crossword today: puzzle answers for Saturday, September 21

The New York Times has introduced the next title coming to its Games catalog following Wordle’s continued success — and it’s all about math. Digits has players adding, subtracting, multiplying, and dividing numbers. You can play its beta for free online right now. 
In Digits, players are presented with a target number that they need to match. Players are given six numbers and have the ability to add, subtract, multiply, or divide them to get as close to the target as they can. Not every number needs to be used, though, so this game should put your math skills to the test as you combine numbers and try to make the right equations to get as close to the target number as possible.

Players will get a five-star rating if they match the target number exactly, a three-star rating if they get within 10 of the target, and a one-star rating if they can get within 25 of the target number. Currently, players are also able to access five different puzzles with increasingly larger numbers as well.  I solved today’s puzzle and found it to be an enjoyable number-based game that should appeal to inquisitive minds that like puzzle games such as Threes or other The New York Times titles like Wordle and Spelling Bee.
In an article unveiling Digits and detailing The New York Time Games team’s process to game development, The Times says the team will use this free beta to fix bugs and assess if it’s worth moving into a more active development phase “where the game is coded and the designs are finalized.” So play Digits while you can, as The New York Times may move on from the project if it doesn’t get the response it is hoping for. 
Digits’ beta is available to play for free now on The New York Times Games’ website

Source link

Continue Reading

Servers computers

This mobile rack case is a homelab in the works

Published

on

This mobile rack case is a homelab in the works



I think this is gonna turn out really cool. Only time will tell. Gotta build a server, a PC, and some other goodies for it.

source

Continue Reading

Technology

Win a Google Pixel 9 or Pixel 9 Pro XL with Android Headlines!

Published

on

Win a Google Pixel 9 or Pixel 9 Pro XL with Android Headlines!

10/8/2024 Thank you to everyone who entered our contest. We have contacted the winners, and once they have replied, we will announce their names here. If they do not reply within 48 hours, we will select another winner in their place. Thank you very much for participating in our giveaway, and stay tuned for another contest giveaway coming soon.

Winner #1 is Jacob Brunscheon from Waterloo, IA , Winner #2 TBA 

 

This year, Google has announced its Pixel 9 series earlier than ever before. Which means our annual Pixel giveaway is starting earlier than ever before. This time around, we are giving away two Pixel 9 smartphones – Pixel 9 and Pixel 9 Pro XL. If you’ve wanted to check out the new Pixel 9, but didn’t want to spend money on one, well now is your time to do so.

Advertisement

Here’s everything you need to know about Android Headlines’ big Pixel 9 giveaway!

About the Google Pixel 9

The Google Pixel 9 is actually getting quite the upgrade this year. Not only is it sporting the new Tensor G4 processor, but it’s also sporting a slightly larger display. Pixel 9 has a 6.3-inch FHD+ 120Hz display that can get as bright as 2,700 nits of peak brightness (or 1,800 nits for HDR content). The battery has also been upgraded this year to a 4,700mAh cell, which I actually think will offer the best battery life of any of the Pixel 9 smartphones this year. Charging has been upgraded to 27W, still pretty slow, but faster than Pixel 8.

Internally, Google has upgraded the RAM to 12GB – likely due to all of the AI features. And there’s also 128GB of storage. On the camera front, Google has also made quite a few upgrades, including a 50-megapixel primary camera and a 48-megapixel ultrawide camera.

Of course, we can’t forget about the many, many new AI features. Including Pixel Screenshots, Gemini Live, Call Notes, Add Me, and much more. Making this a really well-rounded smartphone experience. The Google Pixel 9 retails for $799.

Advertisement

It’s a pretty incredible phone from Google, and you can enter to win one today!

About the Google Pixel 9 Pro XL

The Google Pixel 9 Pro XL, on the other hand, is the largest Pixel device Google has ever made. This year, the Pixel 9 Pro XL grows to a 6.8-inch display, and it’s even brighter with 3,000 nits of peak brightness (2,00 nits for HDR). The RAM has been upgraded again to 16GB, though it does still start at 128GB of storage.

The cameras here are the same as before, with a 50-megapixel primary camera, a 48-megapixel ultrawide and a 48-megapixel telephoto camera on-board. This is going to provide you with some really great photos and videos. Speaking of videos, the Zoom Enhance feature that was announced last year, is finally available now with Pixel 9 Pro series.

There are other AI features included, too, like Add Me, which lets you take a group selfie, even with the person taking the photo. There are also Call Notes, Pixel Screenshots, Gemini Live, and much more.

Advertisement

The Google Pixel 9 Pro XL is shaping up to be a really great phone, and we can’t wait to get our hands on it and give one away to one of you.

How To enter

To be entered for a chance to win the Google Pixel 9 or Google Pixel 9 Pro XL, all you need to do is take part in the giveaway widget below. To get started, enter the contest with your email address.

Once you have entered, you’ll have the opportunity to gain additional entries by completing various actions, including visiting Android Headlines social media channels.

You are entitled to complete as many actions as you like; each action offers a unique number of entries, and each entry has the potential to be the winning one.

Advertisement

This Google Pixel 9 or Google Pixel 9 Pro XL giveaway is a USA-ONLY contest and will close promptly at 2:59 pm PST on Tuesday, October 8, 2024.

Enter now for a chance to win a Google Pixel 9 or Google Pixel 9 Pro XL, courtesy of Android Headlines.

  • This is a USA-only Giveaway.
  • Entrants need to be of a suitable age to enter.
  • Shipping issues are not controlled by Android Headlines or our partners. You should be aware that things can go wrong. Android Headlines or our partners are not responsible for items lost in transit.
  • It only takes one email entry to win, so only enter using one email address. Entering with more than one email will not improve your chances of winning and may result in disqualification. Email addresses are checked and confirmed.
  • The winner (s) will be emailed, and if no response is given within 48 hours, another entrant(s) will be selected.
  • Anyone deemed to be ‘spamming’ the contest will be disqualified.
  • Android Headlines reserves the right to make changes to this contest/giveaway.

Source link

Continue Reading

Trending

Copyright © 2024 WordupNews.com