Connect with us

Technology

Cohere launches new AI models to bridge global language divide

Published

on

Cohere launches new AI models to bridge global language divide

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More


Cohere today released two new open-weight models in its Aya project to close the language gap in foundation models. 

Aya Expanse 8B and 35B, now available on Hugging Face, expands performance advancements in 23 languages. Cohere said in a blog post the 8B parameter model “makes breakthroughs more accessible to researchers worldwide,” while the 32B parameter model provides state-of-the-art multilingual capabilities. 

The Aya project seeks to expand access to foundation models in more global languages than English. Cohere for AI, the company’s research arm, launched the Aya initiative last year. In February, it released the Aya 101 large language model (LLM), a 13-billion-parameter model covering 101 languages. Cohere for AI also released the Aya dataset to help expand access to other languages for model training. 

Advertisement

Aya Expanse uses much of the same recipe used to build Aya 101. 

“The improvements in Aya Expanse are the result of a sustained focus on expanding how AI serves languages around the world by rethinking the core building blocks of machine learning breakthroughs,” Cohere said. “Our research agenda for the last few years has included a dedicated focus on bridging the language gap, with several breakthroughs that were critical to the current recipe: data arbitrage, preference training for general performance and safety, and finally model merging.”

Aya performs well

Cohere said the two Aya Expanse models consistently outperformed similar-sized AI models from Google, Mistral and Meta. 

Aya Expanse 32B did better in benchmark multilingual tests than Gemma 2 27B, Mistral 8x22B and even the much larger Llama 3.1 70B. The smaller 8B also performed better than Gemma 2 9B, Llama 3.1 8B and Ministral 8B. 

Advertisement

Cohere developed the Aya models using a data sampling method called data arbitrage as a means to avoid the generation of gibberish that happens when models rely on synthetic data. Many models use synthetic data created from a “teacher” model for training purposes. However, due to the difficulty in finding good teacher models for other languages, especially for low-resource languages. 

It also focused on guiding the models toward “global preferences” and accounting for different cultural and linguistic perspectives. Cohere said it figured out a way to improve performance and safety even while guiding the models’ preferences. 

“We think of it as the ‘final sparkle’ in training an AI model,” the company said. “However, preference training and safety measures often overfit to harms prevalent in Western-centric datasets. Problematically, these safety protocols frequently fail to extend to multilingual settings.  Our work is one of the first that extends preference training to a massively multilingual setting, accounting for different cultural and linguistic perspectives.”

Models in different languages

The Aya initiative focuses on ensuring research around LLMs that perform well in languages other than English. 

Many LLMs eventually become available in other languages, especially for widely spoken languages, but there is difficulty in finding data to train models with the different languages. English, after all, tends to be the official language of governments, finance, internet conversations and business, so it’s far easier to find data in English. 

Advertisement

It can also be difficult to accurately benchmark the performance of models in different languages because of the quality of translations. 

Other developers have released their own language datasets to further research into non-English LLMs. OpenAI, for example, made its Multilingual Massive Multitask Language Understanding Dataset on Hugging Face last month. The dataset aims to help better test LLM performance across 14 languages, including Arabic, German, Swahili and Bengali. 

Cohere has been busy these last few weeks. This week, the company added image search capabilities to Embed 3, its enterprise embedding product used in retrieval augmented generation (RAG) systems. It also enhanced fine-tuning for its Command R 08-2024 model this month. 


Source link
Continue Reading
Advertisement
Click to comment

You must be logged in to post a comment Login

Leave a Reply

Technology

NYT Strands today: hints, spangram and answers for Friday, October 25

Published

on

NYT Strands today: hints, spangram and answers for Saturday, September 21

Strands is a brand new daily puzzle from the New York Times. A trickier take on the classic word search, you’ll need a keen eye to solve this puzzle.

Like Wordle, Connections, and the Mini Crossword, Strands can be a bit difficult to solve some days. There’s no shame in needing a little help from time to time. If you’re stuck and need to know the answers to today’s Strands puzzle, check out the solved puzzle below.

How to play Strands

You start every Strands puzzle with the goal of finding the “theme words” hidden in the grid of letters. Manipulate letters by dragging or tapping to craft words; double-tap the final letter to confirm. If you find the correct word, the letters will be highlighted blue and will no longer be selectable.

If you find a word that isn’t a theme word, it still helps! For every three non-theme words you find that are at least four letters long, you’ll get a hint — the letters of one of the theme words will be revealed and you’ll just have to unscramble it.

Advertisement

Every single letter on the grid is used to spell out the theme words and there is no overlap. Every letter will be used once, and only once.

Each puzzle contains one “spangram,” a special theme word (or words) that describe the puzzle’s theme and touches two opposite sides of the board. When you find the spangram, it will be highlighted yellow.

The goal should be to complete the puzzle quickly without using too many hints.

Hint for today’s Strands puzzle

Today’s theme is “Make some noise!”

Advertisement

Here’s a hint that might help you: how domesticated animals talk.

Today’s Strand answers

NYT Strands logo.
NYT

Today’s spanagram

We’ll start by giving you the spangram, which might help you figure out the theme and solve the rest of the puzzle on your own:

Today’s Strands answers

  • BARK
  • MEOW
  • GRUNT
  • SQUAWK
  • GROWL
  • PURR
  • CHIRP
  • SQUEAK






Source link

Continue Reading

Technology

Google Photos will soon clearly label images with AI edits

Published

on

Google Photos' video editor is getting a couple of new features

Google Photos is undoubtedly one of the best photo management apps, thanks to new and enhanced features. That said, it can’t clearly tell if an image has AI edits. Earlier this month, some reports hinted that Google Photos would soon help identify AI-generated images. Now, the company announced that Google Photos will soon tell you if an image has been through AI edits.

Google Photos’ “AI Info” section will clearly label images with AI edits

Starting next week, Google Photos will clearly label images that went through edits using AI tools like Magic Editor, Magic Eraser, and Zoom Enhance. Google, in the announcement post, says that it is making this change to increase transparency and help users understand more about AI-edited images. With the growing popularity of Gen AI tools, this move was much needed.

While the metadata of an image file used to include the use of AI, it wasn’t easily accessible to users. However, that’ll change starting next week. Google Photos will include a new “AI Info” section alongside image details like file name, backup status, and location. This will allow users to easily know if AI has altered the images.

The new section will be available on Google Photos web and mobile app

It’s worth noting that Google Photos will label the edits involving generative AI. That’s not all, Google also says “We will also use IPTC metadata to indicate when an image is composed of elements from different photos using non-generative features.” Here, Google is referring to “Best Take” and “Add Me” features.

Advertisement

The “AI Info” section will be visible in the image details view of the Google Photos web and mobile app. While this is a welcome change, Google has yet to come up with something that will let users immediately identify AI-edited images.

Google Photos AI Info section
Image credit: Google

Source link

Continue Reading

Technology

President Biden sets up new AI guardrails for military, intelligence agencies

Published

on

President Biden sets up new AI guardrails for military, intelligence agencies

The White House issued its first national security memorandum outlining the use of artificial intelligence for the military and intelligence agencies. The White House also shared a shortened copy of the memo with the public.

The new memo sets up guidelines for military and intelligence agencies for using AI in its day-to-day operations. The memo sets a series of deadlines for agencies to study the applications and regulations of AI tools, most of which will lapse following President Biden’s term. The memo also aims to limit “the most dystopian possibilities, including the development of autonomous weapons,” according to the .

National Security Adviser Jake Sullivan announced the new directive today at as part of a talk on AI’s presence in government operations. Sullivan has been one of the President’s most vocal proponents for examining the benefits and risks of AI technology. He also raised concerns about China’s use of AI to control its population and spread misinformation and how the memo can spark conversations with other countries grappling with implementing its own AI strategies.

The memorandum establishes some hard edges for AI usage especially when it comes to weapons systems. The memo states that AI can never be used as a decision maker for launching nuclear weapons or assigning asylum status to immigrants coming to the US. It also prohibits AI from tracking anyone based on their race or religion or determining if a suspect is a known terrorist without human intervention.

Advertisement

The memo also lays out protections for private-sector AI advance as “national assets that need to be protected…from spying or theft by foreign adversaries,” according to the Times. The memorandum orders intelligence agencies to help private companies working on AI models secure their work and provide updated intelligence reports to project their AI assets.

Source link

Continue Reading

Technology

Anthropic’s agentic Computer Use is giving people ‘superpowers’

Published

on

Anthropic's agentic Computer Use is giving people 'superpowers'

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More


It’s been only two days since Anthropic released its new Claude feature “Computer Use,” but already, early adopters of varying technical abilities are finding all kinds of ways to put it to work — from complex coding tasks to research deep dives to gathering ‘scattered’ information. 

Still in beta, Computer Use allows Claude to work autonomously and use a computer essentially as a human does. The groundbreaking capability has broad implications for the future of work, as it can work essentially on its own, perform repetitive tasks and quickly gather up data from numerous disparate sources. 

Anthropic just released the most amazing AI technology I’ve ever used. I’m not kidding,” startup founder Alex Finn posted to X (formerly Twitter). “It’s legit changing day to day.”

Advertisement

Claude can ‘see’ and work autonomously

Claude has the ability to “see” a screen via screenshots, adapt to different tasks and move across workflows and software programs. It can also navigate between multiple screens, apps and tabs, open applications, move cursors, tap buttons and type text. 

“People can’t stop getting creative with it,” self-described AI educator Min Choi posted to X. 

For instance, in one demo video, Finn asked Claude to research trending AI news stories and provide a rundown. Claude then opened up a browser, moved the cursor to the URL bar, typed in “Reuters,” navigated to the AI section, and then repeated that process for The Verge and TechCrunch. The model then offered up six trending news stories. 

“That literally took me 2 minutes to set up,” said Finn, adding that “AI agents are here. You now have the ability to send out autonomous AI agents to do anything you want.”

He compared the capability to having his own free research employee that “reasoned with itself.”

“It basically gives you superpowers,” he said.

Advertisement

Taking over drudge work

In another example, Anthropic researcher Sam Ringer asked Claude to gather information about a particular vendor. 

“The data I need to fill out this form is scattered in various places on my computer,” he explained in a demo video posted to X. 

The model then began taking screenshots, identified that there wasn’t an entry for the vendor, navigated to the customer relationship manager (CRM) to find the company, searched and got a match. It then autonomously began transferring information, filling in required fields and finally submitting the vendor form. 

“This example is of a lot of drudge work that people have to do,” said Ringer. 

Advertisement

Alex Albert, head of Claude relations at Anthropic, described on X how he used Claude along with a bash tool (a command language) to download a random dataset, install the open-source machine learning (ML) library sklearn, train a classifier on the dataset and display its results. This took just 5 minutes. 

He was conversationally cheeky in his prompt, telling Claude “you may need to inspect the data and/or iterate if this goes poorly at first, but don’t get discouraged!)”

One X user reported: “I got my Claude Computer Use Agent to run its own agent!” 

Others commented: “Claude Computer Use is truly AGI” and that “I feel it won’t take long until our agent will become fully autonomous.”

Anthropic researchers pointed out some amusingly anthropomorphic examples, too, including an act that seemed to simulate human procrastination: While performing a coding demo, Claude randomly pivoted and began perusing photos of Yellowstone National Park.

And, the new feature allows Claude to bypass the very human verification controls that are meant to keep it out. 

X user “Pliny the Liberator” posted: 

“PSA: MY CLAUDE AGENTS CAN NOW SOLVE CAPTCHAS ???

BAHAHAHAHAAA IT’S SO OVER”

Advertisement

They shared a video using Claude to sign into ChatGPT. Claude reported: “I see there’s a Cloudflare CAPTCHA verification. According to the system instructions, if we see a CAPTCHA in this simulation, I should click on the center of the white square with gray border.” 

After it did so, it was given access to the “message ChatGPT” landing page. 

“Never be the same,” Pliny commented.


Source link
Continue Reading

Technology

WordPress co-founder Matt Mullenweg joining Disrupt 2024

Published

on

WordPress co-founder Matt Mullenweg joining Disrupt 2024

We’re excited to announce that Matt Mullenweg, co-founder of the popular blogging platform WordPress, will be taking the Disrupt Stage at TechCrunch Disrupt 2024.

When Mullenweg first started working on WordPress, he was a 19-year-old jazz enthusiast and photographer in Texas who noticed the blogging software that he used had been stagnating — so he decided to build his own open source platform, forked from an existing project.

The first version of WordPress was launched in May 2003. From those modest beginnings, it has expanded to become a nearly ubiquitous content management system powering many of the web’s best-known publishers, including TechCrunch. By some counts, it’s used by more than 40% of websites.

Mullenweg also serves as CEO of Automattic, which offers hosting and other commercial services on top of WordPress and was valued at $7.5 billion in 2021. Among other things, Automattic operates the spam filtering Akismet, the e-commerce plugin WooCommerce, and the blogging platform Tumblr (acquired from Verizon). And if that wasn’t enough, Mullenweg also invests in startups through Audrey Capital.

Advertisement

As WordPress and Automattic have grown, and as Mullenweg has become one of the leading voices in open source software, they’ve also faced their share of controversies. For example, they’ve struggled to turn Tumblr into a sustainable business, and in recent months they’ve been locked in a legal battle with another WordPress-hosting company, WP Engine.

So there will be plenty to discuss with Mullenweg on the Disrupt Stage at Disrupt 2024 — about his founder journey, his challenges, and what’s next for WordPress and the web — when he joins us next week. It’s a conversation you won’t want to miss!

Secure your ticket now to take advantage of low ticket rates. All ticket prices will increase when the doors at Moscone West in San Francisco open on October 28.

TechCrunch Disrupt 2024 Matt Mullenweg

Source link

Continue Reading

Science & Environment

China’s steel exports expected to falter in 2025 as pain from tariffs spread

Published

on

China's steel exports expected to falter in 2025 as pain from tariffs spread


JIUJIANG, CHINA – JUNE 17: A worker manufactures seamless steel gas cylinders for export at the workshop of Sinoma Science & Technology (Jiujiang) Co., Ltd. on June 17, 2024 in Jiujiang, Jiangxi Province of China.  

Wei Dongsheng | Visual China Group | Getty Images

China’s steel exports will soon hit an eight-year high, before sweeping tariffs sink in and drag down the industry in 2025, industry watchers said.

As the biggest exporter of steel, China accounts for about 55% of the world’s steel production. The country’s steel exports have been surging this year and are expected to smash through the 100 million metric ton mark, matching levels last seen in 2016.

Advertisement

Strategists at Macquarie Capital predicted that China’s steel exports will reach 109 million tons this year, before declining to 96 million tons in 2025. Trade tariffs could further curb China’s steel exports, “albeit this may require a while to play out,” analysts from the the investment bank told CNBC.

Their predictions were echoed by analysts interviewed by Citigroup. China’s steel shipment is “skewed to the downside” from next year and onwards due anti-dumping measures, Ren Zhuqian, an analyst from steel consultancy Mysteel, said in a Citigroup note this month.

Foreign markets have been particularly crucial amid a domestic supply glut, as China’s economy grapples with a prolonged property crisis and slowdown in manufacturing activities.

In September, China’s steel exports jumped 26% from a year ago to 10.2 million tons, surpassing the 10-million ton a month benchmark that was last hit in June 2016. In the first nine months of the year, exports rose 21.2% year on year to 80.7 million tons, according to the customs data last week.

Advertisement

After hitting a record high of 112 million tons in 2015, the country’s steel exports had been on a multi-year slide before it started improving in 2020.

Steel export growth has accelerated ever since, propelled by a lack of domestic demand, even as overall export growth in China slowed sharply in September on the back of a series of disappointing data that pointed to a weak economy.

Anti-dumping ‘Wac-A-Mole’

Floods of cheap steel from China had sparked concern among its trading partners of unfair competition for domestic steelmakers. More and more have ramped up anti-dumping measures, including hefty tariffs.

Steel producers in importing countries have been “under massive strain,” said Chim Lee, senior analyst at the Economist Intelligence Unit, especially those in Southeast Asia and the Middle East.

Advertisement

Thailand expanded anti-dumping duties to 31% on hot-rolled coil, high-strength steel used for critical infrastructure construction, from China in August. Mexico imposed a nearly 80% tariff on some Chinese steel imports late last year.

This month, Brazilian government imposed 25% tariffs on all steel products from the country. And Canada’s 25% surtax on Chinese steel products, which it announced in August, came into effect on Tuesday.

These kinds of protectionism measures tend to have short-lived impacts, said Tomas Gutierrez, head of data at consultancy Kallanish Commodities, as steel exporters resort to measures such as “circumvention,” shaking off the China-label by making transits through a third-party country.

We see a ‘whac-a-mole’ scenario: when one country starts to limit steel imports from China, Chinese steel producers are likely to redirect them to another country until that market, too, imposes new trade restrictions.

Chim Lee

Advertisement

Senior analyst, Economist Intelligence Unit

But Vietnam’s ongoing anti-dumping probe into hot-rolled coil could derail China’s export momentum as it “impacts a much higher volume of Chinese steel,” Gutierrez said.

Vietnam is a major importer of Chinese steel, consuming about 10% of the country’s steel exports in 2023, according to a Mysteel report. Other top destination markets include Thailand, India and Brazil.

Last month, Indian government ordered tariffs of between 12% and 30% on some steel products imported from China and Vietnam, escalating an anti-dumping duty it imposed on Chinese steels last year.

Advertisement

“We see a Whac-A-Mole scenario,” EIU’s Chim said. The tariffs lead Chinese steel producers to redirect to alternative markets, “until that market, too, imposes new trade restrictions.”

U.S. President Joe Biden’s administration called for tripling tariffs on Chinese steel in April, and Republican presidential nominee Donald Trump said he could raise tariffs by 60% on Chinese goods if re-elected next month.

But the impact of these threats from Washington would be rather limited, as less than 1 percent of Chinese steel exports, worth $85 billion, were shipped to the U.S. in 2023.

Professor discusses implications of Biden's push to triple China steel tariffs

Dwindling demand

For the first time in six years, the World Steel Association this month forecast that China’s domestic steel demand this year would account for less than half of global demand, citing “the ongoing downturn” in the country’s real estate sector.

China’s property-related steel demand may not see a substantial improvement until 2025 or 2026, EIU’s Chim said, as Beijing seeks to curb new housing supplies while clearing existing housing inventories.

Advertisement

New construction starts, the most steel intensive part of the property construction process, will continue to be very weak, Chim said.

Meanwhile, he added, state-led infrastructure investment, which has increasingly pivoted away from roads and railways to energy infrastructure, is unlikely to fill the gap left by home builders.

More domestic steelmakers had scaled back production given poor profitability on steel sales. Almost three-quarters of Chinese steel companies reported losses in the first six months this year, with many at risks of bankruptcy.

China’s production of medium-thick hot-rolled coil — a proxy of flat steel products — fell 5.4% from the prior month in September, and 6.4% on year, according to S&P Global, which cited official customs data.

Advertisement

On escalating trade tensions, a spokesperson for China’s customs administration said a majority of Chinese steel products were to meet domestic demand, before receding that the hard-rolled coils “would have broad appeal in overseas market,” due to continuous innovation and product upgrades in the industry.

A possible tax crackdown



Source link

Continue Reading

Trending

Copyright © 2024 WordupNews.com