Connect with us

Technology

Databricks Apps a toolkit that simplifies AI development

Published

on

Databricks Apps a toolkit that simplifies AI development

Databricks on Tuesday unveiled Databricks Apps, a suite of features that aims to make it easier for users to build customized data and AI applications.

Databricks already provides Mosaic AI, an environment that enables customers to integrate systems such as large language models (LLMs) with their enterprise’s proprietary data. Missing, however, were the capabilities to develop the actual interactive applications such as generative AI chatbots that are powered by the combination of AI systems mixed with proprietary data.

Databricks Apps adds the ability to develop applications on top of the tools previously available in Mosaic AI, enabling developers to execute the entire development and deployment process within the secure Databricks environment.

Because Databricks Apps extends what users could do with Mosaic AI and lets them develop applications without requiring third-party platforms, the new set of tools is significant, according to Donald Farmer, founder and principal of TreeHive Strategy.

Advertisement

“Very interesting news from Databricks,” he said. “The new Databricks Apps features take away some bothersome obstacles such as the need to spin up separate infrastructure for development and deployment. Because they can now deploy and manage apps directly in Databricks, this should be considerably easier.”

Kevin Petrie, an analyst at BARC U.S, likewise noted that Databricks Apps is an important addition for the vendor’s customers given that it adds to what they were previously able to develop with Mosaic AI.

“Companies cannot differentiate themselves competitively by simply implementing AI/ML models,” he said. “Rather, they must create differentiated applications that capitalize on their unique datasets. Databricks Apps help AI adopters take that critical step.”

Based in San Francisco, Databricks is a data platform vendor that when it was founded in 2013 was one of the pioneers of the data lakehouse storage format, combining the structured data storage capabilities of data warehouses with the unstructured data storage capabilities of data lakes.

Advertisement

Over the past two years, the vendor has made AI a focal point, expanding its platform to include an environment for deploying and managing traditional AI, generative AI and machine learning applications.

Databricks’ June 2023 acquisition of MosaicML for $1.3 billion was a key part of creating that environment with MosaicML’s technology now serving as the foundation for Databricks’ AI and machine learning capabilities. Subsequent acquisitions and product development initiatives, including the launch of DBRX, Databricks’ own large language model, have added functionality.

Now, Databricks Apps — available in public preview on AWS and Azure — further advances the vendor’s AI development capabilities.

New capabilities

Fueled by the potential of generative AI to aid data management and analytics, enterprise interest in AI is surging.

Advertisement

One of its promises is that it can enable true natural language processing (NLP), which lets non-technical workers use analytics to inform decisions. Another part of its potential is that it can be used to generate code and automate processes, which can make data experts more efficient.

However, developing generative AI applications, including chatbots that let users query and analyze data and tools that use machine learning to take on tasks such as monitoring for data quality, is not easy.

Databricks Apps is designed to simplify application development by enabling developers to do all their work in the secure Databricks environment while still providing them with choices as they build data and AI applications.

Before Databricks Apps, Databricks customers had to use platforms from third-party vendors to complete the development of generative AI chatbots, AI-powered analytics applications and other intelligent capabilities.

Advertisement

However, mixing proprietary data, AI systems such as LLMs and third-party development platforms risked accidental data beaches. In addition, it was expensive.

Part of what makes developing data and AI applications difficult, risky and expensive is all the movement they require. Relevant data needs to be discovered and moved out of a data storage platform to train an application. The application needs to be developed in an integrated development environment or other data science platform. And then the application needs to be moved to its host environment for deployment and management.

Databricks Apps eliminates the need for that labor intensive, expensive and risky movement.

Instead, it enables developers to build applications natively in Databricks using development frameworks including Dash, Flask, Gradio, Shiny and Streamlit. In addition, it comes with prebuilt Python templates designed to speed up the development process.

Advertisement

However, if developers prefer to work in an integrated development environment such as Visual Studio Code or PyCharm, Databricks Apps supports that as well.

Following development, Databricks Apps eliminates the need to build infrastructures for deploying and running applications by running the applications on automatically allotted serverless compute storage within Databricks, according to the vendor. Management, meanwhile, includes security measures and governance capabilities such as access control and data lineage accessed through the Unity Catalog.

“There are some features here which are potentially very impactful,” Farmer said. “For example, the support for popular developer frameworks, which enables application developers to work with familiar tools of choice, expands the Databricks ecosystem to a new market of application developers.” 

In addition, eliminating the need to develop infrastructures for managing applications is noteworthy, he continued.

Advertisement

“The automatic provisioning of serverless compute will be significant because it enables developers to focus on building applications rather than the complex process of deploying a data architecture, which was a barrier to those who were not data specialists,” he said.

From a competitive standpoint, Databricks’ aggressive development of an environment for building, deploying and managing AI and machine learning tools over the past couple of years has differentiated it from other data platform vendors, Farmer said.

While AWS, Google Cloud, Microsoft and Snowflake have all similarly made AI a focal point of their product development, their tools for developing and managing AI models and applications are not as integrated as what Databricks has built, he continued. Databricks Apps furthers the separation between Databricks and its peers.

“Snowflake has been catching up or at least playing catch-up, but this continuous development from Databricks is very compelling,” Farmer said. “Microsoft Fabric, of course, is aiming to be a unified platform similar to Databricks, but it’s still an inferior product. Google Cloud Platform and AWS have a wide range of AI and ML services, but they’re not so deeply integrated across the platform.”

Advertisement

Despite the additive capabilities of Databricks Apps, Petrie cautioned that the applications — in particular, generative AI applications — customers will be able to develop will not suddenly enable anyone within an organization to freely work with data.

While Databricks aims to help enterprises broaden the reach of data and AI beyond a small audience of users, training and expertise are still required to use data and AI to inform decisions and take actions based on those decisions.

“Like many vendors, Databricks aims to ‘democratize’ the consumption of data, analytics and AI,” Petrie said. “But I think users of these applications will still require significant expertise in data, AI and the business domain, depending on the use cases involved.”

While Databricks Apps extends what customers could do with Mosaic AI and demonstrates that Databricks is continuing to focus on improving its AI and machine learning development environment, the impetus for the new features came from customer feedback, according to Shanku Niyogi, the vendor’s vice president of product management.

Advertisement

Developing and deploying internal applications has always been complex, he noted. But with enterprise interest in AI rapidly increasing, there is greater need for vendors such as Databricks to simplify developing and deploying AI applications.

“Customers … have shared that building and deploying internal data apps has historically been a complex and time-consuming process,” Niyogi said. “They specifically asked for easier ways to test new features while maintaining a secure environment. With the explosion of AI, this need has only grown.”

Looking ahead

Databricks Apps does not end Databricks’ focus on enabling application development and deployment, according to Niyogi.

The vendor’s goal is to make data and AI available to a broad audience of users, he noted. Toward that end, Databricks plans to invest in developing new Mosaic AI features as well as adding other capabilities through partnerships.

Advertisement

“Databricks will continue to make AI more accessible for organizations,” Niyogi said. “This includes further ways to simplify the app development process, new Mosaic AI capabilities that help teams build, deploy and measure compound AI systems, and a continued investment in a collaborative AI partner ecosystem.”

Farmer, meanwhile, said that Databricks’ focus on improving AI and machine learning workflows is appropriate. In particular, he suggested that the vendor enhance its support for developing applications for non-technical users as well as emerging AI technologies such as multimodal models.

“Multimodal will become critical over the next couple of years,” Farmer said. “I think we should also see more development for non-technical users. This release includes a first attempt at that, and no doubt this is the start of a new direction for Databricks and a very welcome one at that.”

Eric Avidon is a senior news writer for TechTarget Editorial and a journalist with more than 25 years of experience. He covers analytics and data management.

Advertisement

Source link

Continue Reading
Advertisement
Click to comment

You must be logged in to post a comment Login

Leave a Reply

Science & Environment

Wildlife Photographer of the Year: Tadpoles win top prize

Published

on

Wildlife Photographer of the Year: Tadpoles win top prize


Shane Gross Tadpoles glide beneath lily padsShane Gross

Shane Gross wins the grand prize – and the ‘Wetlands: The Bigger Picture’ category

A snapshot of wriggling toad tadpoles has earned Shane Gross the title of Wildlife Photographer of the Year.

Beneath a floating canopy of lily pads in Cedar Lake, Canada, a swarm of western toad tadpoles glided gracefully through the water.

“To me, the most fun that I can have, the thing that lights me up inside, is to see something new and try to photograph it in the best way I possibly can,” Shane told BBC News.

Advertisement

His careful movements through the delicate layer of silt and algae at the lake’s bottom ensured a clear view.

“I had no idea if I had anything good at all until I got home,” he said. “But when I finally looked, I was like, wow, this is pretty cool.”

Within four to twelve weeks after hatching, these little tadpoles begin their transformation into toads, with only about 1% making it to adulthood.

He was awarded the prize at London’s Natural History Museum.

Advertisement

“This image swirls with light, energy and a feeling of synchronised movement between the lilies and the tadpole tails,” said Kathy Moran, Jury Chair and Editor. “The real payoff is that this wonderful scene highlights environments and species that are often overlooked.”

Scroll on to see all of the winning photographs.

Alexis Tinker-Tsavalas slime molds alongside a tiny springtail.Alexis Tinker-Tsavalas

Alexis Tinker-Tsavalas wins the junior grand prize, in addition to the 15-17-year-olds category

Alexis Tinker-Tsavalas, 17, from Germany, won the Young Wildlife Photographer of the Year title. His photo “Life Under Dead Wood” featured fruiting slime mould alongside a tiny, energetic springtail.

Working quickly was essential, as these tiny critters can leap several times their body length in the blink of an eye.

Advertisement

“I think a lot of people don’t know that these things even exist,” Alexis said. “If people learn more through my images, I feel like that’s one of the biggest goals for me, to just show this tiny world that a lot of people don’t really get to see, in a different light.”

Using a technique known as focus-stacking, he combined 36 images into one stunning photograph.

These miniature springtails, under two millimetres long, are found alongside slime moulds worldwide, munching on microorganisms and playing a key role in soil health.

Category winners

Advertisement

Dusting for New Evidence by Britta Jaschinski, Germany/UK

Britta Jaschinski a crime scene investigator dusts a confiscated tusk Britta Jaschinski

Britta Jaschinski wins the Photojournalism category

Britta Jaschinski observed as a crime scene investigator from London’s Metropolitan Police dusted a confiscated tusk at Heathrow Airport for fingerprints, using newly developed magnetic powder.

Under the Waterline by Matthew Smith, UK/Australia

Matthew Smith A leopard seal beneath Antarctic iceMatthew Smith

Matthew Smith claims the title in the Underwater category

Matthew Smith captured a striking split image of a curious leopard seal beneath the Antarctic ice, using a custom extension he designed for his camera’s underwater housing.

Advertisement

Dolphins of the Forest by Thomas Peschak, Germany/South Africa

Thomas Peschak Amazon river dolphin in a flooded forest habitatThomas Peschak

Thomas Peschak takes home the award in the Photojournalist Story category

The Amazon River dolphin, one of two freshwater dolphin species in the Amazon and Orinoco basins, uniquely adapts to explore seasonally flooded forest habitats.

Thomas Peschak highlights the endangered dolphins’ complex relationship with local communities and the challenges they face due to human interactions that disrupt their natural behaviours.

Tiger in Town by Robin Darius Conz, Germany

Advertisement
Robin Darius Conz a tiger on a hillside overlooking a town Robin Darius Conz

Robin Darius Conz has won the Urban Wildlife category

While filming a wildlife documentary in India’s western ghats, Robin Darius Conz saw a tiger on a hillside overlooking a town. He used a drone to track the tiger, to highlight the contrast between protected areas and those affected by human development.

A Tranquil Moment by Hikkaduwa Liyanage Prasantha Vinod, Sri Lanka

Hikkaduwa Liyanage Prasantha Vinod a young toque macaque sleeping in an adult's armsHikkaduwa Liyanage Prasantha Vinod

Hikkaduwa Liyanage Prasantha Vinod takes the prize in the Behaviour: Mammals category

After photographing birds and leopards, Hikkaduwa Liyanage Prasantha Vinod captured a young toque macaque peacefully sleeping in an adult’s arms to highlight the challenges these monkeys face amid habitat loss and farmer conflicts.

The Demolition Squad by Ingo Arndt, Germany

Advertisement
Ingo Arndt red ants dismembering a blue beetle Ingo Arndt

Ingo Arndt is the winner of the Behaviour: Invertebrates category

Ingo Arndt captured the red wood ants efficiently dismembering a blue ground beetle to carry into their nest. He described himself as “full of ant” after just a few minutes lying beside the ants’ nest as he watched their teamwork in action.

Free as a Bird by Alberto Román Gómez, Spain

Alberto Román Gómez stonechat perched beside a heavy chain on a fenceAlberto Román Gómez

Alberto Román Gómez claims the title in the 10 Years and Under category

Alberto Román Gómez captured a playful stonechat perched beside a heavy chain, resembling a tiny warrior. From his father’s car in Sierra de Grazalema Natural Park, he struggled to photograph the bird as it darted about, gathering insects.

Frontier of the Lynx by Igor Metelskiy, Russia

Advertisement
Igor Metelskiy Lynx stretching in snowIgor Metelskiy

Igor Metelskiy has been awarded first place in the Animals in their Environment category

Mr Metelskiy captured a serene image of a lynx stretching in the evening sun, blending into the wilderness. After over six months of patience, he positioned his camera trap near the footprints of potential prey, revealing the elusive lynx in its natural habitat.

Old Man of the Glen by Fortunato Gatto, Italy

Fortunato Gatto a birch tree draped with pale ‘old man’s beard’ lichensFortunato Gatto

Fortunato Gatto wins the Plants and Fungi category

Fortunato Gatto came across a gnarled birch tree draped with pale ‘old man’s beard’ lichens in Glen Affric in the Scottish highlands. Glen Affric is home to the highest concentration of native trees in the UK, making it a vital ecosystem.

Practice Makes Perfect by Jack Zhi, USA

Advertisement
Jack Zhi  young falcon hunting a butterflyJack Zhi

Jack Zhi is awarded first place in the Behaviour: Birds category

Jack Zhi captures a young falcon practicing hunting on a butterfly near its sea-cliff nest. For the past eight years, he observed the birds in this area, but tracking them was particularly challenging as they were so fast.

The Artful Crow by Jiří Hřebíček, Czech Republic

Jiří Hřebíček  painterly image of a carrion crowJiří Hřebíček

Jiří Hřebíček won the Natural Artistry category

Jiří Hřebíček created an artistic image of a carrion crow by using a long shutter speed while moving his camera on purpose.

On Watch by John E Marriott, Canada

Advertisement
John E Marriott Lynx resting with its young sheltered behind it John E Marriott

John E Marriott takes home the award in the Animal Portraits category

John Marriott photographs a lynx resting, with its fully grown young sheltering from the cold wind behind it. After a week of tracking led him to the group, he kept his distance to avoid disturbing the family in the snowy forest.

A Diet of Deadly Plastic by Justin Gilligan, Australia

Justin Gilligan A mosaic of plastic found in the digestive tract of a dead flesh-footed shearwaterJustin Gilligan

Justin Gilligan wins the Oceans: The Bigger Picture category

Justin Gilligan created a mosaic from 403 pieces of plastic found in the digestive tract of a dead flesh-footed shearwater. He has been documenting research from a team that studies the impact of plastic pollution on marine ecosystems.

An Evening Meal by Parham Pourahmad, USA

Advertisement
Parham Pourahmad hawk eating a squirrelParham Pourahmad

Parham Pourahmad Winner wins the 11-14 Years category

Parham Pourahmad watched the last rays of sunlight highlight a young Cooper’s hawk eating a squirrel. Over the summer, he photographed wildlife in a city park to show that “nature will always be wild and unpredictable”.

Wetland Wrestle by Karine Aigner, USA

Karine Aigner anaconda coiled around a yacare caiman's snout  Karine Aigner

Karine Aigner won the Behaviour: Amphibians and Reptiles category

Karine Aigner spotted a yellow anaconda coiled around the snout of a yacaré caiman while leading a tour group. She observed the two reptiles struggling, uncertain which was the aggressor, while horseflies clung to the snake’s back.

The Serengeti of the Sea by Sage Ono, USA

Advertisement
Sage Ono Tube-snout fish eggs glimmer among golden kelpSage Ono

Sage Ono’s image won the Rising Star Award.

Tube-snout fish eggs glimmer among golden kelp, their colours fading as they develop. Sage Ono, inspired by his grandfather’s marine biology stories, captures the unique underwater life of Monterey Bay’s giant kelp forests.

“I like small and weird. So, when I saw the eggs and the kelp, I was like, okay, this is something I don’t have a photograph of. I’ve never really seen a photograph of it, so it’s really interesting to me.” Sage said.



Source link

Advertisement
Continue Reading

Technology

Prime Day Anker deals include big savings on power banks and chargers during October Big Deal Days

Published

on

Prime Day Anker deals include big savings on power banks and chargers during October Big Deal Days

Anker makes some of our favorite charging gear and mobile accessories, and it’s almost guaranteed that you’ll be able to find good discounts on the company’s products during an event like October Prime Day. Whether you’ve been on the hunt for a docking station for your laptop, want a new magnetic wireless charger for your next trip or just need another charging cable to replace the last one you misplaced, Prime Day deals on Anker devices should be able to help. We’re seeing some of our favorite Anker accessories on sale for record-low (or close to them) prices. While there’s always the chance that these deals come back around in a month for Black Friday, we recommend grabbing what you want now while the deals are available. These are the best Prime Day deals on Anker gear that we found for October Prime Day.

Particularly if you have an iPhone with MagSafe support, magnetic accessories can make charging up your phone even easier. On sale this time around are wireless, magnetic power banks and charging stations that can support multiple devices at once.

Anker Prime Power Bank 200W

Photo by Amy Skorheim / Engadget

Prime Day, or any big sale event for that matter, is a good opportunity to pick up a few extra essentials like charging cables while you can get them at a discount. Anker’s offerings right now include deals on USB-C and Lightning cables, along with charging adapters in various sizes and max wattages.

Anker may be known for its charging gear, but the company makes other accessories like docking stations and webcams, too. Prime Day deals include deep discounts on hubs and stations that add a bunch of extra ports back into the mix, and one of our favorite webcams.

Advertisement

Follow @EngadgetDeals on Twitter for the latest tech deals and buying advice, and stay tuned to Engadget.com for all of the best tech deals coming out of October Prime Day 2024.

Source link

Advertisement
Continue Reading

Servers computers

CERTECH Benchmark Server Rack – 800mm Wide

Published

on

CERTECH Benchmark Server Rack - 800mm Wide

source

Continue Reading

Technology

How a UK treaty could spell the end of the .io domain

Published

on

How a UK treaty could spell the end of the .io domain

A treaty finalized by the UK may bring about the end of the .io domain. Last week, the British government announced that it has agreed to give up ownership of the Chagos Islands, a territory in the Indian Ocean it has controlled since 1814 — relinquishing the .io domain with it.

But first, let’s take a step back (and I mean far back) to see how we got here. According to the Encyclopedia Britannica, the Chagos Islands were settled by the French in the 1700s, who brought slaves to the archipelago. In 1814, the French ceded control of the Chagos Islands and the island country of Mauritius to the British. When the British took over, the Chagos Islands remained a dependency of Mauritius.

In 1965, the UK granted Mauritius its sovereignty, but the government decided to split off the Chagos Islands, making it a British Indian Ocean Territory. The UK ended up forcibly removing the Chagossian people so the US could build a military base on one of the islands, displacing more than 1,500 people, as detailed in this report from Human Rights Watch.

Eventually, the Chagos Islands — or the British Indian Ocean Territory — were given the IO country code. It was also assigned a matching .io country code domain in 1997. The British government granted the rights to sell .io domains to the Internet Computer Bureau (ICB), according to a 2014 report from GigaOm.

Advertisement

A country’s government is typically supposed to receive revenue for any sites that register using their country code domain. For example, Anguilla, which has the country code AI, was projected to make between $25 million and $30 million last year from websites registering with the .ai domain.

The IANA aims to retire old country code domains within five years

You’d think the Chagos Islands would make similar amounts of money from the .io domain. After all, thousands of buzzy tech startups and cryptocurrency companies — like itch.io, greenhouse.io, and opensea.io — adopted the domain, since “io” also serves as an abbreviation for “input/output.”

However, entrepreneur Paul Kane, who previously ran the ICB, told GigaOm that the British government collected some of the revenue, which came as a surprise to the Chagossian people. In 2020, the Chagossians submitted a claim to gain ownership of what they said was a $50 million property, as reported by Fortune.

Advertisement

But now, the UK’s finalized agreement will make the Chagos Islands part of Mauritius — a move Chagossians say the government didn’t even consult them on. With this change, the British Indian Ocean Territory is no more, calling into question the future of the .io domain.

As pointed out by the Every newsletter, the Internet Assigned Numbers Authority (IANA) has a process for retiring old country code domains within five years (with the possibility for extensions). The IANA established this rule after the Soviet Union’s .su domain lingered after its collapse, becoming a domain commonly used among cybercriminals.

Since then, IANA has also had to retire the .yu domain previously used for Yugoslavia, but it remained operational for years following the country’s breakup while government websites transitioned to new domains. And while the independent Solomon Islands does have the domain name .sb, where “B” stands for how it used to be a British protectorate, that domain was registered decades after it achieved independence. The UK still has the inactive .gb domain as well, but it’s considering getting rid of it.

For now, it’s still too early to tell what will become of the .io domain — whether it will go through a similar transitional period like .yu, or if the IANA will just let the Chagossans keep it. The Verge reached out to Identity Digital — the domain registrar that previously obtained the rights to sell .io domains — and IANA for information about .io’s future. We didn’t immediately hear back.

Advertisement

Source link

Continue Reading

Servers computers

Anurag Gurtu Introduces the UCS-E Data Center-Class Blade Server

Published

on

Anurag Gurtu Introduces the UCS-E Data Center-Class Blade Server

source

Continue Reading

Technology

Quordle today – hints and answers for Wednesday, October 9 (game #989)

Published

on

Quordle on a smartphone held in a hand

Quordle was one of the original Wordle alternatives and is still going strong now nearly 1,000 games later. It offers a genuine challenge, though, so read on if you need some Quordle hints today – or scroll down further for the answers.

Enjoy playing word games? You can also check out my Wordle today, NYT Connections today and NYT Strands today pages for hints and answers for those puzzles.

Source link

Continue Reading

Trending

Copyright © 2024 WordupNews.com