Connect with us

Technology

Fivetran targets data security by adding Hybrid Deployment

Published

on

Fivetran targets data security by adding Hybrid Deployment

Fivetran on Wednesday introduced Hybrid Deployment, a feature that enables customers to develop and run data pipelines within their own secure environments rather than having to run all workloads on the vendor’s managed platform.

While many enterprises have no problems running data integration workloads in a vendor’s cloud environment, some, such as those in highly regulated industries need  those workloads to be tightly managed and are better suited by private clouds or on-premises deployments.

Hybrid Deployment lets such customers control their Fivetran workloads from those private clouds or on-premises systems to ensure security and compliance, which is significant because it enables Fivetran to better meet the needs of certain customers as well as potentially reach new ones, according to Doug Henschen, an analyst at Constellation Research.

The vendor has grown rapidly since 2012 by serving customers that store data in cloud-based platforms such as Amazon Redshift, Databricks, Google BigQuery, Microsoft Azure and Snowflake, he noted. Hybrid Deployment enables Fivetran to reach new potential customers as well as existing ones that store data in multiple environments.

Advertisement

“Now that the company is maturing, it’s clearly looking to reach new and existing customers that have significant on-premises requirements and need to either move data into the cloud or handle integrations on premises,” Henschen said.

Based in Oakland, Calif., Fivetran is a data integration specialist. The vendor’s broad network of connectors enables customers to ingest data from their sources into databases, data warehouses and data lakes where it can be integrated with similar data to form datasets for analytics and AI applications.

To date, Fivetran has raised over $850 million in total funding, including $125 million in debt financing in May 2023 that was intended as a hedge against a potential economic downturn. Earlier in 2023, the vendor added a set of high-volume connectors and unveiled an integration with Monte Carlo to add data observability capabilities at the point of ingestion.

Hybrid Deployment

Enterprise data is complex. It comes from myriad sources in an array of forms and contains different types of information.

Advertisement

Some of it is simple and straightforward. It can be ingested from its original source and moved into a system on a public cloud where it can then be prepared for analysis. It needs to be kept secure because it often it contains proprietary information that if leaked could lead to a competitive disadvantage for an enterprise. But it doesn’t contain data that, if accidentally exposed, could violate privacy regulations or result in other harm to an organization.

Other data is more sensitive. For example, it could contain personally identifiable information that if exposed would lead to a regulatory violation.

As a result, enterprises often keep such data in their own environment so it never gets moved — even through secure channels — into an external system such as a public cloud or a vendor’s platform. Private clouds are one method of keeping data more secure.. On premises databases are another.

To meet the needs of those organizations subject to greater regulatory oversight than most others or that deal with large amounts of sensitive information, established data integration vendors such as Boomi, Informatica and SnapLogic provide hybrid deployment capabilities.

Advertisement

Meanwhile, Fivetran is not long out of its startup phase, Henschen pointed out.

“Fivetran is a fairly young, cloud-focused company,” he said.

As a result, though it competes with mature vendors, its most similar peers are other data integration vendors still attempting to mature such as AirByte, DBT Labs and Matillion. Now, as it attempts to grow, Fivetran is adding certain capabilities that more evolved vendors already provide.

Hybrid Deployment, therefore, represents Fivetran’s own effort to meet the needs of organizations subject to strict regulatory oversight or that deal with large amounts of sensitive data. Such organizations often struggle to develop systems that enable data-informed decision-making, the vendor noted.

Advertisement

With Hybrid Deployment, Fivetran is supplying them with the means to integrate data without it ever leaving their secure environment in what Kevin Petrie, an analyst at BARC U.S. called a logical next step in its development.

“Fivetran first distinguished itself as a simple, cost-effective way to move data from many SaaS applications in the cloud to cloud-based data warehouses such as Snowflake,” he said.

Later, in 2021 in conjunction with raising $565 million in funding, Fivetran acquired HVR, adding capabilities that enabled customers to extract data from on-premises databases, Petrie noted.

“Their new hybrid capabilities extend this strategy by enabling Fivetran customers to manage and govern data pipelines on premises as well as in one or more clouds,” he said.

Advertisement

While Hybrid Deployment is an evolution for Fivetran, providing enterprise-grade capabilities that its more mature competitors also provide, the impetus for its development came from customer feedback, according to chief operating officer Taylor Brown, a Fivetran co-founder..

Certain customers use Fivetran for some of their data integration and movement, but without being able to manage their data in their own environments were unable to use Fivetran for all their data movement and integration needs.

The security fears that cause certain organizations to avoid using public clouds to manage data are not unfounded, Brown noted. For Fivetran to serve their needs, they required something more from the vendor.

“These customers might use Fivetran for most data sources but have to rely on cumbersome DIY or self-hosted solutions for the most sensitive of sources,” Brown said. “Fivetran’s Hybrid Deployment … provides them with the flexibility to maintain full control over sensitive data while benefiting from the ease and scalability of a managed service.”

Advertisement

Hybrid Deployment provides Fivetran users with a single control pane from which they can manage all data sources, whether they are in public clouds, private clouds or on premises.

Intended benefits include the following, according to Fivetran:

  • Full visibility by enabling customers to monitor all their data pipelines from a single interface in their own environment rather than Fivetran’s.
  • Security features that let users set access controls, mask sensitive data and track data as it moves through pipelines to ensure that it remains compliant.
  • Compatibility across multiple environments including on premises, private clouds and public clouds such as AWS, Google Cloud Platform and Microsoft Azure.
  • Cost control by providing customers with detailed reporting tools and enabling them to track their usage.
  • Pipeline scalability and customization to meet an organization’s unique needs.
  • Simple setup.

While all are valuable, compatibility across environments and cost management are potentially the most significant for Fivetran customers, according to Henschen.

Independent vendors such as Fivetran tend to address compatibility better than tech giants that provide data integration tools as part of larger data management offerings, he noted. Meanwhile, cost management measures are critical as more workloads are moved to the cloud and cloud spending increases for enterprises.

“All [the intended benefits] are important and ones that many integration vendors try to address,” Henschen said. “The ones that stand out to me are compatibility across environments … and cost management, which is really crucial to all customers but not all vendors address the need adequately.”

Advertisement

Petrie likewise highlighted the cost control features as particularly notable. Being able to accurately predict cloud spending is critical for enterprises, especially as they increase their investments in generative AI, traditional AI and machine learning fueled by technological advances such as the evolution of large language models and added compute power.

“I like their ability to monitor utilization and consumption of pipeline resources from a cost standpoint,” he said. “This supports FinOps initiatives in which enterprises aim to predict, measure, optimize and govern cloud-related costs.”

Looking ahead

With Hybrid Deployment now part of Fivetran’s platform, the vendor’s aim is to continue adding features that ultimately make access to data as simple and reliable as possible, according to Brown.

Specifically, the vendor’s roadmap includes adding tools that provide more support for customers as they develop AI and machine learning workloads, including further addressing data security and compliance.

Advertisement

One such tool will combine the capabilities of Hybrid Deployment and Fivetran Managed Data Lake to enable any organization — whether dealing with large volumes of sensitive data or not — to use their unstructured data to help train AI models and applications.

Unstructured data, often stored in data lakes, now makes up more than three-quarters of all data and is key to training AI models and applications. Unstructured data, however, is not easy to integrate with structured data to provide enterprises with a complete view of their operations.

“As AI workloads and applications continue to be top-of-mind for customers, we’ll be building more functionality into the platform to support those efforts,” Brown said.

Eric Avidon is a senior news writer for TechTarget Editorial and a journalist with more than 25 years of experience. He covers analytics and data management.

Advertisement

Source link

Continue Reading
Advertisement
Click to comment

You must be logged in to post a comment Login

Leave a Reply

Science & Environment

“Dark oxygen” created in the ocean without photosynthesis, researchers say

Published

on

"Dark oxygen" created in the ocean without photosynthesis, researchers say


Researchers have discovered bundles of “dark oxygen” being formed on the ocean floor. 

In a new study, over a dozen scientists from across Europe and the United States studied “polymetallic nodules,” or chunks of metal, that cover large swaths of the sea floor. Those nodules and other items found on the ocean floor in the deep sea between Hawaii and Mexico were subjected to a range of experiments, including injection with other chemicals or cold seawater. 

The experiments showed that more oxygen — which is necessary for all life on Earth — was being created by the nodules than was being consumed. Scientists dubbed this output “dark oxygen.” 

Advertisement

About half of the world’s oxygen comes from the ocean, but scientists previously believed it was entirely made by marine plants using sunlight for photosynthesis. Plants on land use the same process, where they absorb carbon dioxide and produce oxygen. But scientists for this study examined nodules about three miles underwater, where no sunlight can reach. 

This isn’t the first time attention has been drawn to the nodules. The chunks of metal are made of minerals like cobalt, nickel, manganese and copper that are necessary to make batteries. Those materials may be what causes the production of dark oxygen. 

“If you put a battery into seawater, it starts fizzing,” lead researcher Andrew Sweetman, a professor from the Scottish Association for Marine Science, told CBS News partner BBC News. “That’s because the electric current is actually splitting seawater into oxygen and hydrogen [which are the bubbles]. We think that’s happening with these nodules in their natural state.”

The metals on the nodules are valued in the trillions of dollars, setting of a race to pull the nodules up from the ocean’s depths in a process known as deep sea or seabed mining. Environmental activists have decried the practice.  

Advertisement

Sweetman and other marine scientists worry that the deep sea mining could disrupt the production of dark oxygen and pose a threat to marine life that may depend on it. 

“I don’t see this study as something that will put an end to mining,” Sweetman told the BBC. “[But] we need to explore it in greater detail and we need to use this information and the data we gather in future if we are going to go into the deep ocean and mine it in the most environmentally friendly way possible.”



Source link

Advertisement
Continue Reading

Technology

Quantum computers teleport and store energy harvested from empty space

Published

on

Quantum computers teleport and store energy harvested from empty space

A quantum computing chip

IBM

Energy cannot be created from nothing, but physicists found a way to do the next best thing: extract energy from seemingly empty space, teleport it elsewhere and store it for later use. The researchers successfully tested their protocol using a quantum computer.

The laws of quantum physics reveal that perfectly empty space cannot exist – even places fully devoid of atoms still contain tiny flickers of quantum fields. In 2008, Masahiro Hotta at Tohoku University in Japan proposed that those flickers, together with the …

Advertisement

Source link

Continue Reading

Science & Environment

What caused the hydrothermal explosion at Yellowstone National Park? A meteorologist explains

Published

on

What caused the hydrothermal explosion at Yellowstone National Park? A meteorologist explains


Yellowstone National Park visitors were sent running and screaming Tuesday when a hydrothermal explosion spewed boiling hot water and rocks into the air. No one was injured, but it has left some wondering: How does this happen and why wasn’t there any warning? 

The Weather Channel’s Stephanie Abrams said explosions like this are caused by underground channels of hot water, which also create Yellowstone’s iconic geysers and hot springs. 

“When the pressure rapidly drops in a localized spot, it actually forces the hot water to quickly turn to steam, triggering a hydrothermal explosion since gas takes up more space than liquid,” Abrams said Wednesday on “CBS Mornings.” “And this explosion can rupture the surface, sending mud and debris thousands of feet up and more than half a mile out in the most extreme cases.” 

Advertisement

Tuesday’s explosion was not that big, Abrams said, “but a massive amount of rocks and dirt buried the Biscuit Basin,” where the explosion occurred.   

A nearby boardwalk was left with a broken fence and was covered in debris. Nearby trees were also killed, with the U.S. Geological Survey saying the plants “can’t stand thermal activity.” 

Advertisement

“Because areas heat up and cool down over time, trees will sometimes die out when an area heats up, regrow as it cools down, but then die again when it heats up,” the agency said on X.

The USGS said it considers this explosion small, and that similar explosions happen in the national park “perhaps a couple times a year.” Often, though, they happen in the backcountry and aren’t noticed.

“It was small compared to what Yellowstone is capable of,” USGS Volcanoes said on X. “That’s not to say it was not dramatic or very hazardous — obviously it was. But the big ones leave craters hundreds of feet across.”

The agency also said that “hydrothermal explosions, “being episodes of water suddenly flashing to steam, are notoriously hard to predict” and “may not give warning signs at all.” It likened the eruptions to a pressure cooker.

Advertisement

While Yellowstone sits on a dormant volcano, officials said the explosion was not related to volcanic activity. 

“This was an isolated incident in the shallow hot-water system beneath Biscuit Basin,” the USGS said. “It was not triggered by any volcanic activity.” 





Source link

Advertisement
Continue Reading

Technology

What happened to the Metaverse?

Published

on

What happened to the Metaverse?

S6
Ep135


What happened to the Metaverse?

Host Andrew Davidson is joined by technology experts Brian Benway and Jan Urbanek in a discussion about the Metaverse. Our experts shed light on the latest technological and hardware advancements and marketing strategies from Big Tech. What will it take for the Metaverse to gain mainstream popularity? Listen now to find out!

Advertisement

Head over to Mintel’s LinkedIn to let us know what you think of today’s episode, and visit mintel.com to become a member of our free Spotlight community.

Visit the Mintel Store to explore all our technology research and buy a report today.

Advertisement

Meet the Host

Andrew Davidson

SVP/Chief Insights Officer, Mintel Comperemedia.

Advertisement

Meet the Guests

Brian Benway

Senior Analyst, Gaming and Entertainment, Mintel Reports US.

Advertisement

Jan Urbanek

Senior Analyst, Consumer Technology, Mintel Reports Germany.

Advertisement

Mintel News

For the latest in consumer and industry news, top trends and market perspectives, stay tuned to Mintel News featuring commentary from Mintel’s team of global category analysts.

Advertisement
Advertisement

More from Mintel

  • Mintel Technology Reports

    Mintel’s Technology market research help you anticipate what’s next in the Technology industries….


    View our reports store

Subscribe to Mintel Spotlight

Podcast

2024-03-15T03:16:00+00:00

Advertisement

2024

0

Latest insights

June 6, 2024

In the exciting world of Artificial Intelligence (AI), prompts are instructions or queries you enter into the AI interface to get responses. If you want helpful responses, you…

Advertisement

November 28, 2023

Head over to Mintel’s LinkedIn to let us know what you think of today’s episode, and visit mintel.com to become a member of our free Spotlight community. Learn…

Download the Latest Market Intelligence

Advertisement

Source link

Continue Reading

Science & Environment

Archaeologists make stunning underwater discovery of ancient mosaic in sea off Italy

Published

on

Archaeologists make stunning underwater discovery of ancient mosaic in sea off Italy


More than 30,000 ancient coins found

Advertisement

Advertisement


More than 30,000 ancient coins found off the coast of Italy

00:50

Advertisement

Researchers studying an underwater city in Italy say they have found an ancient mosaic floor that was once the base of a Roman villa, a discovery that the local mayor called “stupendous.” 

The discovery was made in Bay Sommersa, a marine-protected area and UNESCO World Heritage Site off the northern coast of the Gulf of Naples. The area was once the Roman city of Baia, but it has become submerged over the centuries thanks to volcanic activity in the area. The underwater structures remain somewhat intact, allowing researchers to make discoveries like the mosaic floor. 

The Campi Flegrei Archaeological Park announced the latest discovery, which includes “thousands of marble slabs” in “hundreds of different shapes,” on social media

452639775-795071199481548-6552179372358771133-n.jpg
A part of the mosaic floor being excavated. 

Advertisement

Edoardo Ruspantini


“This marble floor has been at the center of the largest underwater restoration work,” the park said, calling the research “a new challenge” and made “very complicated due to the extreme fragment of the remains and their large expansion.”

The marble floor is made of recovered, second-hand marble that had previously been used to decorate other floors or walls, the park said. Each piece of marble was sharpened into a square and inscribed with circles. The floor is likely from the third century A.D., the park said in another post, citing the style of the room and the repurposing of the materials as practices that were common during that time. 

452533330-795071436148191-6754360492272000857-n.jpg
The remains of collapsed walls that cover the mosaic floor. 

Advertisement

Parco Archeologico Campi Flegrei


Researchers are working carefully to extract the marble pieces from the site, the park said. The recovery work will require careful digging around collapsed walls and other fragmented slabs, but researchers hope to “be able to save some of the geometries.” 

Once recovered, the slabs are being brought to land and cleaned in freshwater tanks. The marble pieces are then being studied “slab by slab” to try to recreate the former mosaic, the park said. 

452615453-795071266148208-4364365545620230344-n.jpg
Researchers work to rearrange the mosaic tiles after bringing them up from underwater. 

Advertisement

Parco Archeologico Campi Flegrei


“The work is still long and complex, but we are sure that it will offer many prompts and great satisfactions,” the park said. 



Source link

Advertisement
Continue Reading

Technology

SpaceX fires up Starship engines ahead of fifth test flight

Published

on

SpaceX fires up Starship engines ahead of fifth test flight

SpaceX has just performed a static fire of the six engines on its Starship spacecraft as it awaits permission from the Federal Aviation Administration (FAA) for the fifth test flight of the world’s most powerful rocket.

The Elon Musk-led spaceflight company shared footage and an image of the test fire on X (formerly Twitter) on Thursday. It shows the engines firing up while the vehicle remained on the ground.

For flights, the Starship spacecraft is carried to orbit by the first-stage Super Heavy booster, which pumps out 17 million pounds of thrust at launch, making it the most powerful rocket ever built.

Advertisement

The Super Heavy booster and Starship spacecraft — collectively known as the Starship — have launched four times to date, with the performance of each test flight showing improvements over the previous one.

The first one, for example, exploded shortly after lift off from SpaceX’s Starbase facility in Boca Chica, Texas, in April last year, while the second effort, which took place seven months later, achieved stage separation before an explosion occurred — an incident that was captured in dramatic footage. The third and fourth flights lasted much longer and achieved many of the mission objectives, including getting the Starship spacecraft to orbit.

The fifth test flight isn’t likely to take place until November at the earliest, according to a recent report. It will involve the first attempt to use giant mechanical arms to “catch” the Super Heavy booster as it returns to the launch area. SpaceX recently expressed extreme disappointment at the time that it’s taking the FAA to complete an investigation that will pave the way for the fifth Starship test, and has said that it’ll be ready to launch the vehicle within days of getting permission from the FAA.

Once testing is complete, NASA wants to use the Starship, along with its own Space Launch System rocket, to launch crew and cargo to the moon and quite possibly for destinations much further into space such as Mars. NASA is already planning to use a modified version of the Starship spacecraft to land the first astronauts in five decades on the lunar surface in the Artemis III mission, currently set for 2026.

Advertisement






Source link

Advertisement
Continue Reading

Trending

Copyright © 2017 Zox News Theme. Theme by MVP Themes, powered by WordPress.