5.5 C
London
Thursday, December 1, 2022

Confluent launches visual streaming data pipeline designer • londonbusinessblog.com

Must read

Closing arguments begin in the Trump Organization tax fraud case

Closing arguments began Thursday in the tax fraud case against the Trump Organization, which is accused of a sweeping, 15-year scheme to compensate top...

Medibank Hackers Declare ‘Case Closed’ As Hoard Of Stolen Data Is Released • londonbusinessblog.com

The cybercriminals behind the Medibank ransomware attack have published what appears to be the rest of the data stolen from the Australian health insurance...

Coinbase says Apple forced it to remove NFT transfers from its iOS wallet

Coinbase has accused Apple of forcing it to remove NFT transfers from the Wallet app on iOS. On Thursday, it tweeted that Apple...

Hour One’s $20 Million Deck • londonbusinessblog.com

Over the yearshas Mike Butcher covered Hour one a number of times here on londonbusinessblog.com. The company uses AI to create text-to-video solutions...
Shreya Christinahttps://londonbusinessblog.com
Shreya has been with londonbusinessblog.com for 3 years, writing copy for client websites, blog posts, EDMs and other mediums to engage readers and encourage action. By collaborating with clients, our SEO manager and the wider londonbusinessblog.com team, Shreya seeks to understand an audience before creating memorable, persuasive copy.

confluentthe company that built a streaming service on top of the open source Apache Kafka project, was always about helping companies capture data streams. First it was on prem, then later in the cloud. Moving the streaming service to the cloud has eliminated much of the complexity associated with managing the underlying infrastructure.

Today, at the current conference, the company is introducing a new tool called Stream Designer to make it easier to build a streaming data pipeline in a visual workflow. Users can simply plug in a set of data components to build a custom data stream, and Confluent takes care of the background coding for them, essentially moving the abstraction from infrastructure to design.

Company co-founder and CEO Jay Kreps says that while it’s still aimed at developers, its goal is to put stream design within the reach of more people than Apache Kafka experts.

“We still serve all kinds of developers, but this makes it something you can just click on and build a data pipeline that connects things, transforms data, and moves things from place to place. And it inherits and runs on the same underlying streaming infrastructure. That means all data streams are reusable, they’re all real-time, and they’re all horizontally scalable,” Kreps told londonbusinessblog.com.

He says that although the program writes the underlying code for the developer, it is still accessible to developers who need to work with it. “One of the nice things about how we’ve done this is that even though you don’t have to write any code, all the code is there. You can see exactly what he’s doing under the hood. You can see exactly the kind of transformations in SQL that we would do on this data, so it works with the existing developer toolchains as needed,” he said.

Confluent Stream Designer Tool

Example of Confluent Stream Designer Image Credits: confluent

For Kreps, this is all part of the evolution of Kafka, a project originally conceived at LinkedIn to move massive amounts of data. In the beginning it was a very technical venture, but over time the company has tried to make it more and more accessible to a larger number of people within an organization.

In addition to Stream Designer, the company is also announcing Stream Governance, which ensures that data is used correctly and that only authorized users can see data.

“For many organizations, it’s almost like there are two competing tensions: one is to unlock the data and use it to be effective and serve customers better and more efficiently. And the other is to lock it up and be safe and don’t let anything bad happen. And unless you have tools that help with both dimensions, you’re kind of stuck,” he said. Stream Governance helps users ensure they use the data flowing through these data streams in a secure and compliant manner.

While they were at it, Confluent announced a new Confluent for Startups program designed to let startups use the platform with free credits and access to expertise to help them get started with data streaming technologies.

Stream Designer and Stream Governance are available today as part of the Confluent cloud service subscription package, and there will be no additional charges for the new capabilities, he said.

More articles

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Latest article

Closing arguments begin in the Trump Organization tax fraud case

Closing arguments began Thursday in the tax fraud case against the Trump Organization, which is accused of a sweeping, 15-year scheme to compensate top...

Medibank Hackers Declare ‘Case Closed’ As Hoard Of Stolen Data Is Released • londonbusinessblog.com

The cybercriminals behind the Medibank ransomware attack have published what appears to be the rest of the data stolen from the Australian health insurance...

Coinbase says Apple forced it to remove NFT transfers from its iOS wallet

Coinbase has accused Apple of forcing it to remove NFT transfers from the Wallet app on iOS. On Thursday, it tweeted that Apple...

Hour One’s $20 Million Deck • londonbusinessblog.com

Over the yearshas Mike Butcher covered Hour one a number of times here on londonbusinessblog.com. The company uses AI to create text-to-video solutions...

How taking solo retreats is beneficial for founders and entrepreneurs

Opinions expressed by londonbusinessblog.com contributors are their own. A while ago I flew from Minneapolis to Panama City and then took a water taxi to...