Microsoft Obtains Osmos for Agentic AI Data Engineering
Microsoft has revealed the acquisition of Seattle-based startup Osmos, concentrating on agentic AI for data engineering, in a strategic transfer to reduce time-consuming manual information preparation. The integration aims to enhance Microsoft Material’s analytics abilities by automating complicated ingestion and transformation tasks that generally drain IT teams’ time and resources. Deploying self-governing AI agents will reduce human intervention.
Agentic AI for Data Engineering
Osmos’ AI representatives are developed to autonomously handle end-to-end data workflows, from intake to validation, allowing teams to focus on producing insights instead of cleaning up information. The acquisition signals Microsoft’s growing investment in streamlining huge data operations and closing the space with competitors like Databricks on the Azure platform.
“Organizations today deal with a common challenge: Data is everywhere, but making it actionable is often manual, slow and pricey,” composed Bogdan Crivat, corporate vice president of Azure Data Analytics at Microsoft, in a post revealing the acquisition. “Many teams spend the majority of their time preparing data instead of analyzing it.”
Osmos Background
Founded in 2019, Osmos raised $13 million in 2021 from financiers including Lightspeed Venture Partners, CRV, Pear and SV Angel.
Osmos will be folded into Microsoft Material, the company’s merged information and analytics platform. The integration will center on OneLake, Fabric’s merged information lake that functions as the foundation for the platform.
The Osmos group currently built native integrations with Material through Microsoft’s Workload Center extensibility platform. Those items included an AI information wrangler and AI data engineering representatives that produce production-grade PySpark notebooks straight within Fabric environments.
According to Roy Hasson, Microsoft senior director of item, the existing Osmos items demonstrated strong customer adoption. “We rapidly recognized that clients liked using Osmos on top of Fabric Spark and it reduced their dev and upkeep efforts by 50%,” Hasson said in a LinkedIn post.
How the Technology Works
The innovation creates Fabric-native notebooks with built-in recognition, metric logging and variation control. These notebooks support multiple data formats consisting of CSV, Excel, JSON, Parquet and text files.
At the core of Osmos is what the business calls an “AI Data Engineer”– an agentic system created to function like a human data engineer. The innovation translates user requirements, composes code, performs validation and releases to production tables pending human approval.
Competitive Landscape
The acquisition positions Microsoft’s Material more straight in competition with Databricks, which also provides automated ETL tools on Azure. Both platforms are developed around Apache Glow for information processing.
Microsoft Material released in May 2023 and has gotten stable updates, including the Real-Time Intelligence module announced at Build 2024 and the general schedule of Copilot for Fabric.
What’s Next
The Osmos team will sign up with Microsoft’s Fabric engineering organization. Microsoft stated it will share integration timelines and item updates through the Microsoft Material Blog Site. To find out more, check out the Microsoft website.