Blog

Composable DataOps Blog

• Configuring MSMQ with Windows Failover Clustering on AWS for Composable DataOps (2-Node Setup)
  Microsoft Message Queuing (MSMQ) is a robust messaging platform for reliable and low latency asynchronous communication between distributed application components. It offers exactly-once delivery, transactional coordination with databases, priority queues, and peek-lock semantics — making it well-suited for mission-critical workloads that demand durability, ordering, and seamless failover. By combining MSMQ with Windows Failover Clustering (WSFC) […]
• Running Multiple Composable Web Nodes
  In order to meet the demand of incoming requests to a Composable cluster, you many need to scale out and run multiple web nodes. In this topology, a network load balancer is required to sit in front of the web nodes with sticky sessions enabled, and route traffic across the web nodes in the cluster. […]
• Execute External Applications From DataFlows – The Process Executor
  There are many instances when working with DataFlows where you need to execute some executable or command. In this post we will explore two examples where the process executor was used to run a program not native to Composable from a DataFlow. Building a Web App The first task we will look is at building […]
• Enabling Azure AD Authentication for Composable
  1. Create an App Registration in the Azure Portal. 2. In the App Registration, you’ll need to add Composable redirect urls. There are 2 different urls that Composable may request Microsoft Online to redirect back to. One is the Composable login page, and the other is the Composable register page if the user hasn’t setup […]
• Composable’s Industry Trends for 2025
  As we step into 2025, the landscape of artificial intelligence (AI) and DataOps continues to evolve at an unprecedented pace. At Composable, we’ve been at the forefront of these advancements, and we’re excited to share some recent industry recognition and insights into the trends shaping our industry. Composable’s Recent Recognition In 2024, Composable achieved significant […]
• Composable’s Latest Features
  As we close out 2024, we wanted to share some of the latest updates and enhancements to the Composable platform. These features, ranging from major upgrades to subtle yet powerful enhancements, are designed to streamline your processes and supercharge your DataOps productivity. Highlights Test Suites Testing is a cornerstone of reliable analytics. Our new Test […]
• DataLabNotebookRunner Script Support
  Composable now supports running Python scripts from DataLabs using the DataLab Notebook Runner Module. This is useful in production environments where you wish to run DataLab code without the overhead of spinning up a notebook. The above script and notebook Modules simply add the two numbers labeled with variables a and b together. Stats:13.202s .ipynb […]
• Composable & ChatGPT APIs: Unlocking the Power of Conversational AI
  ChatGPT is a revolutionary language model that has taken the world by storm. With its remarkable ability to generate human-like responses and engage in meaningful conversations, it has become an indispensable tool for various applications. The benefits of ChatGPT are vast, from enhancing customer support experiences to enabling virtual assistants that can understand and respond […]
• Composable and Databricks: The Essential Role of Monitoring and Governance
  As organizations scale their usage of Databricks, they often encounter challenges related to governance and management of the various components within the environment. In this blog post, we will explore the importance of implementing a monitoring tool to maintain control over databases, tables, and notebooks created within Databricks and show how this can be done […]
• Unlocking the Power of Data Exchange and Collaboration with Composable Data Marketplaces
  Organizations are constantly seeking new ways to access and leverage valuable data. One emerging solution that has gained significant attention is the concept of data marketplaces. Data marketplaces provide a platform for securely sharing data, enabling organizations to tap into a wide range of datasets to drive insights and innovation. In this post, we will […]