# Why Condense? {% embed url="" %} ## Built-in IDE for Custom Transformations & Connectors Condense provides a fully integrated development environment (IDE) designed for building, testing, and deploying custom transformations logics and connectors directly within the platform. The built-in IDE enables developers to write complex logic using their preferred programming languages, integrate with version control systems, and efficiently manage the full lifecycle of data transformations and streaming applications. ### Key Benefits of Built-in IDE:
#### Seamless Customization for Complex Workflows * Write, Test & Deploy Custom Code – The IDE enables developers to write complex transformations and build custom connectors, tailored to unique business needs. * Multi-Language Support – Developers can use Python, Java, Scala, or other supported languages to create high-performance data streaming logic. * Integrated Development & Execution – Test and validate custom logic directly within the IDE before deploying to production. #### Version Control Integration for Collaborative Development * Seamless Git Integration – Connect GitHub, GitLab, or Bitbucket for version control, rollback, and collaboration on transformation logic. * Branching & Code Management – Developers can manage multiple branches, ensuring smooth development, testing, and deployment workflows. * Continuous Integration (CI) for Custom Code – Automate builds, testing, and releases, reducing errors and ensuring production-ready deployments. #### Scalable & Secure Development Environment * On-Demand Development Containers – The IDE automatically provisions secure, isolated environments for each development session. * Auto-Expire Development Environments – Pre-configured expiration policies ensure optimal resource utilization and cost efficiency. * Prebuilt Testing & Debugging Tools – Identify issues in real time with built-in debugging, log tracking, and execution monitoring. #### Deployment & Lifecycle Management of Custom Code * Versioning for Custom Transforms & Connectors – Easily publish, restore, and deploy new versions of custom transformations for uninterrupted workflows. * Pipeline Deployment & Monitoring – Deploy custom logic directly into data pipelines and track execution metrics. * Rollback & Recovery – Restore deleted or expired applications to ensure continuity in streaming workflows. #### Efficient and Intelligent Data Processing * Real-Time Data Execution – Process data streams efficiently with low-latency execution of custom logic. * Optimized Resource Allocation – Ensure that custom transformations scale dynamically, adapting to fluctuating workloads. * Enterprise-Grade Security – Built-in RBAC (Role-Based Access Control) ensures only authorized users can edit, deploy, or delete custom transforms. ### Why Condense Built-in IDE is a Game-Changer? 1. No External Tools Required – Develop, test, and deploy custom code without needing additional software or platforms. 2. Designed for Streaming & Transformations – Purpose-built IDE tailored for real-time data processing and Kafka-based event-driven architectures. 3. Faster Development & Deployment – Reduces time-to-market by eliminating integration complexities between code development and streaming pipelines. 4. Ensures Code Reliability & Versioning – Built-in Git support and automated version tracking ensure stability and consistency in all deployments. 5. Enterprise-Ready Security & Compliance – Provides audit trails, user access management, and secure execution for regulated industries. With Condense offered built-in IDE, developers can build, deploy, and scale complex transformations and connectors with ease, efficiency, and full control, accelerating real-time data processing like never before. ## Condense comes with a Fully Managed BYOC
Condense is deployed as “Fully Managed BYOC (Bring Your Own Cloud)” which allows enterprises to deploy and operate their real-time data streaming platform directly within their own cloud environment, ensuring complete control over their data, security, and compliance requirements—without the burden of infrastructure management. With fully managed Kafka at its core, Condense automates deployment, scaling, and maintenance, making real-time data streaming effortlessly while maintaining the flexibility of customer-owned infrastructure. ### Advantages of Fully Managed BYOC? #### Full Data Sovereignty & Compliance Data remains in the customer's cloud environment, ensuring security and compliance with industry regulations. #### Zero Infrastructure Management Fully managed updates, patches, auto-scaling, and failovers eliminate backend complexity. #### High Availability & Reliability Guarantees 99.95% uptime SLA with built-in multi-cluster redundancy and fault tolerance. #### Dynamic Resource Optimization Automatically scales up or down based on data throughput, optimizing cloud costs. #### Seamless Deployment via Marketplace Available on AWS Marketplace, Azure Marketplace, and GCP Marketplace, enabling one-click deployment with pre-configured settings. ### Why Choose Condense with Fully Managed BYOC? #### Enterprise-Ready Designed for organizations that require streaming infrastructure within their controlled cloud environment with zero operational complexity. #### Security-First Approach Fully aligns with compliance mandates by keeping data within the enterprise cloud. #### Cost-Optimized No overprovisioning—auto-scaling ensures businesses pay only for the resources they use. #### Scalability Without Limits Handle high-throughput real-time data streaming, making it ideal for mobility, fintech, healthcare, and IoT applications. ## Condense inherently deploys with a Fully - Managed Kafka
Condense provides a fully managed Kafka service within its Fully Managed BYOC model, ensuring seamless data streaming, high availability, and zero infrastructure complexity. By embedding Kafka into its industry-specific verticalized streaming ecosystem, Condense enables real-time event processing, data communication between services, and scalable pipeline orchestration—all within the customer's cloud environment. With Condense fully managed Kafka, enterprises get enterprise-grade performance, dynamic scaling, and automated operational management, eliminating the need for manual intervention in cluster provisioning, maintenance, scaling, and security updates. ### Kafka as the Messaging Backbone #### Event-Driven Data Streaming Condense uses Kafka as a high-throughput event streaming system, ensuring fault-tolerant, distributed message queuing between microservices and streaming applications. #### One-Way Queue Model Kafka operates as a one-way queue, moving event data seamlessly through various prebuilt transformations, custom transformations, and real-time processing stages before reaching downstream applications. #### Decoupled Service Communication Kafka ensures service independence, meaning applications can produce and consume data asynchronously without blocking. #### High-Performance Streaming Optimized for millions of events per second, ensuring low-latency streaming and high-throughput data processing. ### Cluster Management: Kafka Brokers and Zookeeper #### Fully Managed Kafka Cluster Kafka brokers and Zookeeper run within customer-controlled cloud environments, managed by Condense, ensuring high availability and resilience. #### Fault-Tolerant Architecture Multi-cluster redundancy and automatic replication prevent data loss and ensure continuous streaming even in the event of node failures. #### Data Integrity & Consistency Kafka maintains strong replication and partitioning strategies, ensuring data consistency across distributed environments. #### Seamless Kafka Version Upgrades Condense handles Kafka version upgrades with user consent, allowing smooth adoption of new features and security patches without disrupting operations. ### Automated Scaling with Event-Driven Auto-Scalers #### Consumer Group Auto-Balancing Kafka dynamically scales consumer groups based on event throughput, preventing backlogs and maintaining near-real-time processing. #### Adaptive Resource Scaling Event-driven auto scalers optimize cluster performance by dynamically adjusting consumer group offsets, ensuring Kafka maintains low-latency event processing at scale. #### Intelligent Partition Rebalancing Kafka automatically redistributes partitions among consumers during scaling, eliminating bottlenecks. ### Reliability and High Availability (99.95% Uptime SLA) #### Multi-Zone Deployment Kafka clusters are deployed across multiple availability zones within customer cloud environments, preventing downtime due to infrastructure failures. #### Automatic Failover & Leader Election If a Kafka broker fails, Zookeeper automatically elects a new leader, ensuring data availability and seamless failover. #### Log Retention & Durability Kafka persists event logs based on configurable retention policies, preventing data loss and ensuring replayability. ### Security, Compliance, and Observability #### Data Encryption Condense ensures end-to-end encryption for Kafka data in transit (TLS) and at rest (AES-256). #### Role-Based Access Control (RBAC) Fine-grained permission management ensures that only authorized applications and users can interact with Kafka topics. #### Audit Logging & Monitoring Built-in observability tools provide real-time monitoring of Kafka performance, including throughput, latency, and partition distribution. #### Enterprise Compliance Kafka operates within customer-controlled BYOC environments, ensuring GDPR, HIPAA, and SOC 2 compliance. ## How does Fully Managed Kafka in BYOC Benefit the Enterprises? * **Zero Kafka Management Overhead** No need to manage Kafka clusters, scale infrastructure, or troubleshoot failures. Condense automates everything. * **Predictable Low Latency** Ensures consistent real time data delivery for mission critical applications. * **Built for High Throughput Workloads** Supports millions of events per second across distributed systems. * **Seamless Upgrades and Patches** Kafka upgrades are handled without downtime, ensuring access to the latest security patches. * **Fully Secure and Compliant** Data stays within customer-controlled cloud environments and meets strict regulatory requirements. * **Marketplace Deployment** Available on AWS Marketplace, Azure Marketplace, and GCP Marketplace for one click provisioning. With Fully Managed Kafka which comes with built-in Condense fully managed BYOC, enterprises get the best of both worlds: fully managed real-time data streaming within a customer-controlled cloud environment. By eliminating operational complexity, enhancing security, and ensuring high-performance event streaming, Condense enables businesses to focus on innovation rather than infrastructure management.