KSQL
Last updated
Was this helpful?
Last updated
Was this helpful?
KSQL is a powerful, SQL-like streaming engine for Apache Kafka that enables real-time data processing and transformation. Integrating KSQL with Condense will enable users to perform complex data transformations and aggregations on Kafka topics directly from the platform.
Execute SQL-like queries on streaming data for immediate insights.
Supports filtering, joins, and aggregations in real time.
Create, update, and delete streams and tables from Kafka topics.
Streams for unbounded event sequences
Tables for stateful data
Run queries that process data on the fly without storing results.
Ideal for real-time monitoring and alerting
Integrated directly into the Condense UI for seamless query execution.
Visualise query results in real time.
Admin/Developer: Full access to create and manage queries.
Viewer: Read-only access (no KSQL permissions)
Admin or Developer role in Condense
Access to Kafka topics with read/write permissions
Basic knowledge of SQL syntax
Log in to Condense with your credentials
Navigate to KSQL from the main menu
Select New Query to open the editor
For processing real-time event data, in the query editor, enter your query
Click Execute to create the stream
For stateful data, in the query editor, enter your query
Click Execute to create the table
Execute transient queries for real-time analysis
Click Execute to execute and view real-time results
Review Error Logs:
Access logs below the query editor
Common issues: topic permissions, schema mismatches
RBAC (Role-Based Access Control) restricts access based on predefined user roles:
Admin: Full create/edit/delete permissions
Developer: Create/edit permissions
Viewer: Read-only access (no KSQL access in initial release)
Grant the user "Developer" or "Admin" role in RBAC
Ensure ACLs allow topic creation permissions
Yes, ACLs can be configured at the topic level to grant or restrict access to specific topics.