Real-time SQL Server Change Data Capture (CDC)
Microsoft SQL Server is a powerful, widely used relational database management system. Today, we’re releasing a public beta version of our Microsoft SQL Server as a source for real-time data streams.
As a source, you can build pipelines that act on changes from SQL Server. For example, you can:
- Extract Transform Load (ETL) into a Data Warehouse.
- Real-time replication and sync to other data stores.
With Meroxa, it’s all streaming, real-time, and your pipelines will be up and running in minutes not months.
Getting Started
To begin sending data to SQL Server, perform the following steps:
- Create an Account — By using the dashboard, or the CLI.
- Setup —Configure your Microsoft SQL Server instance and acquire the credentials needed to talk to Meroxa.
- Add Resource — Use the dashboard or
meroxa resource create
command to add to your Meroxa Resource Catalog.
SQL Server Source Connector
As a source, you can capture changes from SQL Server and send to Amazon Redshift, Webhooks, Amazon S3 or any other destination.
The SQL Server source is a CDC connector that leverages SQL Server transaction log, which contains a list of every change events. This connector will perform an initial snapshot of the data. Then, it will stream every INSERT
, UPDATE
, DELETE
operation and push the events into a Meroxa stream.
This connector will emit data records in the following format:
![](https://miro.medium.com/max/1400/1*3UPlW3iDFuihoKqr2p6nOw.png)
To create a source, you can use the dashboard or meroxa resource create
command to create a new connector:
meroxa resource create mysqlserver \
--type sqlserver \
--url "sqlserver://$MSSQL_USER:$MSSQL_PASS@$MSSQL_URL:$MSSQL_PORT/$MSSQL_DB"
For more, see Microsoft SQL Server Documentation.
I can’t wait to see what you build 🚀
The SQL Server connector is currently in beta. We encourage customers to start using the connector in their staging and development environments and provide feedback. Following the beta phase, we will make the connector generally available for use in all environments (dev, staging, and production). Meroxa follows this pattern for all connectors that it releases to ensure a great experience for you.
As always,
- If you need help, reach out to support@meroxa.io
- Join our Discord community.
- Follow us on Twitter.