Connectors
DataLynxr connects to cloud object storage, streaming sources, and BI/orchestration tools. All connectors use your existing cloud credentials — no data leaves your environment.
Cloud Storage
DataLynxr reads and writes directly to your cloud object storage. No data copying or egress to DataLynxr infrastructure.
| Provider | Auth method | Formats supported |
|---|---|---|
| AWS S3 | IAM Role (recommended), access key/secret | Iceberg, Delta Lake, Apache Hudi, Parquet, ORC, CSV |
| Google Cloud Storage | Service Account JSON, Workload Identity | Iceberg, Delta Lake, Parquet, ORC, CSV |
| Azure ADLS Gen2 | Managed Identity, Service Principal + client secret | Iceberg, Delta Lake, Parquet, ORC, CSV |
Apache Kafka
Ingest from Kafka topics into Delta or Iceberg tables with exactly-once semantics using checkpointed offsets.
source:
type: kafka
brokers: kafka-broker:9092
topic: user-events
consumer_group: dlx-ingest-01
format: json # json | avro | protobuf
schema_registry: http://schema-registry:8081
sink:
type: delta
table: s3://my-lake/events/
checkpoint: s3://my-lake/_checkpoints/events/
merge_schema: true
AWS Kinesis
Ingest from Kinesis Data Streams into Delta tables. Uses the Enhanced Fan-Out consumer for sub-second latency.
source:
type: kinesis
stream_name: my-event-stream
region: us-east-1
enhanced_fan_out: true
dbt
Use dbt with DataLynxr's Trino-compatible endpoint. Install the dbt-trino adapter and point it at your DataLynxr workspace endpoint.
acme_lakehouse:
target: prod
outputs:
prod:
type: trino
host: acme-analytics.datalynxr.com
port: 8080
user: "{{ env_var('DLX_USER') }}"
password: "{{ env_var('DLX_TOKEN') }}"
database: iceberg
schema: prod
Apache Airflow
Use the TrinoOperator or TrinoHook in your Airflow DAGs to run SQL against DataLynxr. Set the connection type to Trino and enter your workspace credentials.
JDBC / ODBC
DataLynxr supports the Trino JDBC and ODBC drivers, compatible with Tableau, Power BI, DBeaver, and other BI tools. Download the driver from Trino's releases and configure the JDBC URL:
jdbc:trino://acme-analytics.datalynxr.com:8080/iceberg/prod