Skip to content

Commit

Permalink
Release Databricks (mode: delta_lake) as Release Candidate (#670)
Browse files Browse the repository at this point in the history
  • Loading branch information
@Sevenannn
Sevenannn authored Dec 6, 2024
1 parent 3f16821 commit 48291e5
Showing 1 changed file with 27 additions and 25 deletions.
52 changes: 27 additions & 25 deletions spiceaidocs/docs/components/data-connectors/index.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -11,31 +11,33 @@ Data Connectors provide connections to databases, data warehouses, and data lake

Currently supported Data Connectors include:

| Name | Description | Status | Protocol/Format | Refresh Modes | Supports [Ingestion][ingestion] | Supports Documents |
| --------------- | ------------------------- | ----------------- | ----------------------------------- | --------------------------- | ------------------------------- | ------------------ |
| `duckdb` | DuckDB | Release Candidate | | `append`, `full` | ❌ | ❌ |
| `github` | GitHub | Release Candidate | GraphQL, REST | `append`, `full` | ❌ | ❌ |
| `mysql` | MySQL | Release Candidate | | `append`, `full` | Roadmap | ❌ |
| `postgres` | PostgreSQL | Release Candidate | | `append`, `full` | Roadmap | ❌ |
| `s3` | S3 | Release Candidate | Parquet, CSV | `append`, `full` | Roadmap | ✅ |
| `databricks` | Databricks | Beta | Spark Connect <br/> S3 / Delta Lake | `append`, `full` | Roadmap | ❌ |
| `delta_lake` | Delta Lake | Beta | Delta Lake | `append`, `full` | Roadmap | ❌ |
| `file` | File | Beta | Parquet, CSV | `append`, `full` | Roadmap | ✅ |
| `flightsql` | FlightSQL | Beta | Arrow Flight SQL | `append`, `full` | ❌ | ❌ |
| `odbc` | ODBC | Beta | | `append`, `full` | ❌ | ❌ |
| `spiceai` | Spice.ai | Beta | Arrow Flight | `append`, `full` | ✅ | ❌ |
| `abfs` | Azure BlobFS | Alpha | Parquet, CSV | `append`, `full` | Roadmap | ✅ |
| `clickhouse` | Clickhouse | Alpha | | `append`, `full` | ❌ | ❌ |
| `debezium` | Debezium | Alpha | CDC, Kafka | `append`, `full`, `changes` | ❌ | ❌ |
| `dremio` | Dremio | Alpha | Arrow Flight SQL | `append`, `full` | ❌ | ❌ |
| `ftp`, `sftp` | FTP/SFTP | Alpha | Parquet, CSV | `append`, `full` | ❌ | ✅ |
| `graphql` | GraphQL | Alpha | GraphQL | `append`, `full` | ❌ | ❌ |
| `http`, `https` | HTTP(s) | Alpha | Parquet, CSV | `append`, `full` | ❌ | ❌ |
| `localpod` | Local dataset replication | Alpha | | `append`, `full` | ❌ | ✅ |
| `mssql` | MS SQL Server | Alpha | Tabular Data Stream (TDS) | `append`, `full` | ❌ | ❌ |
| `sharepoint` | SharePoint | Alpha | | `append`, `full` | ❌ | ✅ |
| `snowflake` | Snowflake | Alpha | Arrow | `append`, `full` | Roadmap | ❌ |
| `spark` | Spark | Alpha | Spark Connect | `append`, `full` | ❌ | ❌ |
| Name | Description | Status | Protocol/Format | Refresh Modes | Supports [Ingestion][ingestion] | Supports Documents |
| ---------------------------------- | ------------------------- | ----------------- | ------------------------- | --------------------------- | ------------------------------- | ------------------ |
| `duckdb` | DuckDB | Release Candidate | | `append`, `full` | ❌ | ❌ |
| `github` | GitHub | Release Candidate | GraphQL, REST | `append`, `full` | ❌ | ❌ |
| `mysql` | MySQL | Release Candidate | | `append`, `full` | Roadmap | ❌ |
| `postgres` | PostgreSQL | Release Candidate | | `append`, `full` | Roadmap | ❌ |
| `s3` | S3 | Release Candidate | Parquet, CSV | `append`, `full` | Roadmap | ✅ |
| `databricks (mode: delta_lake)` | Databricks | Release Candidate | S3 / Delta Lake | `append`, `full` | Roadmap | ❌ |
| `databricks (mode: spark_connect)` | Databricks | Beta | Spark Connect | `append`, `full` | Roadmap | ❌ |
| `file` | File | Beta | Parquet, CSV | `append`, `full` | Roadmap | ✅ |
| `delta_lake` | Delta Lake | Beta | Delta Lake | `append`, `full` | Roadmap | ❌ |
| `flightsql` | FlightSQL | Beta | Arrow Flight SQL | `append`, `full` | ❌ | ❌ |
| `odbc` | ODBC | Beta | | `append`, `full` | ❌ | ❌ |
| `spiceai` | Spice.ai | Beta | Arrow Flight | `append`, `full` | ✅ | ❌ |
| `abfs` | Azure BlobFS | Alpha | Parquet, CSV | `append`, `full` | Roadmap | ✅ |
| `clickhouse` | Clickhouse | Alpha | | `append`, `full` | ❌ | ❌ |
| `debezium` | Debezium | Alpha | CDC, Kafka | `append`, `full`, `changes` | ❌ | ❌ |
| `dremio` | Dremio | Alpha | Arrow Flight SQL | `append`, `full` | ❌ | ❌ |
| `file` | File | Alpha | Parquet, CSV | `append`, `full` | Roadmap | ✅ |
| `ftp`, `sftp` | FTP/SFTP | Alpha | Parquet, CSV | `append`, `full` | ❌ | ✅ |
| `graphql` | GraphQL | Alpha | GraphQL | `append`, `full` | ❌ | ❌ |
| `http`, `https` | HTTP(s) | Alpha | Parquet, CSV | `append`, `full` | ❌ | ❌ |
| `localpod` | Local dataset replication | Alpha | | `append`, `full` | ❌ | ✅ |
| `mssql` | MS SQL Server | Alpha | Tabular Data Stream (TDS) | `append`, `full` | ❌ | ❌ |
| `sharepoint` | SharePoint | Alpha | | `append`, `full` | ❌ | ✅ |
| `snowflake` | Snowflake | Alpha | Arrow | `append`, `full` | Roadmap | ❌ |
| `spark` | Spark | Alpha | Spark Connect | `append`, `full` | ❌ | ❌ |

[ingestion]: https://docs.spiceai.org/features/data-ingestion

Expand Down

0 comments on commit 48291e5

Please sign in to comment.