Skip to content

Commit f7828fd

Browse files
authored
Merge pull request #13 from databrickslabs/feature/update_readme
Minor fixes to README
2 parents feae990 + bbe16fe commit f7828fd

1 file changed

Lines changed: 8 additions & 7 deletions

File tree

‎README.md‎

Lines changed: 8 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -1,16 +1,17 @@
11
# Delta Sharing Java Connector
22
<img src="docs/source/images/delta-sharing-java-logo.png" alt="drawing" style="width:50px; float: left;"/>
3-
<img src="https://github.com/GIScience/badges/raw/master/status/experimental.svg" alt="drawing" style="width:140px; margin-top:15px; float: left;"/>
4-
<br>
5-
<br>
63

7-
A java connector for [delta-sharing](https://delta.io/sharing/) that allows you to easily ingest data on any JVM.
4+
![experimental](https://github.com/GIScience/badges/raw/master/status/experimental.svg)
5+
[![build](https://github.com/databrickslabs/delta-sharing-java-connector/actions/workflows/build.yml/badge.svg)](https://github.com/databrickslabs/delta-sharing-java-connector/actions/workflows/build.yml)
6+
[![docs](https://github.com/databrickslabs/delta-sharing-java-connector/actions/workflows/docs.yml/badge.svg)](https://github.com/databrickslabs/delta-sharing-java-connector/actions/workflows/docs.yml)
87

9-
![Design](docs/source/images/high-level-design.png)
8+
A Java connector for [Delta Sharing](https://delta.io/sharing/) that allows you to easily ingest data on any JVM.
109

10+
![Design](docs/source/images/high-level-design.png)
1111

1212
## Project Description
13-
This project brings delta-sharing capabilities to java.
13+
This project brings Delta Sharing capabilities to Java.
14+
1415
The Java connector follows the Delta Sharing protocol to read shared tables from a Delta Sharing Server. To further reduce and limit egress costs on the Data Provider side, we implemented a persistent cache to reduce and limit the egress costs on the Data Provider side by removing any unnecessary reads.
1516

1617
- The data is served to the connector via persisted cache to limit the egress costs whenever possible.
@@ -19,7 +20,7 @@ The Java connector follows the Delta Sharing protocol to read shared tables from
1920
- Data records are provided as a set of Avro GenericRecords that provide a good balance between the flexibility of representation and integrational capabilities. GenericRecords can easily be exported to JSON and/or other formats using EncoderFactory in Avro.
2021

2122
- Every time the data access is requested the connector will check for the metadata updates and refresh the table data in case of any metadata changes.
22-
- The connector requests the metadata for the table based on its coordinate from the provider. The table coordinate is the profile file path following with `#` and the fully qualified name of a table (<share-name>.<schema-name>.<table-name>)
23+
- The connector requests the metadata for the table based on its coordinate from the provider. The table coordinate is the profile file path following with `#` and the fully qualified name of a table (`<share-name>.<schema-name>.<table-name>`)
2324
- A lookup of table to metadata is maintained inside the JVM. The connector then compares the received metadata with the last metadata snapshot. If there is no change, then the existing table data is served from cache. Otherwise, the connector will refresh the table data in the cache.
2425

2526
- When the metadata changes are detected both the data and the metadata will be updated.

0 commit comments

Comments
 (0)