Presto Excel Connector

This connector allows Presto to query data stored in Excel files from local or SFTP storage.

Currently, the connector supports select on the first sheets of .xls, .xlsx files.

Compile

Download the source code of Presto from GitHub, copy presto-excel into it, and add the following line to pom.xml under the root module:

<module>presto-excel</module>

Configuration

Create a catalog properties file etc/catalog/excel.properties. To read files from local drives, add something like this:

connector.name=excel
excel.protocol=file
excel.base=/path/to/dir

excel.base sets the root directory. The schema name is the second level directory, and table name is the Excel filename.

The connector also supports reading files from a SFTP server.

connector.name=excel
excel.protocol=sftp
excel.base=/path/to/dir
excel.host=xxx.xxx.xxx.xxx
excel.port=xxx
excel.username=xxx
excel.password=xxx

Excel Connector uses Excel Streaming Reader to load large .xlsx files. rowCacheSize and bufferSize can be adjusted in the configuration file, and the default values are 100 and 4096.

excel.xlsx-row-cache-size=100   # number of rows to keep in memory
excel.xlsx-buffer-size=4096     # buffer size to use when reading InputStream to file

Known issues

Presto does not support case-sensitive identifiers (see this issue). The connector cannot recognize the file that has uppercase letters in its path either.

TODO

• Support multiple sheets.

• Support HDFS, HTTP Server, etc.

---

Presto Excel connector，目前支持查询本地或 SFTP 服务器上的 .xls、.xlsx 文件的单张 sheet。

编译

从 GitHub 获取 Presto 源码，在根目录的 pom.xml 中添加模块：

<module>presto-excel</module>

配置

创建配置文件 etc/catalog/excel.properties。读取本地文件的配置如下：

connector.name=excel
excel.protocol=file
excel.base=/path/to/directory

excel.base 为根目录，schema 名称对应第二级目录，table 名称对应 Excel 文件名（不包含后缀）。

也可以从 SFTP 服务器读取文件：

connector.name=excel
excel.protocol=sftp
excel.base=/path/to/directory
excel.host=xxx.xxx.xxx.xxx
excel.port=xxx
excel.username=xxx
excel.password=xxx

连接器使用了 Excel Streaming Reader 实现大文件的读取，读取时使用的 rowCacheSize 和 bufferSize 可以在配置文件中调整，默认值为 100 和 4096。

excel.xlsx-row-cache-size=100   # number of rows to keep in memory
excel.xlsx-buffer-size=4096     # buffer size to use when reading InputStream to file

已知问题

Presto 不支持大写表名（见 这个 issue），该连接器也不支持读取路径中包含大写字母的文件。

TODO

• 支持多张工作表。

• 支持 HDFS、HTTP 等协议。