Cloud storage auditing research is dedicated to solving the data integrity problem of outsourced storage on the cloud. In recent years, researchers have proposed various cloud storage auditing schemes using different techniques. While these work are elegant in theory, they assume an ideal cloud storage model, i.e., the cloud provides the storage and compute interfaces as required by the proposed schemes. However, this does not hold for mainstream cloud storage system because these systems only provide read and write interfaces,but not compute interface. To bridge this gap, this work proposes a serverless computing-based cloud storage auditing system for existing mainstream cloud object storage. The proposed system leverages exiting cloud storage auditing schemes as a basic building block. Leveraging the characteristics of serverless computing, the proposed system realizes economical, pay-as-you-go cloud storage auditing. The proposed system also supports mainstream cloud storage upper layer applications (e.g., file preview) by not modifying the data formats when embedding authentication tags for latter auditing. Experimental results show that the proposed scheme is efficient and promising for practical usage.
To better reveal the possibility of cloud storage auditing protocols becoming practical, we also designed a cost model to portray the economic performance. This work has been officially accepted by the SCIS , and more detailed content can be found in this online-published version.
In the implementation, we also provide a python script to compute the challenge length l that is used by PDP scheme.
We use java 1.8.0_202, tencentcloud-sdk-java 3.1.210 to develop this project and use IntelliJ IDEA and Maven to compile it. For more configuration details, please refer to pom.xml.
Please note that when packaging serverless cloud functions, you need to modify the configuration in pom.xml.
Firstly, please import this project into IntelliJ IDEA and it will automatically import all dependencies in pom.xml.
Secondly, you have to prepare the cloud-object-storage service and serverless cloud-function service in the Tencent Cloud or other cloud service provider.
Upload the packaged jar file to the serverless cloud function, select the API gateway as the trigger and configure accordingly. For the details of the configuration and use of cloud services, please refer to the Tencent Cloud documentation or the instructions of the cloud service provider you use.
Thus, we have prepared the basis for the operation of the system.
You can start the audit system in IDEA as follows:
- Replace the string "filePath" with your destination directory which stores the data that is to be outsourced.
- Replace the string "cosConfigFilePath" which provide the COS configuration, including secretId, ecretKey, regionName, bucketName.
- Replace the string "reqPath" which provide the request link to trigger the execution of the cloud function.
- Locate the class “com.fchen_group.TPDSInScf.Run.Benchmark”, which is the entrance of the whole program.
It is important to note that the serverless cloud function also need to obtain cloud storage configuration. Because hard-coding the key in the program is not secure, the most secure way is to read from the environment variable. However, there is a bug with the corresponding API. We have confirmed this bug with Tencent Cloud and gave feedback to them.
If you are used to compile the java program in the command line, you can compile the project by yourself. Then, you can execute the following command in the command line to start the system:
java -jar TPDSInSCF-1.0-SNAPSHOT_Benchmark-jar-with-dependencies.jarOne needs to specify the AUDIT_TASK_NUM, BLOCK_SHARDS and DATA_SHARDS after the program starts.
Please feel free to hack on our integrity checking system! We're happy to accept contributions.