Skip to content
This repository has been archived by the owner on Jan 18, 2021. It is now read-only.

Reva ocis storage #466

Merged
merged 39 commits into from
Sep 11, 2020
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
39 commits
Select commit Hold shift + click to select a range
4cd95c2
Use reva ocis-driver branch
Sep 10, 2020
d43860b
run API tests also on ocis storage
individual-it Sep 10, 2020
808701c
expected failures on ocis-storage file
individual-it Sep 10, 2020
1d31f4d
run local API tests with multiple storages
individual-it Sep 10, 2020
3f7f8ee
use correct function to upper string
individual-it Sep 10, 2020
cd22d1d
use owncloud as storage name
individual-it Sep 10, 2020
dddc0ce
rename expected-failures on OC storage file
individual-it Sep 10, 2020
c826b04
fix behat filter tags
individual-it Sep 10, 2020
a3d3f5f
skip tests on OCIS storage that are skipped on OC storage
individual-it Sep 10, 2020
6e295fe
set skeleton and userdeletion
individual-it Sep 10, 2020
efe5e95
Switch to ocis-sharing branch in butonic's reva
Sep 10, 2020
7b3bb22
set dataroot and use delete command to delete user data
individual-it Sep 10, 2020
c4af223
fix config name
individual-it Sep 10, 2020
127d630
Update to latest butonic ocis-sharing branch
Sep 10, 2020
da48317
create /srv/app/tmp/ocis/root/
individual-it Sep 10, 2020
a69c4ba
delete only inside nodes
individual-it Sep 10, 2020
f18a95e
delete only inside nodes 2
individual-it Sep 10, 2020
c718f56
skip local tests on OCIS storage
individual-it Sep 11, 2020
aa858d8
skip failing oc10 API tests
individual-it Sep 11, 2020
48033e8
skip some newly enabled tests
individual-it Sep 11, 2020
040ac2b
delete only content of nodes/root
individual-it Sep 11, 2020
2126201
only delete inside root folder, for local tests
individual-it Sep 11, 2020
004d6b7
enable oc10 tests that started to pass
individual-it Sep 11, 2020
c5bb430
Revert "skip local tests on OCIS storage"
individual-it Sep 11, 2020
b501e73
skip only those local tests that fail
individual-it Sep 11, 2020
f75a252
skip only those local tests that fail 2
individual-it Sep 11, 2020
385cb93
more adjustments to expected failures!
individual-it Sep 11, 2020
7f7c330
split tests in 4 parts
individual-it Sep 11, 2020
3365c00
better naming of steps
individual-it Sep 11, 2020
dfeec1d
Update reva to butonic ocis-sharing branch
Sep 11, 2020
0f99853
delete passing tests from expected failures list in OCIS
individual-it Sep 11, 2020
c35527c
rearange expected failures on OCIS storage to reduce diff with expect…
individual-it Sep 11, 2020
0f46323
skip some tests that fail because of test infra issues
individual-it Sep 11, 2020
c20a27d
more favorite and version tests are passing
individual-it Sep 11, 2020
668e45b
deleting not existing test suite
individual-it Sep 11, 2020
c1a4978
fix comments
individual-it Sep 11, 2020
cb4e972
get rid of not existing tests
individual-it Sep 11, 2020
05e0300
Update reva to v1.2.1-0.20200911111727-51649e37df2d
Sep 11, 2020
111992b
Add OCIS storage expected failures for dav properties
Sep 11, 2020
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
42 changes: 26 additions & 16 deletions .drone.star
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@ config = {
'apiTests': {
'coreBranch': 'master',
'coreCommit': '65ee49ae5dad3af84aa781b98e805fe463baf9fe',
'numberOfParts': 2
'numberOfParts': 4
}
}

Expand Down Expand Up @@ -31,39 +31,42 @@ def main(ctx):
def testPipelines(ctx):
pipelines = [
testing(ctx),
localApiTestsOcStorage(ctx, config['apiTests']['coreBranch'], config['apiTests']['coreCommit'])
localApiTests(ctx, config['apiTests']['coreBranch'], config['apiTests']['coreCommit'], 'owncloud'),
localApiTests(ctx, config['apiTests']['coreBranch'], config['apiTests']['coreCommit'], 'ocis')
]

for runPart in range(1, config['apiTests']['numberOfParts'] + 1):
pipelines.append(coreApiTests(ctx, config['apiTests']['coreBranch'], config['apiTests']['coreCommit'], runPart, config['apiTests']['numberOfParts']))
pipelines.append(coreApiTests(ctx, config['apiTests']['coreBranch'], config['apiTests']['coreCommit'], runPart, config['apiTests']['numberOfParts'], 'owncloud'))
pipelines.append(coreApiTests(ctx, config['apiTests']['coreBranch'], config['apiTests']['coreCommit'], runPart, config['apiTests']['numberOfParts'], 'ocis'))

return pipelines

def localApiTestsOcStorage(ctx, coreBranch = 'master', coreCommit = ''):
def localApiTests(ctx, coreBranch = 'master', coreCommit = '', storage = 'owncloud'):
return {
'kind': 'pipeline',
'type': 'docker',
'name': 'localApiTestsOcStorage',
'name': 'localApiTests-%s-storage' % (storage),
'platform': {
'os': 'linux',
'arch': 'amd64',
},
'steps':
build() +
revaServer() +
revaServer(storage) +
cloneCoreRepos(coreBranch, coreCommit) + [
{
'name': 'localApiTestsOcStorage',
'name': 'localApiTests-%s-storage' % (storage),
'image': 'owncloudci/php:7.2',
'pull': 'always',
'environment' : {
'TEST_SERVER_URL': 'http://reva-server:9140',
'OCIS_REVA_DATA_ROOT': '/srv/app/tmp/reva/',
'OCIS_REVA_DATA_ROOT': '%s' % ('/srv/app/tmp/reva/' if storage == 'owncloud' else ''),
'DELETE_USER_DATA_CMD': '%s' % ('rm -rf /srv/app/tmp/reva/data/*' if storage == 'owncloud' else 'rm -rf /srv/app/tmp/ocis/root/nodes/root/*'),
'SKELETON_DIR': '/srv/app/tmp/testing/data/apiSkeleton',
'TEST_EXTERNAL_USER_BACKENDS':'true',
'REVA_LDAP_HOSTNAME':'ldap',
'TEST_OCIS':'true',
'BEHAT_FILTER_TAGS': '~@skipOnOcis-OC-Storage',
'BEHAT_FILTER_TAGS': '~@skipOnOcis-%s-Storage' % ('OC' if storage == 'owncloud' else 'OCIS'),
'PATH_TO_CORE': '/srv/app/testrunner'
},
'commands': [
Expand Down Expand Up @@ -95,34 +98,35 @@ def localApiTestsOcStorage(ctx, coreBranch = 'master', coreCommit = ''):
},
}

def coreApiTests(ctx, coreBranch = 'master', coreCommit = '', part_number = 1, number_of_parts = 1):
def coreApiTests(ctx, coreBranch = 'master', coreCommit = '', part_number = 1, number_of_parts = 1, storage = 'owncloud'):
return {
'kind': 'pipeline',
'type': 'docker',
'name': 'Core-API-Tests-%s' % (part_number),
'name': 'Core-API-Tests-%s-storage-%s' % (storage, part_number),
'platform': {
'os': 'linux',
'arch': 'amd64',
},
'steps':
build() +
revaServer() +
revaServer(storage) +
cloneCoreRepos(coreBranch, coreCommit) + [
{
'name': 'oC10ApiTests-%s' % (part_number),
'name': 'oC10ApiTests-%s-storage-%s' % (storage, part_number),
'image': 'owncloudci/php:7.2',
'pull': 'always',
'environment' : {
'TEST_SERVER_URL': 'http://reva-server:9140',
'OCIS_REVA_DATA_ROOT': '/srv/app/tmp/reva/',
'OCIS_REVA_DATA_ROOT': '%s' % ('/srv/app/tmp/reva/' if storage == 'owncloud' else ''),
'DELETE_USER_DATA_CMD': '%s' % ('rm -rf /srv/app/tmp/reva/data/*' if storage == 'owncloud' else 'rm -rf /srv/app/tmp/ocis/root/nodes/root/*'),
'SKELETON_DIR': '/srv/app/tmp/testing/data/apiSkeleton',
'TEST_EXTERNAL_USER_BACKENDS':'true',
'REVA_LDAP_HOSTNAME':'ldap',
'TEST_OCIS':'true',
'BEHAT_FILTER_TAGS': '~@notToImplementOnOCIS&&~@toImplementOnOCIS&&~comments-app-required&&~@federation-app-required&&~@notifications-app-required&&~systemtags-app-required&&~@provisioning_api-app-required&&~@preview-extension-required&&~@local_storage',
'DIVIDE_INTO_NUM_PARTS': number_of_parts,
'RUN_PART': part_number,
'EXPECTED_FAILURES_FILE': '/drone/src/tests/acceptance/expected-failures-on-OC-storage.txt'
'EXPECTED_FAILURES_FILE': '/drone/src/tests/acceptance/expected-failures-on-%s-storage.txt' % (storage.upper())
},
'commands': [
'cd /srv/app/testrunner',
Expand Down Expand Up @@ -945,7 +949,7 @@ def build():
}
]

def revaServer():
def revaServer(storage):
return [
{
'name': 'reva-server',
Expand All @@ -959,7 +963,12 @@ def revaServer():
'REVA_LDAP_BIND_PASSWORD': 'admin',
'REVA_LDAP_BASE_DN': 'dc=owncloud,dc=com',
'REVA_LDAP_SCHEMA_UID': 'uid',
'REVA_STORAGE_HOME_DRIVER': '%s' % (storage),
'REVA_STORAGE_HOME_DATA_DRIVER': '%s' % (storage),
'REVA_STORAGE_OC_DRIVER': '%s' % (storage),
'REVA_STORAGE_OC_DATA_DRIVER': '%s' % (storage),
'REVA_STORAGE_HOME_DATA_TEMP_FOLDER': '/srv/app/tmp/',
'REVA_STORAGE_OCIS_ROOT': '/srv/app/tmp/ocis/root',
'REVA_STORAGE_OWNCLOUD_DATADIR': '/srv/app/tmp/reva/data',
'REVA_STORAGE_OC_DATA_TEMP_FOLDER': '/srv/app/tmp/',
'REVA_STORAGE_OC_DATA_SERVER_URL': 'http://reva-server:9164/data',
Expand All @@ -972,6 +981,7 @@ def revaServer():
'commands': [
'apk add mailcap',
'mkdir -p /srv/app/tmp/reva',
'mkdir -p /srv/app/tmp/ocis/root/nodes',
'bin/ocis-reva --log-level debug --log-pretty gateway &',
'bin/ocis-reva --log-level debug --log-pretty users &',
'bin/ocis-reva --log-level debug --log-pretty auth-basic &',
Expand Down
10 changes: 10 additions & 0 deletions changelog/unreleased/update-reva-to-20200911.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
Enhancement: update reva to v1.2.1-0.20200911111727-51649e37df2d

- Update reva to v1.2.1-0.20200911111727-51649e37df2d
- Added new OCIS storage driver ocis [(reva/#1155)](https://github.com/cs3org/reva/pull/1155)
- App provider: fallback to env. variable if 'iopsecret' unset [(reva/#1146)](https://github.com/cs3org/reva/pull/1146)
- Add switch to database [(reva/#1135)](https://github.com/cs3org/reva/pull/1135)
- Add the ocdav HTTP svc to the standalone config [(reva/#1128)](https://github.com/cs3org/reva/pull/1128)

https://github.com/owncloud/ocis-reva/pull/466

2 changes: 1 addition & 1 deletion go.mod
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ module github.com/owncloud/ocis-reva
go 1.13

require (
github.com/cs3org/reva v1.2.1-0.20200826162318-c0f54e1f37ea
github.com/cs3org/reva v1.2.1-0.20200911111727-51649e37df2d
github.com/gofrs/uuid v3.3.0+incompatible
github.com/gopherjs/gopherjs v0.0.0-20181103185306-d547d1d9531e // indirect
github.com/micro/cli/v2 v2.1.1
Expand Down
Loading