Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Some files on SMB share on a Server 2016 deduplicated volume are not accessible by NC #10228

Closed
soldier9945 opened this issue Jul 13, 2018 · 2 comments

Comments

@soldier9945
Copy link

Steps to reproduce

  1. Create a SMB share on a Server 2016 server and activate Data Deduplication on the volume where it resides
  2. Mount an SMB share in NC
  3. Browse to a file that is deduped* on the share's volume (note the file size is OK in NC)

*in Windows Explorer the "Size on Disk" of a deduped file is showing 0kb while the normal "Size" is the real file size also shown in NC

Expected behaviour

File should open / download

Actual behaviour

Preview of images states:
Error! Could not generage a preview of this file.
Please go to the next slide while we remove this image from the slideshow

On download of the image or other file types
(Apache2 is behind Reverse-Proxy IIS 10.0) Error 502 of the web server

(directly on Apache2) The server closed the connection without sending any data.

Server configuration

Operating system: Debian 9 (stretch)

Web server: Apache/2.4.25

Database: MariaDB 10.1.26

PHP version: PHP 7.0.27-0+deb9ul

Nextcloud version: 13.0.4

Updated from an older Nextcloud/ownCloud or fresh install: Database and file storage volume migrated from older Nextcloud 13.0.x

Where did you install Nextcloud from: Nextcloud.com/install

Signing status:

Signing status

No errors have been found.

List of activated apps:

App list

Enabled:

  • activity: 2.6.1
  • apporder: 0.4.1
  • bookmarks: 0.11.0
  • bruteforcesettings: 1.1.0
  • calendar: 1.6.1
  • comments: 1.3.0
  • contacts: 2.1.5
  • dav: 1.4.7
  • deck: 0.4.0
  • federatedfilesharing: 1.3.1
  • federation: 1.3.0
  • files: 1.8.0
  • files_external: 1.4.1
  • files_pdfviewer: 1.2.1
  • files_retention: 1.2.0
  • files_sharing: 1.5.0
  • files_texteditor: 2.5.1
  • files_trashbin: 1.3.0
  • files_versions: 1.6.0
  • files_videoplayer: 1.2.0
  • firstrunwizard: 2.2.1
  • gallery: 18.0.0
  • logreader: 2.0.0
  • lookup_server_connector: 1.1.0
  • nextcloud_announcements: 1.2.0
  • notes: 2.3.2
  • notifications: 2.1.2
  • oauth2: 1.1.1
  • ojsxc: 3.4.1
  • password_policy: 1.3.0
  • phonetrack: 0.2.8
  • previewgenerator: 1.0.9
  • provisioning_api: 1.3.0
  • rainloop: 5.1.0
  • serverinfo: 1.3.0
  • sharebymail: 1.3.0
  • spreed: 3.2.4
  • survey_client: 1.1.0
  • systemtags: 1.3.0
  • tasks: 0.9.6
  • theming: 1.4.5
  • twofactor_backupcodes: 1.2.3
  • updatenotification: 1.3.0
  • user_ldap: 1.3.1
  • workflowengine: 1.3.0
    Disabled:
  • admin_audit
  • encryption
  • passman
  • user_external

Nextcloud configuration:

Config report

system
{
"system": {
"instanceid": "REMOVED SENSITIVE VALUE",
"passwordsalt": "REMOVED SENSITIVE VALUE",
"secret": "REMOVED SENSITIVE VALUE",
"trusted_proxies": "REMOVED SENSITIVE VALUE",
"trusted_domains": [
"srvcloud",
"cloud.city17.ch",
"10.10.0.31"
],
"datadirectory": "REMOVED SENSITIVE VALUE",
"overwrite.cli.url": "https://cloud.city17.ch",
"overwritehost": "cloud.city17.ch",
"dbtype": "mysql",
"version": "13.0.4.0",
"dbname": "REMOVED SENSITIVE VALUE",
"dbhost": "REMOVED SENSITIVE VALUE",
"dbport": "",
"dbtableprefix": "oc_",
"dbuser": "REMOVED SENSITIVE VALUE",
"dbpassword": "REMOVED SENSITIVE VALUE",
"mail_smtpmode": "smtp",
"mail_from_address": "REMOVED SENSITIVE VALUE",
"mail_domain": "REMOVED SENSITIVE VALUE",
"mail_smtphost": "REMOVED SENSITIVE VALUE",
"mail_smtpport": "25",
"mail_smtpauthtype": "LOGIN",
"installed": true,
"ldapIgnoreNamingRules": false,
"ldapProviderFactory": "\OCA\User_LDAP\LDAPProviderFactory",
"theme": "",
"loglevel": 1,
"maintenance": false,
"data-fingerprint": "ad9f4b2451fc5fb3f824969418b49ffc"
}
}

Are you using external storage, if yes which one: SMB

Are you using encryption: No

Are you using an external user-backend, if yes which one: LDAP/ActiveDirectory

LDAP configuration (delete this part if not used)

LDAP config

+-------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Configuration | |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| hasMemberOfFilterSupport | 1 |
| hasPagedResultSupport | |
| homeFolderNamingRule | |
| lastJpegPhotoLookup | 0 |
| ldapAgentName | CN=Nextcloud Service,OU=Service Users,OU=CITY17,DC=city17,DC=local |
| ldapAgentPassword | *** |
| ldapAttributesForGroupSearch | |
| ldapAttributesForUserSearch | |
| ldapBackupHost | |
| ldapBackupPort | |
| ldapBase | OU=CITY17, DC=city17,DC=local |
| ldapBaseGroups | OU=CITY17, DC=city17,DC=local |
| ldapBaseUsers | OU=CITY17, DC=city17,DC=local |
| ldapCacheTTL | 600 |
| ldapConfigurationActive | 1 |
| ldapDefaultPPolicyDN | |
| ldapDynamicGroupMemberURL | |
| ldapEmailAttribute | mail |
| ldapExperiencedAdmin | 0 |
| ldapExpertUUIDGroupAttr | |
| ldapExpertUUIDUserAttr | |
| ldapExpertUsernameAttr | sAMAccountName |
| ldapGidNumber | gidNumber |
| ldapGroupDisplayName | cn |
| ldapGroupFilter | (&(|(objectclass=group))) |
| ldapGroupFilterGroups | |
| ldapGroupFilterMode | 0 |
| ldapGroupFilterObjectclass | group |
| ldapGroupMemberAssocAttr | member |
| ldapHost | srvdc.city17.local |
| ldapIgnoreNamingRules | |
| ldapLoginFilter | (&(&(|(objectclass=person))(|(|(memberof=CN=Sec_OwnCloud_ACCESS,OU=Groups,OU=CITY17,DC=city17,DC=local)(primaryGroupID=1617))))(|(samaccountname=%uid)(|(mailPrimaryAddress=%uid)(mail=%uid)))) |
| ldapLoginFilterAttributes | |
| ldapLoginFilterEmail | 1 |
| ldapLoginFilterMode | 0 |
| ldapLoginFilterUsername | 1 |
| ldapNestedGroups | 1 |
| ldapOverrideMainServer | |
| ldapPagingSize | 500 |
| ldapPort | 389 |
| ldapQuotaAttribute | |
| ldapQuotaDefault | |
| ldapTLS | 0 |
| ldapUserDisplayName | DisplayName |
| ldapUserDisplayName2 | |
| ldapUserFilter | (&(|(objectclass=person))(|(|(memberof=CN=Sec_OwnCloud_ACCESS,OU=Groups,OU=CITY17,DC=city17,DC=local)(primaryGroupID=1617)))) |
| ldapUserFilterGroups | Sec_OwnCloud_ACCESS |
| ldapUserFilterMode | 0 |
| ldapUserFilterObjectclass | person |
| ldapUuidGroupAttribute | auto |
| ldapUuidUserAttribute | auto |
| turnOffCertCheck | 0 |
| turnOnPasswordChange | 0 |
| useMemberOfToDetectMembership | 1 |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+

Client configuration

Browser: Any

Operating system: Any

Logs

Web server error log

Web server error log

[No error relating to this particular event, loglevel=0]

Nextcloud log (data/nextcloud.log)

Nextcloud log

[Fri Jul 13 09:44:33.895779 2018] [core:notice] [pid 551] AH00052: child pid 22073 exit signal Segmentation fault (11)

I can't seem to find the right logs here, help needed...

Browser log

Browser log

(Apache2 is behind Reverse-Proxy IIS 10.0) Failed to load resource: the server responded with a status of 502 ()

(directly on Apache2) The server closed the connection without sending any data.

@nextcloud-bot
Copy link
Member

GitMate.io thinks possibly related issues are #5340 (SMB File Share enumerating everything as folders), #5140 (Shared folders created in NC 11 no longer accessible in NC 12), #8810 (SMB share disconnects as soon as files are added to it on the backend), #2919 (Shared files no longer visible on NC 11 with encryption), and #2889 (NC 11 - Cannot share files with users after update).

@MorrisJobke
Copy link
Member

*in Windows Explorer the "Size on Disk" of a deduped file is showing 0kb while the normal "Size" is the real file size also shown in NC

That is super weird behavior and I guess the reason why it fails on our end. It thinks the file is 0 kb in size but receives a bigger one. The current workaround would be to use a filesystem that does de-duplication in a more transparent way. Showing the files as 0 kb in size is simply wrong here - even if true for the "storing part" of the filesystem.

AFAIK this needs to be additionally implemented in the files external app on our side. cc @icewind1991

As this sounds like a nice feature, the requests for this are quite low. Currently there a no plans to implement such a feature. Thus I will close this ticket for now. This does not mean we don't want this feature, but it is simply not on our roadmap for the near future. If somebody wants to implement this feature nevertheless we are happy to assist and help out.

If you wish to have this feature implemented by the Nextcloud GmbH there is the option for consulting work on top of your Nextcloud Enterprise subscription to get your features implemented.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants