Incompatibility with "zii" #80

KyleMaas · 2021-02-08T19:41:00Z

Describe the bug
If the package "zii" is installed due to a dependency somewhere else in an npm project including js-multibase (in my case, from ipfs-repo-migrations from ipfs-core), this function:

js-multibase/src/index.js

Line 116 in c373031

function encoding (nameOrCode) {

...no longer works for types which use a code of "z". This happens in my case from here:

https://github.com/ipfs/js-ipfs-repo-migrations/blob/425d53c5f2ef2d89b11d2cfc33362d5ebfad81a5/migrations/migration-9/utils.js#L10

To Reproduce
Steps to reproduce the behavior:

npm install js-multibase
npm install zii
Require both so they are pulled into your project.
Try to decode "zQmdfTbBqBPQ7VNxZEYEj14VmRuZBkqFbiwReogJgS1zR1n"

Expected behavior
It decodes.

Actual behavior
I get this error: TypeError: enc.decode is not a function

Desktop (please complete the following information):

OS: Gentoo Linux
Browser: Chromium
Version: 87

The text was updated successfully, but these errors were encountered:

KyleMaas · 2021-02-08T20:42:29Z

I should note that this is where I'm trying to use this:

arj03/ssb-browser-demo#198

zii is pulled in a couple levels of dependencies down, so it's not an easy one for us to just patch out.

jacobheun · 2021-02-18T16:26:34Z

Where did you get the CID "zQmdfTbBqBPQ7VNxZEYEj14VmRuZBkqFbiwReogJgS1zR1n"? It's not valid. I think there may be some bad generation of the hashes in one of the dependencies that's incorrectly appending 'z' instead of properly processing it.

KyleMaas · 2021-02-18T16:52:47Z

That comes from this:

https://github.com/ipfs/js-ipfs-repo-migrations/blob/425d53c5f2ef2d89b11d2cfc33362d5ebfad81a5/migrations/migration-9/utils.js#L10

Which calls this:

https://github.com/multiformats/js-multihash/blob/e93d3a25c164d16c0c02d0747c68381f62d77930/src/index.js#L72

Which prepends a "z" and then tries to decode.

However, the problem happens before it even gets to the point where it would be valid or not. It comes from autodetection of encoding of hashes which start with a "z" trigger. If they start with the letter "z", this is true if zii is active:

js-multibase/src/index.js

Line 117 in c373031

if (constants.names[/** @type {BaseName} */(nameOrCode)]) {

So it returns from here:

js-multibase/src/index.js

Line 118 in c373031

return constants.names[/** @type {BaseName} */(nameOrCode)]

Instead of falling back to:

js-multibase/src/index.js

Line 119 in c373031

} else if (constants.codes[/** @type {BaseCode} */(nameOrCode)]) {

And returning from:

js-multibase/src/index.js

Line 120 in c373031

return constants.codes[/** @type {BaseCode} */(nameOrCode)]

It triggers the zii override gets because there is nothing in constants.names with the key "z". But because zii adds a prototype for that, the if() runs because the condition is true. If, instead, the checks are reversed and it checks for codes first (like in pull request #81), it does not conflict with zii because there is already a "z" key in codes.

All that to say...swapping those two fixes the conflict.

lidel · 2021-02-18T17:29:35Z

Well, this is the type of second-degree problems mutating Object prototype (what zii does) gets you into 🤷

IIUC we could accept a PR that protects our libs from this malevolence and adds additional check in:

js-multibase/src/index.js

Lines 116 to 122 in c373031

    
           function encoding (nameOrCode) { 
        
             if (constants.names[/** @type {BaseName} */(nameOrCode)]) { 
        
               return constants.names[/** @type {BaseName} */(nameOrCode)] 
        
             } else if (constants.codes[/** @type {BaseCode} */(nameOrCode)]) { 
        
               return constants.codes[/** @type {BaseCode} */(nameOrCode)] 
        
             } else { 
        
               throw new Error(`Unsupported encoding: ${nameOrCode}`)

Something like:

- if (constants.names[nameOrCode]) { 
+ if (constants.names[nameOrCode] && typeof constants.codes[nameOrCode] === 'string') {

Thoughts?

KyleMaas · 2021-02-18T17:32:37Z

Well, this is the type of second-degree problems mutating Object prototype (what zii does) gets you into

You'll hear no argument from me on that. But unfortunately, it's a dependency that's buried rather deep within other stuff. I do have an open issue filed with that project to try to eliminate zii, but they use it a lot, so it's probably going to be quite a while before that happens.

IIUC we could accept a PR that protects our libs from this malevolence and adds additional check in:

js-multibase/src/index.js

Lines 116 to 122 in c373031

function encoding (nameOrCode) {

if (constants.names[/** @type {BaseName} */(nameOrCode)]) {

return constants.names[/** @type {BaseName} */(nameOrCode)]

} else if (constants.codes[/** @type {BaseCode} */(nameOrCode)]) {

return constants.codes[/** @type {BaseCode} */(nameOrCode)]

} else {

throw new Error(`Unsupported encoding: ${nameOrCode}`)

Something like:
- if (constants.names[nameOrCode]) { 
+ if (constants.names[nameOrCode] && typeof constants.codes[nameOrCode] === 'string') {
Thoughts?

That should work. Or pull request #81, which I tested with zii to make sure it works.

KyleMaas · 2021-02-18T17:36:44Z

However it gets fixed, if you want to test it, all you have to do is npm install zii and add require("zii") to a source file, then run the test suite.

KyleMaas · 2021-02-18T19:49:43Z

Something like:

- if (constants.names[nameOrCode]) { 
+ if (constants.names[nameOrCode] && typeof constants.codes[nameOrCode] === 'string') {

Thoughts?

Turns out this didn't quite work. (a) It needs to check constants.names in the second part, and (b) the elements of that are instances of Base, so it needs to check for an object type. At any rate, I've submitted a working version (which I tested both with and without zii) as #82.

hugomrdias · 2021-02-23T18:18:28Z

damn i dont even know what to say @multiformats/javascript-team thoughts ?

rvagg · 2021-02-23T23:00:03Z

Well ... the correct response is to say that zii is a bad actor and is going to cause side-effects all over the place and you really need to reject it from your dependency tree as fast as you can as if it's a viral infection you need to treat.

But we could deal with it directly without too much pain though and won't feel like a hack because it's technically appropriate anyway:

diff --git a/src/index.js b/src/index.js
index df66bad..8bda372 100644
--- a/src/index.js
+++ b/src/index.js
@@ -114,9 +114,9 @@ function validEncode (name, buf) {
  * @throws {Error} Will throw if the encoding is not supported
  */
 function encoding (nameOrCode) {
-  if (constants.names[/** @type {BaseName} */(nameOrCode)]) {
+  if (constants.names.hasOwnProperty(/** @type {BaseName} */(nameOrCode))) {
     return constants.names[/** @type {BaseName} */(nameOrCode)]
-  } else if (constants.codes[/** @type {BaseCode} */(nameOrCode)]) {
+  } else if (constants.codes.hasOwnProperty(/** @type {BaseCode} */(nameOrCode))) {
     return constants.codes[/** @type {BaseCode} */(nameOrCode)]
   } else {
     throw new Error(`Unsupported encoding: ${nameOrCode}`)

(edit: the types are probably not going to be happy here, maybe good enough to just remove the type cast although I'm not sure what the flow-on effects will be)

KyleMaas · 2021-02-24T00:42:48Z

Well ... the correct response is to say that zii is a bad actor and is going to cause side-effects all over the place and you really need to reject it from your dependency tree as fast as you can as if it's a viral infection you need to treat.

But we could deal with it directly without too much pain though and won't feel like a hack because it's technically appropriate anyway:
diff --git a/src/index.js b/src/index.js
index df66bad..8bda372 100644
--- a/src/index.js
+++ b/src/index.js
@@ -114,9 +114,9 @@ function validEncode (name, buf) {
  * @throws {Error} Will throw if the encoding is not supported
  */
 function encoding (nameOrCode) {
-  if (constants.names[/** @type {BaseName} */(nameOrCode)]) {
+  if (constants.names.hasOwnProperty(/** @type {BaseName} */(nameOrCode))) {
     return constants.names[/** @type {BaseName} */(nameOrCode)]
-  } else if (constants.codes[/** @type {BaseCode} */(nameOrCode)]) {
+  } else if (constants.codes.hasOwnProperty(/** @type {BaseCode} */(nameOrCode))) {
     return constants.codes[/** @type {BaseCode} */(nameOrCode)]
   } else {
     throw new Error(`Unsupported encoding: ${nameOrCode}`)

I would agree with this sentiment, and have expressed such in the bug report for the project that pulls it in. But, it's a core package for JavaScript Scuttlebutt clients, so it's not like we can just drop it and it would be difficult for us to reimplement. So...it is what it is.

That change looks to me like it should work. I haven't tested it, but it looks like it would solve the problem.

hugomrdias · 2021-02-24T10:48:40Z

@rvagg thank you looks like a good compromise
@KyleMaas do you mind doing a PR with this diff ?

KyleMaas · 2021-02-24T12:48:21Z

@rvagg @hugomrdias See #84.

KyleMaas · 2021-02-26T16:55:18Z

Thank you for the help with this! Looking forward to trying to integrate IPFS into our application.

This was referenced Feb 8, 2021

Incompatibility with "zii" ipfs/js-ipfs-repo-migrations#61

Closed

Eliminate "zii" dependency ssbc/ssb-conn#26

Closed

IPFS for larger attachments arj03/ssb-browser-demo#198

Open

KyleMaas mentioned this issue Feb 16, 2021

Fix incompatibility with zii #81

Closed

KyleMaas mentioned this issue Feb 18, 2021

Another way of fixing zii incompatibility #82

Closed

KyleMaas mentioned this issue Feb 24, 2021

Fix incompatibility with zii via @rvagg's fix #84

Merged

hugomrdias closed this as completed in #84 Feb 26, 2021

This was referenced Feb 26, 2021

Bump js-multibase to 4.0.0 ipfs/js-ipfs-repo-migrations#68

Closed

Bump multibase to version 4.0.0 ipfs/js-ipfs#3574

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Incompatibility with "zii" #80

Incompatibility with "zii" #80

KyleMaas commented Feb 8, 2021 •

edited

Loading

KyleMaas commented Feb 8, 2021

jacobheun commented Feb 18, 2021 •

edited

Loading

KyleMaas commented Feb 18, 2021

lidel commented Feb 18, 2021 •

edited

Loading

KyleMaas commented Feb 18, 2021

KyleMaas commented Feb 18, 2021

KyleMaas commented Feb 18, 2021

hugomrdias commented Feb 23, 2021

rvagg commented Feb 23, 2021 •

edited

Loading

KyleMaas commented Feb 24, 2021

hugomrdias commented Feb 24, 2021

KyleMaas commented Feb 24, 2021

KyleMaas commented Feb 26, 2021

Incompatibility with "zii" #80

Incompatibility with "zii" #80

Comments

KyleMaas commented Feb 8, 2021 • edited Loading

KyleMaas commented Feb 8, 2021

jacobheun commented Feb 18, 2021 • edited Loading

KyleMaas commented Feb 18, 2021

lidel commented Feb 18, 2021 • edited Loading

KyleMaas commented Feb 18, 2021

KyleMaas commented Feb 18, 2021

KyleMaas commented Feb 18, 2021

hugomrdias commented Feb 23, 2021

rvagg commented Feb 23, 2021 • edited Loading

KyleMaas commented Feb 24, 2021

hugomrdias commented Feb 24, 2021

KyleMaas commented Feb 24, 2021

KyleMaas commented Feb 26, 2021

KyleMaas commented Feb 8, 2021 •

edited

Loading

jacobheun commented Feb 18, 2021 •

edited

Loading

lidel commented Feb 18, 2021 •

edited

Loading

rvagg commented Feb 23, 2021 •

edited

Loading