Locally created entities removed from the server should eventually be removed locally

[seadowg]

Blocked by Open Rosa spec

Currently, entities that are deleted on the server, but that Collect has never seen in a server entity list will exist locally forever.

Acceptance

• Given I've created an entity locally
  And submitted the form that created it
  When the entity is deleted on the server
  And the entity list is then updated
  Then the entity does not still appear in follow-up forms
  And the entity doses not still appear in "View local entities"

• Collect should limit the number of UUIDs included when constructing the request to integrityUrl so that the request is 2000 characters or fewer (to avoid problems with URL length limits)

Notes

Collect will need a new endpoint in OpenRosa for this to work - Collect needs to ask the server if a local entity that does not appear in the entity list has been removed on the server or not. The current thinking is for that to be provided in the mediaFile for the entity list as integrityUrl like this:

<mediaFile type=”entityList”>
  <filename>people.csv</filename>
  <hash>md5:9fd39ac868eccdc0c134b3b7a6a25eb7</hash>
  <downloadUrl>http://other.appspot.com/blobSource?foo=222</downloadUrl>
  <integrityUrl>http://central.example.com/integrity</integrityUrl>
</mediaFile>

Collect would be able to make a request to this URL and pass entity IDs (like http://central.example.com/integrity?id=id1,id2) and that would respond with:

<?xml version='1.0' encoding='UTF-8' ?>
<entities>
  <entity>
    <id>id1</id>
    <deleted>true</deleted>
  </entity>
  <entity>
    <id>id2</id>
    <deleted>false</deleted>
  </entity>
</entities>

This URL end point isn't implemented yet, but because we'd only ever make the request if integrityUrl was present we can implement this as-is before the Central is finished.

[seadowg]

@lognaturel I'm moving this to v2024.4 for the moment as we've discussed that it should be ok to release it later.