Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Updates before splitting the observation table #286

Merged
merged 63 commits into from
Feb 13, 2023
Merged

Conversation

peterdesmet
Copy link
Member

@peterdesmet peterdesmet commented Feb 10, 2023

This PR addresses all issues that can be tackled before splitting the observation table in two. It fixes the issues below. This PR should only be accepted when all included PRs are merged (checkboxes below).

General

First step in restructuring

Classification method

Camera setup

Other term updates

Website

danstowell and others added 30 commits April 8, 2022 08:17
- Remove `observations.deploymentID` from schema and example
- Remove `observations.timestamp` from schema and example
- Remove `observations.mediaID` from schema and example
- Rename `media.sequenceID` to `media.eventID` in schema and example
- Rename `observations.sequenceID` to `observations.eventID` in schema and example
Fix #200. It remains a broadMatch, since the Camtrap DP concept is narrower.
- Allowed roles: contact, principal investigator, rightsholder, publisher, contributor
- Update roles in example
- Include one contributor without role
- Repeat INBO as rightsholder

Fix #267
Rename classificationConfidence to classificationProbability, and note that it's usually omitted for human classifications
The validate_example_current_schema.py test verbosely included the table schemas, which will fail validation that is trying to prevent that.

1. Define all variables in helpers.py (only)

2. validate_profile_and_schemas.py:
- make use of new variables

3. validate_example_versioned_schema.py:
- document script
- make use of new variables

4. validate_example_current_schema.py
- document script
- make use of new variables
- match resource with table schema using table_schema.name.split("-")[0]) e.g. media-table-schema.json -> media
- link to table schema rather than verbosely including it
Validation never reached that point, because schema is interpreted as a string and properties (incl. "name") are therefore moot
Adding custom tables is possible as long as these don't use the Camtrap DP reserved table names

- Also require Camtrap DP tables to be files (path, not data)
Makes it clearer that this can accept multiple values. Fix #227
Discussed with @baskaufs ac:tag is not specifically about media files, but provides a general description. So the AC term is not narrower than the Camtrap DP term. See #288
Suggested by @gtucobtuco in #288
Allow more (custom) tables + update tests
Add example page to dataset + include media-based observations in example dataset
@peterdesmet peterdesmet merged commit 7561232 into 0.6 Feb 13, 2023
@peterdesmet peterdesmet deleted the term-updates branch February 13, 2023 10:32
@peterdesmet peterdesmet mentioned this pull request Feb 23, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
No open projects
Development

Successfully merging this pull request may close these issues.

4 participants