Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

External sftp code and local config #72

Merged
merged 18 commits into from
Jul 1, 2024
Merged

External sftp code and local config #72

merged 18 commits into from
Jul 1, 2024

Conversation

jcrichlake
Copy link
Contributor

@jcrichlake jcrichlake commented Jun 28, 2024

External Partner SFTP and local config

We need to be able to connect to external SFTP clients and pull down files from them. This PR is the start of that work. It includes the code for retrieving data from an external SFTP server and copying it to our Azure storage container, plus config to enable local testing. We don't yet have credentials/info to set up connections to any customer's deployed environment.

Issue

SFTP issue

Checklist

  • I have added tests to cover my changes
  • I have added logging where useful (with appropriate log level)
  • I have added GoDocs where required
  • I have updated the documentation accordingly

Note: You may remove items that are not applicable

somesylvie and others added 13 commits June 21, 2024 15:49
…`copyfiles`; refactor some duplicate code; add placeholder env vars for SFTP; add placeholder calls to SFTP code

Co-Authored-By: pluckyswan <96704946+pluckyswan@users.noreply.github.com>
Co-Authored-By: halprin <halprin@users.noreply.github.com>
Co-Authored-By: jcrichlake <145698165+jcrichlake@users.noreply.github.com>
… with folder structure

Co-Authored-By: pluckyswan <96704946+pluckyswan@users.noreply.github.com>
Co-Authored-By: halprin <halprin@users.noreply.github.com>
Co-Authored-By: jcrichlake <145698165+jcrichlake@users.noreply.github.com>
Co-Authored-By: jherrflexion <118225331+jherrflexion@users.noreply.github.com>
Co-Authored-By: halprin <halprin@users.noreply.github.com>
Co-Authored-By: jcrichlake <145698165+jcrichlake@users.noreply.github.com>
Co-Authored-By: halprin <halprin@users.noreply.github.com>
Co-Authored-By: jcrichlake <145698165+jcrichlake@users.noreply.github.com>
Co-Authored-By: pluckyswan <96704946+pluckyswan@users.noreply.github.com>
Co-Authored-By: pluckyswan <96704946+pluckyswan@users.noreply.github.com>
Co-Authored-By: pluckyswan <96704946+pluckyswan@users.noreply.github.com>
Co-authored-by: Sylvie <sschuresko@flexion.us>
Co-authored-by: Rajeev Ranjan <rranjan@flexion.us>
Co-authored-by: jcrichlake <145698165+jcrichlake@users.noreply.github.com>
Co-authored-by: pluckyswan <96704946+pluckyswan@users.noreply.github.com>
Co-authored-by: saquino0827 <saquino@flexion.us>
Co-authored-by: James Herr <jherr@flexion.us>
somesylvie and others added 3 commits June 28, 2024 13:00
Co-Authored-By: pluckyswan <96704946+pluckyswan@users.noreply.github.com>
Co-Authored-By: jcrichlake <145698165+jcrichlake@users.noreply.github.com>
Co-Authored-By: pluckyswan <96704946+pluckyswan@users.noreply.github.com>
Co-Authored-By: jcrichlake <145698165+jcrichlake@users.noreply.github.com>
Co-Authored-By: Samuel Aquino <saquino@flexion.us>
Co-Authored-By: pluckyswan <96704946+pluckyswan@users.noreply.github.com>
@somesylvie somesylvie changed the title External sftp External sftp code and local config Jun 28, 2024
@somesylvie somesylvie marked this pull request as ready for review June 28, 2024 21:56
@@ -3,7 +3,7 @@ set -e

pushd ./src/ || exit

THRESHOLD=50
THRESHOLD=65
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we know what threshold we eventually want to reach? Is it the same as TI app?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We don't have a specific number in mind. It will depend on how much code we have that is just pointing to an external library that we wouldn't want to test.

somesylvie and others added 2 commits July 1, 2024 10:56
Co-Authored-By: pluckyswan <96704946+pluckyswan@users.noreply.github.com>
Co-Authored-By: Samuel Aquino <saquino@flexion.us>
Co-Authored-By: jcrichlake <145698165+jcrichlake@users.noreply.github.com>
Co-Authored-By: jherrflexion <118225331+jherrflexion@users.noreply.github.com>
Copy link

sonarcloud bot commented Jul 1, 2024

@somesylvie somesylvie merged commit 55b72bd into main Jul 1, 2024
13 checks passed
@somesylvie somesylvie deleted the external-sftp branch July 1, 2024 21:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants