This repository has been archived by the owner on Feb 1, 2022. It is now read-only.
-
Notifications
You must be signed in to change notification settings - Fork 0
Created Workers #3
Draft
Icebearbear
wants to merge
8
commits into
master
Choose a base branch
from
feat/worker
base: master
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Draft
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Member
Icebearbear
commented
Feb 11, 2020
•
edited
Loading
edited
- installed Pipenv for dependencies management
- installed requests library for HTTP request with pivenv
- get bearer token for Twittter api
- data fetching from Twitter api in JSON format
installed Pipenv for dependencies management installed libraries for HTTP request with pivenv installation details can be found in README.md Data fetching is done using requests library in worker.py before start fetching data, get all the keys and tokens required for this transaction all the detailscan be found in README.md
Jaimeloeuf
reviewed
Feb 11, 2020
Icebearbear
changed the title
Pipenv installation and Twitter API data fetch
Created Worker Branch
Feb 13, 2020
- installed a library called python-detonv to manage the environment variables files - edited README.md file
Jaimeloeuf
reviewed
Feb 15, 2020
|
1. deleted worker and moved logic into connect_to_postgres 2. updated env with postgres connection details 3. updated README to describe .env 4. added a section to describe postgres connection and queries into README
merge master to feat/worker for gitignore
Please update code to use logging module instead of prints |
1. installed SQLAlchemy as ORM with pipenv 2. made a connection to postgres database 3. inserted the data into database 4. updated README file to describe the ORM connection
- steps to creat and use env file - dscription of every variables in env file
Jaimeloeuf
reviewed
Apr 12, 2020
|
||
#ORM query | ||
query = tweets.insert().values(name = name , text = text , time = time).returning(tweets.c.id) | ||
result = connection.execute(query) | ||
|
||
else : | ||
print('Result for' , search_url , 'is unsuccesful') | ||
print('Request unsuccesful') |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Dont commit changes in ur py file when the commit is about ENV vars in README
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.