-
Notifications
You must be signed in to change notification settings - Fork 103
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
add semantic search news article #507
Conversation
# we need to handle the timestamp being set in milliseconds | ||
business_news["date"] = [ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@morkapronczay
meaning the original timestamp is in milliseconds?
In kaggle, it looks like it's just dates - eg "date":string"2022-09-23"
As I understand it, the unix timestamp is in seconds.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
not sure about the kaggle text. Might have been me altering it when I filtered the dataset for myself. (probably when I read it it automatically converted it to date and I wrote it out like this)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@morkapronczay
The kaggle is just dates.
How should we discuss the conversion to seconds from milliseconds?
Or does the following snippet take care of converting from milliseconds (to seconds) whether your dataset has been read into milliseconds or not:
# we need to handle the timestamp being set in milliseconds
business_news["date"] = [
int(date.replace(tzinfo=timezone.utc).timestamp()) for date in business_news.date
]
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@morkapronczay no rush on this question above, just pinging you for when you get time. Thanks!
…perlinked/VectorHub into semantic-search-article---new
notebook article on semantic search, news