Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add _type to all Telegram API objects in ndjson #368

Merged
merged 2 commits into from
Aug 22, 2023
Merged

Add _type to all Telegram API objects in ndjson #368

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
948d0d3
Add "_type" to *all* telethon.tl.types objects in ndjson
ianroberts Jun 23, 2023
dc6822d
Removed some redundant if branches.
ianroberts Jun 23, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
11 changes: 3 additions & 8 deletions datasources/telegram/search_telegram.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -675,24 +675,19 @@ def serialize_obj(input_obj):
mapped_obj[item] = value.timestamp()
elif type(value).__module__ in ("telethon.tl.types", "telethon.tl.custom.forward"):
mapped_obj[item] = SearchTelegram.serialize_obj(value)
if type(obj[item]) is not dict:
mapped_obj[item]["_type"] = type(value).__name__
elif type(value) is list:
mapped_obj[item] = [SearchTelegram.serialize_obj(item) for item in value]
elif type(value).__module__[0:8] == "telethon":
# some type of internal telethon struct
continue
elif type(value) is bytes:
mapped_obj[item] = value.hex()
elif type(value) not in scalars and value is not None:
# type we can't make sense of here
continue
elif type(value) is dict:
for key, vvalue in value:
mapped_obj[item][key] = SearchTelegram.serialize_obj(vvalue)
else:
mapped_obj[item] = value

# Add the _type if the original object was a telethon type
if type(input_obj).__module__ in ("telethon.tl.types", "telethon.tl.custom.forward"):
mapped_obj["_type"] = type(input_obj).__name__
return mapped_obj

@staticmethod
Expand Down