You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
We want the profiling tool to be able to display what input types were read from the spark event log when possible.
it should also indicate if one of the types isn't supported by the rapids plugin.
The text was updated successfully, but these errors were encountered:
so it looks like the datasource v1 does list all of the types read in the metadata in ReadSchema. This does not look like its the case for datasource v2 where it only puts it in the plan string so it gets truncated. I've only looked at parquet so far but for v1 we should be able to do this and v2 for possibly just a couple of columns
Is your feature request related to a problem? Please describe.
We want the profiling tool to be able to display what input types were read from the spark event log when possible.
it should also indicate if one of the types isn't supported by the rapids plugin.
The text was updated successfully, but these errors were encountered: