Skip to content

Issues: modelscope/data-juicer

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

27 Open 173 Closed
27 Open 173 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Merge local and API LLM calling enhancement New feature or request
#490 opened Nov 15, 2024 by BeachWang
2 tasks done
@drcege @BeachWang
sharegpt format support question Further information is requested
#488 opened Nov 14, 2024 by IvanDeng0
3 tasks done
Checkpointer support for Ray-Mode enhancement New feature or request
#487 opened Nov 12, 2024 by yxdyc
2 tasks done
Distributed processing
@HYLcool @Cathy0908
@pan-x-c @yxdyc
1
编译安装时报错 question Further information is requested
#486 opened Nov 12, 2024 by charonkk
3 tasks done
Anyone tried DJ on multimodal datasets of more than 20M samples? question Further information is requested
#482 opened Nov 11, 2024 by serser
3 tasks done
@HYLcool @pan-x-c @yxdyc
windows系统支持 question Further information is requested
#477 opened Nov 6, 2024 by zytcharming
3 tasks done
Update of Jupyter Notebooks bug Something isn't working documentation Improvements or additions to documentation
#476 opened Nov 6, 2024 by HYLcool
@HYLcool @yxdyc
[Bug]: perplexity_filter 算子内存OOM bug Something isn't working
#474 opened Nov 5, 2024 by weiaicunzai
3 tasks done
@HYLcool @pan-x-c @yxdyc
How to calculate the image_text_similarity scores for both Chinese and English? dj:multimodal issues/PRs about multimodal data processing dj:op issues/PRs about some specific OPs question Further information is requested
#473 opened Nov 5, 2024 by weiaicunzai
@HYLcool
1
LLM造数据时需要try_num参数 enhancement New feature or request
#470 opened Nov 4, 2024 by BeachWang
2 tasks done
@drcege @BeachWang
1
如何获取tool_quality_classifier模块中[chinese，code,gtp3]这3个模型的权重? question Further information is requested
#467 opened Oct 30, 2024 by yaun248
3 tasks done
@HYLcool
1
How to use 'chinese_convert_mapper' ? question Further information is requested
#458 opened Oct 22, 2024 by abchbx
3 tasks done
@HYLcool
4
How to use ‘hf_model’ question Further information is requested
#457 opened Oct 22, 2024 by abchbx
3 tasks done
@HYLcool
3
[Bug]: librosa use lazy_loader which depend on python version bug Something isn't working
#453 opened Oct 17, 2024 by BeachWang
3 tasks done
1
[Feat]: Unified LLM Calling Management enhancement New feature or request
#451 opened Oct 16, 2024 by drcege
2 tasks done
@drcege @HYLcool
@Cathy0908 @zhijianma @pan-x-c @garyzhang99 @yxdyc
[Feat]: Automatic Version Matching During Installation enhancement New feature or request
#450 opened Oct 16, 2024 by drcege
2 tasks done
@drcege @HYLcool
@Cathy0908 @zhijianma @pan-x-c @garyzhang99 @yxdyc
[Feat]: Enhance Unit Test Coverage for Python and CUDA Compatibility enhancement New feature or request
#449 opened Oct 16, 2024 by drcege
2 tasks done
@drcege @HYLcool
@zhijianma @pan-x-c @garyzhang99 @yxdyc
Feedback on image_face_ratio_filter and Suggestion for a New image_face_counter_filter Operator enhancement New feature or request
#446 opened Oct 12, 2024 by TobyJasper
2 tasks done
@drcege @HYLcool
2
[Bug]: test_adapter 兼容性 bug Something isn't working
#441 opened Sep 29, 2024 by FailedNamed
3 tasks done
@HYLcool @yxdyc
2
[Bug]: KeyError: 'resource' bug Something isn't working
#440 opened Sep 29, 2024 by luckystar1992
3 tasks done
@HYLcool @yxdyc
1
Require fps filter and mapper for videos dj:op issues/PRs about some specific OPs enhancement New feature or request
#433 opened Sep 23, 2024 by BeachWang
@BeachWang
[Feat] Support explicit FusedOP that allows for the configuration and application of multiple operators in smaller, manageable batches dj:op issues/PRs about some specific OPs enhancement New feature or request
#413 opened Sep 2, 2024 by yxdyc
2 tasks done
1
@drcege @HYLcool
@BeachWang @yxdyc
2
[Feat] Support PythonCodesOperator and BashCodesOperator that wraps an existing python file, or some code snippets to be executed, such as the existing DJ tools. dj:op issues/PRs about some specific OPs enhancement New feature or request
#412 opened Sep 2, 2024 by yxdyc
2 tasks done
1
@drcege @HYLcool
@BeachWang @yxdyc @Qirui-jiao
3
Guidance for OP with multiple data fields to be processed enhancement New feature or request
#411 opened Sep 2, 2024 by yxdyc
2 tasks done
2
[Bug]: librosa not work with np>1 bug Something isn't working dj:dist issues/PRs about distributed data processing dj:multimodal issues/PRs about multimodal data processing stale-issue
#372 opened Jul 29, 2024 by drcege
@drcege @HYLcool
2
ProTip! Exclude everything labeled bug with -label:bug.