feat: change the logic to handle dynamic batching #18514

Job	Run time
commit-lint	1m 12s
lint-flake-8	19s
check-black	1m 10s
check-docstring	1m 11s
code-injection	1m 24s
build-wheels (ubuntu-latest, 3.7, cp37-cp37m)	1m 25s
build-wheels (ubuntu-latest, 3.8, cp38-cp38)	1m 25s
build-wheels (ubuntu-latest, 3.9, cp39-cp39)	1m 23s
build-wheels (ubuntu-latest, 3.10, cp310-cp310)	1m 23s
build-wheels (ubuntu-latest, 3.11, cp311-cp311)	1m 22s
build-wheels (macos-latest, 3.8, 38, macosx_x86_64, x86_64, amd64)	1s
build-wheels (macos-latest, 3.9, 39, macosx_x86_64, x86_64, amd64)	1s
build-wheels (macos-latest, 3.10, 310, macosx_x86_64, x86_64, amd64)	1m 18s
build-wheels (macos-latest, 3.11, 311, macosx_x86_64, x86_64, amd64)	58s
build-wheels (macos-latest, 3.8, 38, macosx_arm64, arm64, arm64)	51s
build-wheels (macos-latest, 3.9, 39, macosx_arm64, arm64, arm64)	1s
build-wheels (macos-latest, 3.10, 310, macosx_arm64, arm64, arm64)	1m 22s
build-wheels (macos-latest, 3.11, 311, macosx_arm64, arm64, arm64)	1m 11s
docker-image-test	1s
hub-test	1s
k8s-flow-test	1s
k8s-deployment-test	1s
docker-compose-test	1s
import-test	1s
install-jina-ecosystem-test	1s
k8s-failures-test	1s
k8s-otel-test	1s
k8s-graceful-test	1s
prep-testbed	1s
core-test	1s
docarray-v-two-test	1s
success-all-test	4s
	18m 14s

Provide feedback