Issue: Ray Library Fails to Handle Irregular Paths with Missing Views

[curryqka]

Description

The Ray library is unable to handle irregular paths that contain missing views (e.g., six-view paths with missing perspectives). This results in a runtime error during processing, specifically when the image_paths variable is None, causing a TypeError in the replace_system_prompt function.

Error Details

Exception has occurred: RayTaskError(UserCodeException)
TypeError: argument of type 'NoneType' is not iterable

Stack Trace

ray::MapBatches(LLMPredictor)()
  File "/root/miniconda3/lib/python3.10/site-packages/ray/data/_internal/execution/util.py", line 78, in __call__
    return future.result()
  File "/high_perf_store/mlinfra-vepfs/wangjinghui/drive-bench/inference/llava1.5.py", line 73, in __call__
    system_prompts[idx] = replace_system_prompt(system_prompts[idx], image_paths)
  File "/high_perf_store/mlinfra-vepfs/wangjinghui/drive-bench/inference/utils.py", line 34, in replace_system_prompt
    if "nuscenes" in path:
TypeError: argument of type 'NoneType' is not iterable

[ldkong1205]

Hi @Daniel-xsy, please take a look at this issue, thanks!

[DrXuQian]

Same problem.