Quantcast
Channel: TAO Toolkit - NVIDIA Developer Forums
Viewing all articles
Browse latest Browse all 497

Detectnet2 TAO Toolkit model training fail on formating dataset on kitti format

$
0
0

Please provide the following information when requesting support.

• Hardware (T4)
• Network Type (Detectnet_v2)
• (launcher) glueck@glueck-WHITLEY:~/getting_started_v5.1.0/setup$ docker -v
Docker version 24.0.7, build afdd53b
detectnet_v2_tfrecords_kitti_trainval.txt (438 Bytes)

• Training spec file(If have, please share here)
• How to reproduce the issue ? (This is for errors. Please share the command line and the detailed log here.)

import os

Set your environment variables if not set already

os.environ[“LOCAL_DATA_DIR”] = “/home/glueck/getting_started_v5.1.0/notebooks/tao_launcher_starter_kit/PenangModelDetection/data”
os.environ[“SPECS_DIR”] = “/home/glueck/getting_started_v5.1.0/notebooks/tao_launcher_starter_kit/PenangModelDetection/specs”
os.environ[“USER_EXPERIMENT_DIR”] = “/workspace/tao-experiments/detectnet_v2”

Create a new directory for the output TFRecords dump

output_tfrecords_dir = os.path.join(os.environ[“LOCAL_DATA_DIR”], “tfrecords”, “kitti_trainval”)
os.makedirs(output_tfrecords_dir, exist_ok=True)
os.system(f’rm -rf {output_tfrecords_dir}/*')

Run the dataset conversion using TAO

print(“Converting Tfrecords for Penang dataset”)
!tao model detectnet_v2 dataset_convert
-d $SPECS_DIR/detectnet_v2_tfrecords_kitti_trainval.txt
-o $output_tfrecords_dir
-r $USER_EXPERIMENT_DIR/

Traceback (most recent call last):
File “/home/glueck/miniconda3/envs/launcher/bin/tao”, line 8, in
sys.exit(main())
File “/home/glueck/miniconda3/envs/launcher/lib/python3.7/site-packages/nvidia_tao_cli/entrypoint/tao_launcher.py”, line 137, in main
args[2:]
File “/home/glueck/miniconda3/envs/launcher/lib/python3.7/site-packages/nvidia_tao_cli/components/instance_handler/local_instance.py”, line 382, in launch_command
docker_handler.run_container(command)
File “/home/glueck/miniconda3/envs/launcher/lib/python3.7/site-packages/nvidia_tao_cli/components/docker_handler/docker_handler.py”, line 325, in run_container
self.pull()
File “/home/glueck/miniconda3/envs/launcher/lib/python3.7/site-packages/nvidia_tao_cli/components/docker_handler/docker_handler.py”, line 187, in pull
docker_pull_progress(line, progress)
File “/home/glueck/miniconda3/envs/launcher/lib/python3.7/site-packages/nvidia_tao_cli/components/docker_handler/docker_handler.py”, line 66, in docker_pull_progress
TASKS[idx] = progress.add_task(f"{idx}", total=line[‘progressDetail’][‘total’])
KeyError: ‘total’

69 posts - 2 participants

Read full topic


Viewing all articles
Browse latest Browse all 497

Trending Articles