Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

how could use ms-swift to do sft on video language model? #2993

Open
MengHao666 opened this issue Jan 26, 2025 · 0 comments
Open

how could use ms-swift to do sft on video language model? #2993

MengHao666 opened this issue Jan 26, 2025 · 0 comments

Comments

@MengHao666
Copy link

I need to run code on the machine of company.
the task need to submit infollowing format.
That is , I needd a entry, like "train.py" as the entry of main code.Could I use ms-swift, or I could not use ms-swift to start my train.

#!/bin/bash
#algo_name 用来指定pytorch版本号,目前支持pytorch180、pytorch1110、pytorch1131、pytorch201

args="--key=value \
 --key1=value1  \
--last-conv-stride=2"
echo "${args}"

# 可选 ENVS,每个环境变量之间用逗号分割,K1=V1,K2=V2
# 不支持环境变量V里面包含逗号,
# ENVS="NVTE_BWD_LAYERNORM_SM_MARGIN=4,NCCL_IB_QPS_PER_CONNECTION=4,CUDA_DEVICE_MAX_CONNECTIONS=1"
echo $ENVS
nebulactl run mdl --queue=队列名 \
                  --entry=train.py \
                  --algo_name=pytorch180 \
                  --worker_count=8 \
                  --user_params="$args" \
                  --file.cluster_file=./cluster.json \
                  --tables=your_input_odps_tables \   可选
                  --job_name=your_job_name \    可选
                  --max_failover_times=0 \   可选,训练任务无需配置
                  --env=${ENV} \可选
                  
                  
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant