Spider Example
This example requires a single node with one GPU of at least 40GB memory.
- Download Spider 1.0 dataset from here and unzip it to the
datafolder. - Use
python spider_eval/convert_dataset.pyto convert the dataset to the parquet format. - Start ray:
bash ../../scripts/restart_ray.sh. To use Wandb, you need to set the WANDB_API_KEY environment variable before starting ray. - Run the agent:
VERL_API_BASE=http://localhost:9999/ python sql_agent.py. Usepython sql_agent.py --helpto see options like running multiple agents. - In another terminal, launch the training server:
bash train.sh.
Evaluation
Results are coming soon.