Skip to content

Commit 31ad82a

Browse files
Update tutorial with correct name for default output directory. (stanford-crfm#1907)
1 parent 7446f37 commit 31ad82a

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

docs/tutorial.md

+2-2
Original file line numberDiff line numberDiff line change
@@ -33,9 +33,9 @@ The meaning of the additional arguments are as follows:
3333
`helm-run` creates an environment directory environment and an output directory by default.
3434

3535
- The environment directory is `prod_env/` by default and can be set using `--local-path`. Credentials for making API calls should be added to a `credentials.conf` file in this directory.
36-
- The output directory is `benchmarking_output/` by default and can be set using `--output-path`.
36+
- The output directory is `benchmark_output/` by default and can be set using `--output-path`.
3737

38-
After running this command, navigate to the `benchmarking_output/runs/v1/` directory. This should contain a two sub-directories named `mmlu:subject=anatomy,model=huggingface_gpt-2` and `mmlu:subject=philosophy,model=huggingface_gpt-2`. Note that the names of these sub-directories is based on the run spec descriptions we used earlier, but with `/` replaced with `_`.
38+
After running this command, navigate to the `benchmark_output/runs/v1/` directory. This should contain a two sub-directories named `mmlu:subject=anatomy,model=huggingface_gpt-2` and `mmlu:subject=philosophy,model=huggingface_gpt-2`. Note that the names of these sub-directories is based on the run spec descriptions we used earlier, but with `/` replaced with `_`.
3939

4040
Each output sub-directory will contain several JSON files that were generated during the corresponding run:
4141

0 commit comments

Comments
 (0)