Skip to content

Commit a3b3890

Browse files
authored
Add directory structure to Readme & add readme to PyPI (stanford-crfm#1901)
1 parent c2fbf61 commit a3b3890

File tree

2 files changed

+34
-1
lines changed

2 files changed

+34
-1
lines changed

README.md

+32
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,5 @@
11
<!--intro-start-->
2+
23
# Holistic Evaluation of Language Models
34

45
[comment]: <> (When using the img tag, which allows us to specify size, src has to be a URL.)
@@ -15,3 +16,34 @@ Welcome! The **`crfm-helm`** Python package contains code used in the **Holistic
1516
<!--intro-end-->
1617

1718
To get started, refer to [the documentation on Read the Docs](https://crfm-helm.readthedocs.io/) for how to install and run the package.
19+
20+
## Directory Structure
21+
22+
The directory structure for this repo is as follows
23+
24+
├── docs # MD used to generate readthedocs
25+
26+
├── scripts # Python utility scripts for HELM
27+
│ ├── cache
28+
│ ├── data_overlap # Calculate train test overlap
29+
│ │ ├── common
30+
│ │ ├── scenarios
31+
│ │ └── test
32+
│ ├── efficiency
33+
│ ├── fact_completion
34+
│ ├── offline_eval
35+
│ └── scale
36+
└── src
37+
├── helm # Benchmarking Scripts for HELM
38+
│ │
39+
│ ├── benchmark # Main Python code for running HELM
40+
│ │ │
41+
│ │ └── static # Current JS (Jquery) code for rendering front-end
42+
│ │ │
43+
│ │ └── ...
44+
│ │
45+
│ ├── common # Additional Python code for running HELM
46+
│ │
47+
│ └── proxy # Python code for external web requests
48+
49+
└── helm-frontend # New React Front-end

setup.cfg

+2-1
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,8 @@ version = 0.2.4
44
author = Stanford CRFM
55
author_email = [email protected]
66
description = Benchmark for language models
7-
long_description = Benchmark for language models
7+
long_description = file: README.md, docs/tutorial.md
8+
long_description_content_type = text/markdown
89
keywords = language models benchmarking
910
license = Apache License 2.0
1011
classifiers =

0 commit comments

Comments
 (0)