Spaces:
Sleeping
Sleeping
added link, fixed typo
Browse files
app.py
CHANGED
@@ -11,11 +11,12 @@ suite = evaluate.EvaluationSuite.load("Vipitis/ShaderEval") #downloads it
|
|
11 |
text = """# Welcome to the ShaderEval Suite.
|
12 |
|
13 |
This space hosts the ShaderEval Suite. more to follow soon.
|
|
|
14 |
|
15 |
# Task1: Return Completion
|
16 |
## Explanation
|
17 |
Modelled after the [CodeXGLUE code_completion_line](https://huggingface.co/datasets/code_x_glue_cc_code_completion_line) task.
|
18 |
-
Using the "return_completion" subset of the [Shadertoys-fine dataset](https://huggingface.co/datasets/
|
19 |
All preprocessing and post proessing is done by the custom evaluator for this suite. It should be as easy as just giving it a model checkpoint that can do the "text-generation" task.
|
20 |
Evaluated is currently with just [exact_match](https://huggingface.co/metrics/exact_match).
|
21 |
|
|
|
11 |
text = """# Welcome to the ShaderEval Suite.
|
12 |
|
13 |
This space hosts the ShaderEval Suite. more to follow soon.
|
14 |
+
For an interactive Demo and more information see the demo space [ShaderCoder](https://huggingface.co/spaces/Vipitis/ShaderCoder)
|
15 |
|
16 |
# Task1: Return Completion
|
17 |
## Explanation
|
18 |
Modelled after the [CodeXGLUE code_completion_line](https://huggingface.co/datasets/code_x_glue_cc_code_completion_line) task.
|
19 |
+
Using the "return_completion" subset of the [Shadertoys-fine dataset](https://huggingface.co/datasets/Vipitis/Shadertoys-fine).
|
20 |
All preprocessing and post proessing is done by the custom evaluator for this suite. It should be as easy as just giving it a model checkpoint that can do the "text-generation" task.
|
21 |
Evaluated is currently with just [exact_match](https://huggingface.co/metrics/exact_match).
|
22 |
|