Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,47 @@
|
|
1 |
---
|
2 |
license: mit
|
|
|
|
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
license: mit
|
3 |
+
metrics:
|
4 |
+
- accuracy
|
5 |
---
|
6 |
+
|
7 |
+
# OpenShape Inference Library
|
8 |
+
|
9 |
+
## Installation
|
10 |
+
|
11 |
+
First, you have to install a recent version of [torch](//pytorch.org/get-started/locally/) and [dgl](//www.dgl.ai/pages/start.html).
|
12 |
+
|
13 |
+
Then install the following extra dependencies:
|
14 |
+
```bash
|
15 |
+
pip install torch.redstone einops huggingface_hub
|
16 |
+
```
|
17 |
+
|
18 |
+
Finally, install OpenShape by cloning the repository and running
|
19 |
+
```bash
|
20 |
+
pip install -e .
|
21 |
+
```
|
22 |
+
|
23 |
+
## Usage
|
24 |
+
|
25 |
+
### Loading an OpenShape model
|
26 |
+
|
27 |
+
```python
|
28 |
+
import openshape
|
29 |
+
pc_encoder = openshape.load_pc_encoder('openshape-pointbert-vitg14-rgb')
|
30 |
+
|
31 |
+
# Available models:
|
32 |
+
# openshape-pointbert-vitb32-rgb, trained against CLIP ViT-B/32
|
33 |
+
# openshape-pointbert-vitl14-rgb, trained against CLIP ViT-L/14
|
34 |
+
# openshape-pointbert-vitg14-rgb, trained against OpenCLIP ViT-bigG/14 (main model in paper)
|
35 |
+
```
|
36 |
+
|
37 |
+
Models accept point clouds of shape [B, 6, N] (XYZ-RGB) and trained with N = 10000.
|
38 |
+
|
39 |
+
Point clouds should be centered at centroid and normalized into the unit ball, and RGB values should have range [0, 1].
|
40 |
+
If you don't have RGB available in your point cloud, fill with [0.4, 0.4, 0.4].
|
41 |
+
|
42 |
+
**Note:** B/32 and L/14 models has gravity axis Y; G/14 model has gravity axis Z.
|
43 |
+
|
44 |
+
### Applications
|
45 |
+
|
46 |
+
Various downstream applications can be found in the demo directory.
|
47 |
+
Check the code at https://huggingface.co/spaces/OpenShape/openshape-demo/tree/main for usage.
|