Update README.md
Browse files
README.md
CHANGED
@@ -7,4 +7,62 @@ sdk: static
|
|
7 |
pinned: false
|
8 |
---
|
9 |
|
10 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
7 |
pinned: false
|
8 |
---
|
9 |
|
10 |
+
<p>Arm’s AI development resources ensure you can deploy at pace, achieving best performance on Arm by default. Our aim is to make your AI development easier, ensuring integration with all major operating systems and AI frameworks, enabling portability for deploying AI on Arm at scale.</p>
|
11 |
+
<p>Discover below some key resources and content from Arm, including our software libraries and tools, that enable you to optimize for Arm architectures and pass-on significant performance uplift for models – from traditional ML and computer vision workloads to small and large language models - running on Arm-based devices.</p>
|
12 |
+
<br>
|
13 |
+
<strong>Arm Kleidi: Unleashing Mass-Market AI Performance on Arm</strong>
|
14 |
+
<p>Arm Kleidi is a targeted software suite, expediting optimizations for any framework and enabling accelerations for billions of AI workloads across Arm-based devices everywhere. Application developers achieve top performance by default, with no additional work or investment in new skills or tools training required.</p>
|
15 |
+
<p><b>Useful Resources on Arm Kleidi:</b></p>
|
16 |
+
<ul><p>
|
17 |
+
<li><a href="https://gitlab.arm.com/kleidi/kleidiai" target="_blank">Arm KleidiAI for optimising any AI framework</a></li>
|
18 |
+
<li><a href="https://gitlab.arm.com/kleidi/kleidicv" target="_blank">Arm KleidiCV for optimising any computer vision framework</a></li>
|
19 |
+
<li><a href="https://github.com/ARM-software/ComputeLibrary" target="_blank">Arm Compute Library for all AI software</a></li>
|
20 |
+
</p></ul>
|
21 |
+
<br>
|
22 |
+
<strong>Running LLMs on Mobile</strong>
|
23 |
+
<br>
|
24 |
+
<p>Our foundation of pervasiveness, flexible performance and energy efficiency mean that Arm CPUs are already the hardware of choice for a variety of AI workloads. Alongside Arm-based servers excelling with LLM workloads, the Arm Kleidi software suite, optimizations to our software libraries, combined with the <a href="https://github.com/ggerganov/llama.cpp" target="_blank">open-source llama.cpp project</a> enable generative AI to run efficiently on mobile devices.</p>
|
25 |
+
<p>Our work includes a virtual assistant demo which at first utilized Meta’s Llama2-7B LLM on mobile via a chat-based application, and has since expanded to include the Llama3 model and Phi-3 3.8B. <a href="https://community.arm.com/arm-community-blogs/b/ai-and-ml-blog/posts/generative-ai-on-mobile-on-arm-cpu" target="_blank">You can learn more about the technical implementation of the demos here. </a></p>
|
26 |
+
<p><b>Find out more about the community contributions that make this happen:</b></p>
|
27 |
+
<ul><p>
|
28 |
+
<li><a href="https://huggingface.co/TheBloke/Llama-2-7B-GGUF" target="_blank">Llama-2-7B-GGUF</a></li>
|
29 |
+
<li><a href="https://huggingface.co/TheBloke/phi-2-GGUF" target="_blank">Phi-2-GGUF</a></li>
|
30 |
+
<li><a href="https://huggingface.co/QuantFactory/Meta-Llama-3-8B-Instruct-GGUF" target="_blank">Meta-Llama-3-8B-Instruct-GGUF</a></li>
|
31 |
+
<li><a href="https://huggingface.co/SanctumAI/Phi-3-mini-4k-instruct-GGUF" target="_blank">Phi-3-mini-4k-instruct-GGUF</a></li>
|
32 |
+
<!-- Add more links here -->
|
33 |
+
</p></ul>
|
34 |
+
<p>These advancements are also highlighted in our Learning Paths below.</p>
|
35 |
+
<br>
|
36 |
+
<strong>AI on Arm in the Cloud</strong>
|
37 |
+
<br>
|
38 |
+
<p>Arm Neoverse platforms give our infrastructure partners access to leading performance, efficiency and unparalleled flexibility to innovate in pursuit of the optimal solutions for emerging AI workloads. The flexibility of the Neoverse platform enables our innovative hardware partners to closely integrate additional compute acceleration into their designs, creating a new generation of built-for-AI custom data center silicon.</p>
|
39 |
+
<p><b>Read the latest on AI-on-Neoverse:</b></p>
|
40 |
+
<ul><p><li>
|
41 |
+
<a href="https://newsroom.arm.com/blog/small-language-models-on-arm" target="_blank">Small Language Models: Efficient Arm Computing Enables a Custom AI Future</a>
|
42 |
+
</li>
|
43 |
+
<li>
|
44 |
+
<a href="https://community.arm.com/arm-community-blogs/b/infrastructure-solutions-blog/posts/best-in-class-llm-performance-on-arm-neoverse-v1-based-aws-graviton3-servers" target="_blank">Best-in-class LLM Performance on Arm Neoverse V1 based AWS Graviton3 CPUs</a>
|
45 |
+
</li></p>
|
46 |
+
</ul>
|
47 |
+
<!-- Add relevant links or content here -->
|
48 |
+
<br>
|
49 |
+
<strong>Arm Learning Paths</strong>
|
50 |
+
<br><p>Tutorials designed to help you develop quality Arm software faster.</p>
|
51 |
+
<ul><p>
|
52 |
+
<li>
|
53 |
+
<a href="https://learn.arm.com/learning-paths/servers-and-cloud-computing/llama-cpu/llama-chatbot/" class="underline" target="_blank">Run a Large Language model (LLM) chatbot on Arm servers</a>
|
54 |
+
</li>
|
55 |
+
<li>
|
56 |
+
<a href="https://learn.arm.com/learning-paths/servers-and-cloud-computing/nlp-hugging-face/pytorch-nlp-hf/" target="_blank">Deploy an NLP model using PyTorch on Arm-based device</a>
|
57 |
+
</li>
|
58 |
+
<li>
|
59 |
+
<a href="https://learn.arm.com/learning-paths/embedded-systems/llama-python-cpu/" target="_blank">Run a local LLM chatbot on a Raspberry Pi 5</a>
|
60 |
+
</li>
|
61 |
+
<li>
|
62 |
+
<a href="https://learn.arm.com/learning-paths/servers-and-cloud-computing/benchmark-nlp/" target="_blank">Accelerate Natural Language Processing (NLP) models from Hugging Face on Arm servers</a>
|
63 |
+
</li>
|
64 |
+
</p></ul>
|
65 |
+
<p>Contribute to our Learning Paths: <a href="https://github.com/ArmDeveloperEcosystem/arm-learning-paths/discussions/categories/ideas" target="_blank">suggest a new Learning Path</a> or <a href="https://learn.arm.com/learning-paths/cross-platform/_example-learning-path/" target="_blank">create one yourself </a>with support from the Arm community.</p>
|
66 |
+
<br>
|
67 |
+
<p><i><small>Note: The data collated here is sourced from Arm and third parties. While Arm uses reasonable efforts to keep this information accurate, Arm does not warrant (express or implied) or provide any guarantee of data correctness due to the ever-evolving AI and software landscape. Any links to third party sites and resources are provided for ease and convenience. Your use of such third-party sites and resources is subject to the third party’s terms of use, and use is at your own risk.</small></i></p>
|
68 |
+
</body>
|